2026-02-13T03:26:45.379 INFO:root:teuthology version: 1.2.4.dev9+ga2c505dae 2026-02-13T03:26:45.396 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T03:26:45.476 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48095 branch: wip-pdonnell-testing-20260210.171210 description: fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/fs/norstats}} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '48095' kernel: sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: ec_profile: - disabled max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds use global snaprealm seq for subvol: false mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client dirsize rbytes: false client_fscrypt_dummy_encryption: true mds: mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.2 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - slow metadata IO - SLOW_OPS - slow request sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f subvols: create: 2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f kclient: client.0: mount_subvol_num: 1 rbytes: false selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: cfcf307502511ba51c39a8b9085c2fcde505d421 owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7166 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 604/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: cfcf307502511ba51c39a8b9085c2fcde505d421 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial096.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP8/Ppw+jWYE0SL4vyrH2uwxaTKC+O2dAcbROWYeqobZdUJBPs4wm6qqIQv+cV695ZVtusYcT6zjF58qx9djwR4= trial132.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFLdTn9UBCLVRhGjUZTgb64WGm5V58T4tk0zmpQB4bKaUPdS/HJIkpHFEVnJWwIC4nd1iYxqfJeGoBNoWk9SjCw= trial133.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBENPP4IBNUUgEI0gxK63zHEsuQIn0VOCqwcZAWnIzaWlaY1K7kvgnrzcs6Yn6zfU9fIHLA76lwhW1XF/01xIWq0= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: distro-suffix: rockylinux-10 roleless: false skip_dashboard: true - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.20 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: kernel-fix-3 teuthology_sha1: a2c505dae37458c5537fa44f1320bd04eef25bb1 timestamp: 2026-02-13_01:53:26 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-13T03:26:45.477 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa; will attempt to use it 2026-02-13T03:26:45.477 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks 2026-02-13T03:26:45.477 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-13T03:26:45.479 INFO:teuthology.task.internal:Checking packages... 2026-02-13T03:26:45.479 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-13T03:26:45.479 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-13T03:26:45.479 INFO:teuthology.packaging:ref: None 2026-02-13T03:26:45.479 INFO:teuthology.packaging:tag: None 2026-02-13T03:26:45.479 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-13T03:26:45.479 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:26:45.479 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-13T03:26:45.593 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-13T03:26:45.594 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-13T03:26:45.605 INFO:teuthology.task.internal:no buildpackages task found 2026-02-13T03:26:45.605 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-13T03:26:45.619 INFO:teuthology.task.internal:Saving configuration 2026-02-13T03:26:45.636 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-13T03:26:45.648 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-13T03:26:45.722 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial096.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48095', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 03:23:27.689417', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP8/Ppw+jWYE0SL4vyrH2uwxaTKC+O2dAcbROWYeqobZdUJBPs4wm6qqIQv+cV695ZVtusYcT6zjF58qx9djwR4='} 2026-02-13T03:26:45.776 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial132.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48095', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 03:23:27.690470', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFLdTn9UBCLVRhGjUZTgb64WGm5V58T4tk0zmpQB4bKaUPdS/HJIkpHFEVnJWwIC4nd1iYxqfJeGoBNoWk9SjCw='} 2026-02-13T03:26:45.832 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial133.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48095', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 03:23:27.690058', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBENPP4IBNUUgEI0gxK63zHEsuQIn0VOCqwcZAWnIzaWlaY1K7kvgnrzcs6Yn6zfU9fIHLA76lwhW1XF/01xIWq0='} 2026-02-13T03:26:45.832 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-13T03:26:45.843 INFO:teuthology.task.internal:roles: ubuntu@trial096.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2026-02-13T03:26:45.843 INFO:teuthology.task.internal:roles: ubuntu@trial132.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2026-02-13T03:26:45.843 INFO:teuthology.task.internal:roles: ubuntu@trial133.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2026-02-13T03:26:45.843 INFO:teuthology.run_tasks:Running task console_log... 2026-02-13T03:26:46.041 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7234304c6d40>, signals=[15]) 2026-02-13T03:26:46.042 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-13T03:26:46.053 INFO:teuthology.task.internal:Opening connections... 2026-02-13T03:26:46.053 DEBUG:teuthology.task.internal:connecting to ubuntu@trial096.front.sepia.ceph.com 2026-02-13T03:26:46.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:26:46.116 DEBUG:teuthology.task.internal:connecting to ubuntu@trial132.front.sepia.ceph.com 2026-02-13T03:26:46.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:26:46.178 DEBUG:teuthology.task.internal:connecting to ubuntu@trial133.front.sepia.ceph.com 2026-02-13T03:26:46.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:26:46.240 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-13T03:26:46.252 DEBUG:teuthology.orchestra.run.trial096:> uname -m 2026-02-13T03:26:46.268 INFO:teuthology.orchestra.run.trial096.stdout:x86_64 2026-02-13T03:26:46.268 DEBUG:teuthology.orchestra.run.trial096:> cat /etc/os-release 2026-02-13T03:26:46.324 INFO:teuthology.orchestra.run.trial096.stdout:NAME="CentOS Stream" 2026-02-13T03:26:46.324 INFO:teuthology.orchestra.run.trial096.stdout:VERSION="9" 2026-02-13T03:26:46.324 INFO:teuthology.orchestra.run.trial096.stdout:ID="centos" 2026-02-13T03:26:46.324 INFO:teuthology.orchestra.run.trial096.stdout:ID_LIKE="rhel fedora" 2026-02-13T03:26:46.324 INFO:teuthology.orchestra.run.trial096.stdout:VERSION_ID="9" 2026-02-13T03:26:46.324 INFO:teuthology.orchestra.run.trial096.stdout:PLATFORM_ID="platform:el9" 2026-02-13T03:26:46.324 INFO:teuthology.orchestra.run.trial096.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T03:26:46.324 INFO:teuthology.orchestra.run.trial096.stdout:ANSI_COLOR="0;31" 2026-02-13T03:26:46.324 INFO:teuthology.orchestra.run.trial096.stdout:LOGO="fedora-logo-icon" 2026-02-13T03:26:46.324 INFO:teuthology.orchestra.run.trial096.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T03:26:46.324 INFO:teuthology.orchestra.run.trial096.stdout:HOME_URL="https://centos.org/" 2026-02-13T03:26:46.324 INFO:teuthology.orchestra.run.trial096.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T03:26:46.324 INFO:teuthology.orchestra.run.trial096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T03:26:46.325 INFO:teuthology.orchestra.run.trial096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T03:26:46.325 INFO:teuthology.lock.ops:Updating trial096.front.sepia.ceph.com on lock server 2026-02-13T03:26:46.395 DEBUG:teuthology.orchestra.run.trial132:> uname -m 2026-02-13T03:26:46.410 INFO:teuthology.orchestra.run.trial132.stdout:x86_64 2026-02-13T03:26:46.410 DEBUG:teuthology.orchestra.run.trial132:> cat /etc/os-release 2026-02-13T03:26:46.467 INFO:teuthology.orchestra.run.trial132.stdout:NAME="CentOS Stream" 2026-02-13T03:26:46.467 INFO:teuthology.orchestra.run.trial132.stdout:VERSION="9" 2026-02-13T03:26:46.467 INFO:teuthology.orchestra.run.trial132.stdout:ID="centos" 2026-02-13T03:26:46.467 INFO:teuthology.orchestra.run.trial132.stdout:ID_LIKE="rhel fedora" 2026-02-13T03:26:46.467 INFO:teuthology.orchestra.run.trial132.stdout:VERSION_ID="9" 2026-02-13T03:26:46.468 INFO:teuthology.orchestra.run.trial132.stdout:PLATFORM_ID="platform:el9" 2026-02-13T03:26:46.468 INFO:teuthology.orchestra.run.trial132.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T03:26:46.468 INFO:teuthology.orchestra.run.trial132.stdout:ANSI_COLOR="0;31" 2026-02-13T03:26:46.468 INFO:teuthology.orchestra.run.trial132.stdout:LOGO="fedora-logo-icon" 2026-02-13T03:26:46.468 INFO:teuthology.orchestra.run.trial132.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T03:26:46.468 INFO:teuthology.orchestra.run.trial132.stdout:HOME_URL="https://centos.org/" 2026-02-13T03:26:46.468 INFO:teuthology.orchestra.run.trial132.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T03:26:46.468 INFO:teuthology.orchestra.run.trial132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T03:26:46.468 INFO:teuthology.orchestra.run.trial132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T03:26:46.468 INFO:teuthology.lock.ops:Updating trial132.front.sepia.ceph.com on lock server 2026-02-13T03:26:46.548 DEBUG:teuthology.orchestra.run.trial133:> uname -m 2026-02-13T03:26:46.563 INFO:teuthology.orchestra.run.trial133.stdout:x86_64 2026-02-13T03:26:46.563 DEBUG:teuthology.orchestra.run.trial133:> cat /etc/os-release 2026-02-13T03:26:46.619 INFO:teuthology.orchestra.run.trial133.stdout:NAME="CentOS Stream" 2026-02-13T03:26:46.619 INFO:teuthology.orchestra.run.trial133.stdout:VERSION="9" 2026-02-13T03:26:46.619 INFO:teuthology.orchestra.run.trial133.stdout:ID="centos" 2026-02-13T03:26:46.620 INFO:teuthology.orchestra.run.trial133.stdout:ID_LIKE="rhel fedora" 2026-02-13T03:26:46.620 INFO:teuthology.orchestra.run.trial133.stdout:VERSION_ID="9" 2026-02-13T03:26:46.620 INFO:teuthology.orchestra.run.trial133.stdout:PLATFORM_ID="platform:el9" 2026-02-13T03:26:46.620 INFO:teuthology.orchestra.run.trial133.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T03:26:46.620 INFO:teuthology.orchestra.run.trial133.stdout:ANSI_COLOR="0;31" 2026-02-13T03:26:46.620 INFO:teuthology.orchestra.run.trial133.stdout:LOGO="fedora-logo-icon" 2026-02-13T03:26:46.620 INFO:teuthology.orchestra.run.trial133.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T03:26:46.620 INFO:teuthology.orchestra.run.trial133.stdout:HOME_URL="https://centos.org/" 2026-02-13T03:26:46.620 INFO:teuthology.orchestra.run.trial133.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T03:26:46.620 INFO:teuthology.orchestra.run.trial133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T03:26:46.620 INFO:teuthology.orchestra.run.trial133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T03:26:46.620 INFO:teuthology.lock.ops:Updating trial133.front.sepia.ceph.com on lock server 2026-02-13T03:26:46.698 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-13T03:26:46.711 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-13T03:26:46.724 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-13T03:26:46.724 DEBUG:teuthology.orchestra.run.trial096:> test '!' -e /home/ubuntu/cephtest 2026-02-13T03:26:46.725 DEBUG:teuthology.orchestra.run.trial132:> test '!' -e /home/ubuntu/cephtest 2026-02-13T03:26:46.727 DEBUG:teuthology.orchestra.run.trial133:> test '!' -e /home/ubuntu/cephtest 2026-02-13T03:26:46.742 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-13T03:26:46.753 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-13T03:26:46.754 DEBUG:teuthology.orchestra.run.trial096:> test -z $(ls -A /var/lib/ceph) 2026-02-13T03:26:46.780 DEBUG:teuthology.orchestra.run.trial132:> test -z $(ls -A /var/lib/ceph) 2026-02-13T03:26:46.783 DEBUG:teuthology.orchestra.run.trial133:> test -z $(ls -A /var/lib/ceph) 2026-02-13T03:26:46.799 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-13T03:26:47.010 INFO:teuthology.run_tasks:Running task kernel... 2026-02-13T03:26:47.029 INFO:teuthology.task.kernel:normalize config orig: {'sha1': 'distro'} 2026-02-13T03:26:47.029 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro'}, 'mon.b': {'sha1': 'distro'}, 'mon.c': {'sha1': 'distro'}}, timeout 300 2026-02-13T03:26:47.029 DEBUG:teuthology.orchestra.run.trial096:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T03:26:47.030 DEBUG:teuthology.orchestra.run.trial132:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T03:26:47.030 DEBUG:teuthology.orchestra.run.trial133:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T03:26:47.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:26:47.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:26:47.045 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-13T03:26:47.045 DEBUG:teuthology.orchestra.run.trial096:> uname -r 2026-02-13T03:26:47.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:26:47.045 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-13T03:26:47.099 INFO:teuthology.orchestra.run.trial133.stdout:5.14.0-645.el9.x86_64 2026-02-13T03:26:47.100 INFO:teuthology.task.kernel:Running kernel on trial133: 5.14.0-645.el9.x86_64 2026-02-13T03:26:47.100 DEBUG:teuthology.orchestra.run.trial133:> sudo yum install -y kernel 2026-02-13T03:26:47.100 INFO:teuthology.orchestra.run.trial096.stdout:5.14.0-645.el9.x86_64 2026-02-13T03:26:47.100 INFO:teuthology.task.kernel:Running kernel on trial096: 5.14.0-645.el9.x86_64 2026-02-13T03:26:47.100 DEBUG:teuthology.orchestra.run.trial096:> sudo yum install -y kernel 2026-02-13T03:26:47.100 INFO:teuthology.orchestra.run.trial132.stdout:5.14.0-645.el9.x86_64 2026-02-13T03:26:47.101 INFO:teuthology.task.kernel:Running kernel on trial132: 5.14.0-645.el9.x86_64 2026-02-13T03:26:47.101 DEBUG:teuthology.orchestra.run.trial132:> sudo yum install -y kernel 2026-02-13T03:26:47.777 INFO:teuthology.orchestra.run.trial133.stdout:CentOS Stream 9 - BaseOS 29 MB/s | 8.9 MB 00:00 2026-02-13T03:26:49.166 INFO:teuthology.orchestra.run.trial132.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.9 MB 00:01 2026-02-13T03:26:49.864 INFO:teuthology.orchestra.run.trial096.stdout:CentOS Stream 9 - BaseOS 3.7 MB/s | 8.9 MB 00:02 2026-02-13T03:26:50.864 INFO:teuthology.orchestra.run.trial133.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-13T03:26:52.178 INFO:teuthology.orchestra.run.trial132.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-13T03:26:52.865 INFO:teuthology.orchestra.run.trial096.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-13T03:26:53.470 INFO:teuthology.orchestra.run.trial133.stdout:CentOS Stream 9 - CRB 34 MB/s | 7.8 MB 00:00 2026-02-13T03:26:54.393 INFO:teuthology.orchestra.run.trial133.stdout:CentOS Stream 9 - Extras packages 98 kB/s | 20 kB 00:00 2026-02-13T03:26:54.858 INFO:teuthology.orchestra.run.trial132.stdout:CentOS Stream 9 - CRB 27 MB/s | 7.8 MB 00:00 2026-02-13T03:26:55.942 INFO:teuthology.orchestra.run.trial133.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2026-02-13T03:26:56.576 INFO:teuthology.orchestra.run.trial132.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-13T03:26:57.052 INFO:teuthology.orchestra.run.trial132.stdout:Extra Packages for Enterprise Linux 50 MB/s | 20 MB 00:00 2026-02-13T03:26:57.224 INFO:teuthology.orchestra.run.trial096.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 7.8 MB 00:01 2026-02-13T03:26:58.749 INFO:teuthology.orchestra.run.trial096.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 20 kB 00:00 2026-02-13T03:26:59.152 INFO:teuthology.orchestra.run.trial133.stdout:lab-extras 2.0 MB/s | 50 kB 00:00 2026-02-13T03:27:00.211 INFO:teuthology.orchestra.run.trial133.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-13T03:27:00.230 INFO:teuthology.orchestra.run.trial133.stdout:Dependencies resolved. 2026-02-13T03:27:00.232 INFO:teuthology.orchestra.run.trial133.stdout:================================================================================ 2026-02-13T03:27:00.232 INFO:teuthology.orchestra.run.trial133.stdout: Package Architecture Version Repository Size 2026-02-13T03:27:00.232 INFO:teuthology.orchestra.run.trial133.stdout:================================================================================ 2026-02-13T03:27:00.232 INFO:teuthology.orchestra.run.trial133.stdout:Installing: 2026-02-13T03:27:00.232 INFO:teuthology.orchestra.run.trial133.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-13T03:27:00.232 INFO:teuthology.orchestra.run.trial133.stdout:Installing dependencies: 2026-02-13T03:27:00.232 INFO:teuthology.orchestra.run.trial133.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-13T03:27:00.232 INFO:teuthology.orchestra.run.trial133.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-13T03:27:00.232 INFO:teuthology.orchestra.run.trial133.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-13T03:27:00.232 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:27:00.232 INFO:teuthology.orchestra.run.trial133.stdout:Transaction Summary 2026-02-13T03:27:00.233 INFO:teuthology.orchestra.run.trial133.stdout:================================================================================ 2026-02-13T03:27:00.233 INFO:teuthology.orchestra.run.trial133.stdout:Install 4 Packages 2026-02-13T03:27:00.233 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:27:00.233 INFO:teuthology.orchestra.run.trial133.stdout:Total download size: 88 M 2026-02-13T03:27:00.233 INFO:teuthology.orchestra.run.trial133.stdout:Installed size: 135 M 2026-02-13T03:27:00.233 INFO:teuthology.orchestra.run.trial133.stdout:Downloading Packages: 2026-02-13T03:27:00.269 INFO:teuthology.orchestra.run.trial132.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-13T03:27:00.355 INFO:teuthology.orchestra.run.trial133.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 12 MB/s | 768 kB 00:00 2026-02-13T03:27:00.387 INFO:teuthology.orchestra.run.trial096.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2026-02-13T03:27:00.626 INFO:teuthology.orchestra.run.trial133.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 51 MB/s | 17 MB 00:00 2026-02-13T03:27:00.882 INFO:teuthology.orchestra.run.trial133.stdout:(3/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 67 MB/s | 40 MB 00:00 2026-02-13T03:27:00.995 INFO:teuthology.orchestra.run.trial133.stdout:(4/4): kernel-modules-core-5.14.0-677.el9.x86_6 48 MB/s | 31 MB 00:00 2026-02-13T03:27:00.995 INFO:teuthology.orchestra.run.trial133.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:27:00.995 INFO:teuthology.orchestra.run.trial133.stdout:Total 116 MB/s | 88 MB 00:00 2026-02-13T03:27:01.186 INFO:teuthology.orchestra.run.trial133.stdout:Running transaction check 2026-02-13T03:27:01.325 INFO:teuthology.orchestra.run.trial132.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-13T03:27:01.345 INFO:teuthology.orchestra.run.trial132.stdout:Dependencies resolved. 2026-02-13T03:27:01.346 INFO:teuthology.orchestra.run.trial132.stdout:================================================================================ 2026-02-13T03:27:01.346 INFO:teuthology.orchestra.run.trial132.stdout: Package Architecture Version Repository Size 2026-02-13T03:27:01.346 INFO:teuthology.orchestra.run.trial132.stdout:================================================================================ 2026-02-13T03:27:01.346 INFO:teuthology.orchestra.run.trial132.stdout:Installing: 2026-02-13T03:27:01.346 INFO:teuthology.orchestra.run.trial132.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-13T03:27:01.346 INFO:teuthology.orchestra.run.trial132.stdout:Installing dependencies: 2026-02-13T03:27:01.347 INFO:teuthology.orchestra.run.trial132.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-13T03:27:01.347 INFO:teuthology.orchestra.run.trial132.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-13T03:27:01.347 INFO:teuthology.orchestra.run.trial132.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-13T03:27:01.347 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:27:01.347 INFO:teuthology.orchestra.run.trial132.stdout:Transaction Summary 2026-02-13T03:27:01.347 INFO:teuthology.orchestra.run.trial132.stdout:================================================================================ 2026-02-13T03:27:01.347 INFO:teuthology.orchestra.run.trial132.stdout:Install 4 Packages 2026-02-13T03:27:01.347 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:27:01.347 INFO:teuthology.orchestra.run.trial132.stdout:Total download size: 88 M 2026-02-13T03:27:01.347 INFO:teuthology.orchestra.run.trial132.stdout:Installed size: 135 M 2026-02-13T03:27:01.347 INFO:teuthology.orchestra.run.trial132.stdout:Downloading Packages: 2026-02-13T03:27:01.391 INFO:teuthology.orchestra.run.trial133.stdout:Transaction check succeeded. 2026-02-13T03:27:01.391 INFO:teuthology.orchestra.run.trial133.stdout:Running transaction test 2026-02-13T03:27:01.506 INFO:teuthology.orchestra.run.trial132.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 11 MB/s | 768 kB 00:00 2026-02-13T03:27:01.619 INFO:teuthology.orchestra.run.trial132.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 93 MB/s | 17 MB 00:00 2026-02-13T03:27:01.723 INFO:teuthology.orchestra.run.trial132.stdout:(3/4): kernel-modules-core-5.14.0-677.el9.x86_6 142 MB/s | 31 MB 00:00 2026-02-13T03:27:01.736 INFO:teuthology.orchestra.run.trial133.stdout:Transaction test succeeded. 2026-02-13T03:27:01.737 INFO:teuthology.orchestra.run.trial133.stdout:Running transaction 2026-02-13T03:27:01.775 INFO:teuthology.orchestra.run.trial132.stdout:(4/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 117 MB/s | 40 MB 00:00 2026-02-13T03:27:01.777 INFO:teuthology.orchestra.run.trial132.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:27:01.777 INFO:teuthology.orchestra.run.trial132.stdout:Total 205 MB/s | 88 MB 00:00 2026-02-13T03:27:01.967 INFO:teuthology.orchestra.run.trial132.stdout:Running transaction check 2026-02-13T03:27:02.165 INFO:teuthology.orchestra.run.trial132.stdout:Transaction check succeeded. 2026-02-13T03:27:02.165 INFO:teuthology.orchestra.run.trial132.stdout:Running transaction test 2026-02-13T03:27:02.509 INFO:teuthology.orchestra.run.trial132.stdout:Transaction test succeeded. 2026-02-13T03:27:02.509 INFO:teuthology.orchestra.run.trial132.stdout:Running transaction 2026-02-13T03:27:02.830 INFO:teuthology.orchestra.run.trial133.stdout: Preparing : 1/1 2026-02-13T03:27:03.112 INFO:teuthology.orchestra.run.trial133.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-13T03:27:03.131 INFO:teuthology.orchestra.run.trial133.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T03:27:03.592 INFO:teuthology.orchestra.run.trial132.stdout: Preparing : 1/1 2026-02-13T03:27:03.617 INFO:teuthology.orchestra.run.trial096.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-13T03:27:03.877 INFO:teuthology.orchestra.run.trial132.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-13T03:27:03.895 INFO:teuthology.orchestra.run.trial132.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T03:27:04.676 INFO:teuthology.orchestra.run.trial096.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-13T03:27:04.696 INFO:teuthology.orchestra.run.trial096.stdout:Dependencies resolved. 2026-02-13T03:27:04.697 INFO:teuthology.orchestra.run.trial096.stdout:================================================================================ 2026-02-13T03:27:04.697 INFO:teuthology.orchestra.run.trial096.stdout: Package Architecture Version Repository Size 2026-02-13T03:27:04.697 INFO:teuthology.orchestra.run.trial096.stdout:================================================================================ 2026-02-13T03:27:04.697 INFO:teuthology.orchestra.run.trial096.stdout:Installing: 2026-02-13T03:27:04.697 INFO:teuthology.orchestra.run.trial096.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-13T03:27:04.697 INFO:teuthology.orchestra.run.trial096.stdout:Installing dependencies: 2026-02-13T03:27:04.697 INFO:teuthology.orchestra.run.trial096.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-13T03:27:04.698 INFO:teuthology.orchestra.run.trial096.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-13T03:27:04.698 INFO:teuthology.orchestra.run.trial096.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-13T03:27:04.698 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:27:04.698 INFO:teuthology.orchestra.run.trial096.stdout:Transaction Summary 2026-02-13T03:27:04.698 INFO:teuthology.orchestra.run.trial096.stdout:================================================================================ 2026-02-13T03:27:04.698 INFO:teuthology.orchestra.run.trial096.stdout:Install 4 Packages 2026-02-13T03:27:04.698 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:27:04.698 INFO:teuthology.orchestra.run.trial096.stdout:Total download size: 88 M 2026-02-13T03:27:04.698 INFO:teuthology.orchestra.run.trial096.stdout:Installed size: 135 M 2026-02-13T03:27:04.698 INFO:teuthology.orchestra.run.trial096.stdout:Downloading Packages: 2026-02-13T03:27:04.786 INFO:teuthology.orchestra.run.trial096.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 24 MB/s | 768 kB 00:00 2026-02-13T03:27:04.884 INFO:teuthology.orchestra.run.trial096.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 132 MB/s | 17 MB 00:00 2026-02-13T03:27:04.897 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T03:27:04.926 INFO:teuthology.orchestra.run.trial133.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T03:27:04.936 INFO:teuthology.orchestra.run.trial096.stdout:(3/4): kernel-modules-core-5.14.0-677.el9.x86_6 205 MB/s | 31 MB 00:00 2026-02-13T03:27:05.008 INFO:teuthology.orchestra.run.trial096.stdout:(4/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 157 MB/s | 40 MB 00:00 2026-02-13T03:27:05.008 INFO:teuthology.orchestra.run.trial096.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:27:05.008 INFO:teuthology.orchestra.run.trial096.stdout:Total 283 MB/s | 88 MB 00:00 2026-02-13T03:27:05.202 INFO:teuthology.orchestra.run.trial096.stdout:Running transaction check 2026-02-13T03:27:05.400 INFO:teuthology.orchestra.run.trial096.stdout:Transaction check succeeded. 2026-02-13T03:27:05.400 INFO:teuthology.orchestra.run.trial096.stdout:Running transaction test 2026-02-13T03:27:05.660 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T03:27:05.688 INFO:teuthology.orchestra.run.trial132.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T03:27:05.743 INFO:teuthology.orchestra.run.trial096.stdout:Transaction test succeeded. 2026-02-13T03:27:05.744 INFO:teuthology.orchestra.run.trial096.stdout:Running transaction 2026-02-13T03:27:06.833 INFO:teuthology.orchestra.run.trial096.stdout: Preparing : 1/1 2026-02-13T03:27:07.121 INFO:teuthology.orchestra.run.trial096.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-13T03:27:07.140 INFO:teuthology.orchestra.run.trial096.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T03:27:07.945 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T03:27:07.952 INFO:teuthology.orchestra.run.trial133.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:27:08.716 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T03:27:08.724 INFO:teuthology.orchestra.run.trial132.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:27:08.901 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T03:27:08.929 INFO:teuthology.orchestra.run.trial096.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T03:27:10.985 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:27:11.841 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:27:12.019 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T03:27:12.025 INFO:teuthology.orchestra.run.trial096.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:27:15.255 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:27:41.584 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:27:41.606 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:27:41.671 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:27:41.671 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-13T03:27:41.671 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T03:27:41.671 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T03:27:41.723 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:27:41.723 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:27:41.723 INFO:teuthology.orchestra.run.trial133.stdout:Installed: 2026-02-13T03:27:41.723 INFO:teuthology.orchestra.run.trial133.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-13T03:27:41.724 INFO:teuthology.orchestra.run.trial133.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-13T03:27:41.724 INFO:teuthology.orchestra.run.trial133.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-13T03:27:41.724 INFO:teuthology.orchestra.run.trial133.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-13T03:27:41.724 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:27:41.724 INFO:teuthology.orchestra.run.trial133.stdout:Complete! 2026-02-13T03:27:41.782 DEBUG:teuthology.orchestra.run.trial133:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T03:27:41.807 INFO:teuthology.orchestra.run.trial133.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T03:27:41.808 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T03:27:41.808 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-13T03:27:41.809 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-13T03:27:41.809 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-13T03:27:41.809 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2026-02-13T03:27:41.809 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial133.front.sepia.ceph.com, path=None, version=distro) 2026-02-13T03:27:41.809 DEBUG:teuthology.orchestra.run.trial133:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T03:27:41.871 INFO:teuthology.orchestra.run.trial133.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T03:27:41.872 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T03:27:41.873 DEBUG:teuthology.orchestra.run.trial133:> sudo rpm -qi grub2-tools 2026-02-13T03:27:41.940 INFO:teuthology.orchestra.run.trial133.stdout:Name : grub2-tools 2026-02-13T03:27:41.940 INFO:teuthology.orchestra.run.trial133.stdout:Epoch : 1 2026-02-13T03:27:41.940 INFO:teuthology.orchestra.run.trial133.stdout:Version : 2.06 2026-02-13T03:27:41.940 INFO:teuthology.orchestra.run.trial133.stdout:Release : 118.el9 2026-02-13T03:27:41.940 INFO:teuthology.orchestra.run.trial133.stdout:Architecture: x86_64 2026-02-13T03:27:41.941 INFO:teuthology.orchestra.run.trial133.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-13T03:27:41.941 INFO:teuthology.orchestra.run.trial133.stdout:Group : Unspecified 2026-02-13T03:27:41.941 INFO:teuthology.orchestra.run.trial133.stdout:Size : 8393909 2026-02-13T03:27:41.941 INFO:teuthology.orchestra.run.trial133.stdout:License : GPLv3+ 2026-02-13T03:27:41.941 INFO:teuthology.orchestra.run.trial133.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-13T03:27:41.941 INFO:teuthology.orchestra.run.trial133.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-13T03:27:41.941 INFO:teuthology.orchestra.run.trial133.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-13T03:27:41.941 INFO:teuthology.orchestra.run.trial133.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-13T03:27:41.941 INFO:teuthology.orchestra.run.trial133.stdout:Packager : builder@centos.org 2026-02-13T03:27:41.941 INFO:teuthology.orchestra.run.trial133.stdout:Vendor : CentOS 2026-02-13T03:27:41.941 INFO:teuthology.orchestra.run.trial133.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-13T03:27:41.941 INFO:teuthology.orchestra.run.trial133.stdout:Summary : Support tools for GRUB. 2026-02-13T03:27:41.942 INFO:teuthology.orchestra.run.trial133.stdout:Description : 2026-02-13T03:27:41.942 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:27:41.942 INFO:teuthology.orchestra.run.trial133.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-13T03:27:41.942 INFO:teuthology.orchestra.run.trial133.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-13T03:27:41.942 INFO:teuthology.orchestra.run.trial133.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-13T03:27:41.942 INFO:teuthology.orchestra.run.trial133.stdout:hardware devices. 2026-02-13T03:27:41.942 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:27:41.942 INFO:teuthology.orchestra.run.trial133.stdout:This subpackage provides tools for support of all platforms. 2026-02-13T03:27:41.943 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-13T03:27:41.943 INFO:teuthology.task.kernel:Updating grub on trial133 to boot 5.14.0-677.el9.x86_64 2026-02-13T03:27:41.943 DEBUG:teuthology.orchestra.run.trial133:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-13T03:27:42.007 INFO:teuthology.orchestra.run.trial133.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-13T03:27:42.009 DEBUG:teuthology.orchestra.run.trial133:> sudo command -v grubby && echo yes || echo no 2026-02-13T03:27:42.073 INFO:teuthology.orchestra.run.trial133.stdout:/sbin/grubby 2026-02-13T03:27:42.074 INFO:teuthology.orchestra.run.trial133.stdout:yes 2026-02-13T03:27:42.075 DEBUG:teuthology.orchestra.run.trial133:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-13T03:27:42.139 INFO:teuthology.orchestra.run.trial133.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-13T03:27:42.140 DEBUG:teuthology.orchestra.run.trial133:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-13T03:27:42.214 DEBUG:teuthology.orchestra.run.trial133:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-13T03:27:42.347 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:27:42.369 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:27:42.425 INFO:teuthology.orchestra.run.trial133.stderr:Generating grub configuration file ... 2026-02-13T03:27:42.491 INFO:teuthology.orchestra.run.trial133.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-13T03:27:42.497 INFO:teuthology.orchestra.run.trial133.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-13T03:27:42.540 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:27:42.540 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-13T03:27:42.540 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T03:27:42.540 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T03:27:42.592 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:27:42.592 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:27:42.592 INFO:teuthology.orchestra.run.trial132.stdout:Installed: 2026-02-13T03:27:42.592 INFO:teuthology.orchestra.run.trial132.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-13T03:27:42.592 INFO:teuthology.orchestra.run.trial132.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-13T03:27:42.592 INFO:teuthology.orchestra.run.trial132.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-13T03:27:42.592 INFO:teuthology.orchestra.run.trial132.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-13T03:27:42.592 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:27:42.593 INFO:teuthology.orchestra.run.trial132.stdout:Complete! 2026-02-13T03:27:42.649 DEBUG:teuthology.orchestra.run.trial132:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T03:27:42.675 INFO:teuthology.orchestra.run.trial132.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T03:27:42.676 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T03:27:42.676 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-13T03:27:42.676 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-13T03:27:42.676 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-13T03:27:42.677 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-13T03:27:42.677 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial132.front.sepia.ceph.com, path=None, version=distro) 2026-02-13T03:27:42.677 DEBUG:teuthology.orchestra.run.trial132:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T03:27:42.739 INFO:teuthology.orchestra.run.trial132.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T03:27:42.740 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T03:27:42.740 DEBUG:teuthology.orchestra.run.trial132:> sudo rpm -qi grub2-tools 2026-02-13T03:27:42.751 INFO:teuthology.orchestra.run.trial133.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-13T03:27:42.757 INFO:teuthology.orchestra.run.trial133.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-13T03:27:42.788 INFO:teuthology.orchestra.run.trial133.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-13T03:27:42.795 INFO:teuthology.orchestra.run.trial133.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-13T03:27:42.808 INFO:teuthology.orchestra.run.trial132.stdout:Name : grub2-tools 2026-02-13T03:27:42.808 INFO:teuthology.orchestra.run.trial132.stdout:Epoch : 1 2026-02-13T03:27:42.808 INFO:teuthology.orchestra.run.trial132.stdout:Version : 2.06 2026-02-13T03:27:42.808 INFO:teuthology.orchestra.run.trial132.stdout:Release : 118.el9 2026-02-13T03:27:42.808 INFO:teuthology.orchestra.run.trial132.stdout:Architecture: x86_64 2026-02-13T03:27:42.808 INFO:teuthology.orchestra.run.trial132.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-13T03:27:42.808 INFO:teuthology.orchestra.run.trial132.stdout:Group : Unspecified 2026-02-13T03:27:42.809 INFO:teuthology.orchestra.run.trial132.stdout:Size : 8393909 2026-02-13T03:27:42.809 INFO:teuthology.orchestra.run.trial132.stdout:License : GPLv3+ 2026-02-13T03:27:42.809 INFO:teuthology.orchestra.run.trial132.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-13T03:27:42.809 INFO:teuthology.orchestra.run.trial132.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-13T03:27:42.809 INFO:teuthology.orchestra.run.trial132.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-13T03:27:42.809 INFO:teuthology.orchestra.run.trial132.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-13T03:27:42.809 INFO:teuthology.orchestra.run.trial132.stdout:Packager : builder@centos.org 2026-02-13T03:27:42.809 INFO:teuthology.orchestra.run.trial132.stdout:Vendor : CentOS 2026-02-13T03:27:42.809 INFO:teuthology.orchestra.run.trial132.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-13T03:27:42.809 INFO:teuthology.orchestra.run.trial132.stdout:Summary : Support tools for GRUB. 2026-02-13T03:27:42.809 INFO:teuthology.orchestra.run.trial132.stdout:Description : 2026-02-13T03:27:42.810 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:27:42.810 INFO:teuthology.orchestra.run.trial132.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-13T03:27:42.810 INFO:teuthology.orchestra.run.trial132.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-13T03:27:42.810 INFO:teuthology.orchestra.run.trial132.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-13T03:27:42.810 INFO:teuthology.orchestra.run.trial132.stdout:hardware devices. 2026-02-13T03:27:42.810 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:27:42.810 INFO:teuthology.orchestra.run.trial132.stdout:This subpackage provides tools for support of all platforms. 2026-02-13T03:27:42.811 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-13T03:27:42.811 INFO:teuthology.task.kernel:Updating grub on trial132 to boot 5.14.0-677.el9.x86_64 2026-02-13T03:27:42.811 DEBUG:teuthology.orchestra.run.trial132:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-13T03:27:42.817 INFO:teuthology.orchestra.run.trial133.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-13T03:27:42.824 INFO:teuthology.orchestra.run.trial133.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-13T03:27:42.875 INFO:teuthology.orchestra.run.trial132.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-13T03:27:42.876 DEBUG:teuthology.orchestra.run.trial132:> sudo command -v grubby && echo yes || echo no 2026-02-13T03:27:42.906 INFO:teuthology.orchestra.run.trial133.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T03:27:42.914 INFO:teuthology.orchestra.run.trial133.stderr:done 2026-02-13T03:27:42.916 DEBUG:teuthology.orchestra.run.trial133:> test -d /sys/firmware/efi 2026-02-13T03:27:42.931 DEBUG:teuthology.orchestra.run.trial133:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-13T03:27:42.940 INFO:teuthology.orchestra.run.trial132.stdout:/sbin/grubby 2026-02-13T03:27:42.941 INFO:teuthology.orchestra.run.trial132.stdout:yes 2026-02-13T03:27:42.942 DEBUG:teuthology.orchestra.run.trial132:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-13T03:27:42.996 INFO:teuthology.orchestra.run.trial133.stdout:/boot/efi/EFI/BOOT 2026-02-13T03:27:42.996 INFO:teuthology.orchestra.run.trial133.stdout:/boot/efi/EFI/centos 2026-02-13T03:27:42.998 DEBUG:teuthology.orchestra.run.trial133:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-13T03:27:43.006 INFO:teuthology.orchestra.run.trial132.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-13T03:27:43.006 DEBUG:teuthology.orchestra.run.trial132:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-13T03:27:43.064 INFO:teuthology.orchestra.run.trial133.stdout:no 2026-02-13T03:27:43.064 DEBUG:teuthology.orchestra.run.trial133:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-13T03:27:43.079 DEBUG:teuthology.orchestra.run.trial132:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-13T03:27:43.129 INFO:teuthology.orchestra.run.trial133.stdout:yes 2026-02-13T03:27:43.129 DEBUG:teuthology.orchestra.run.trial133:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-13T03:27:43.193 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial133 2026-02-13T03:27:43.193 DEBUG:teuthology.orchestra.run.trial133:> sudo bash -c 'echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-13T03:27:43.287 INFO:teuthology.orchestra.run.trial132.stderr:Generating grub configuration file ... 2026-02-13T03:27:43.350 INFO:teuthology.orchestra.run.trial132.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-13T03:27:43.356 INFO:teuthology.orchestra.run.trial132.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-13T03:27:43.608 INFO:teuthology.orchestra.run.trial132.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-13T03:27:43.615 INFO:teuthology.orchestra.run.trial132.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-13T03:27:43.646 INFO:teuthology.orchestra.run.trial132.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-13T03:27:43.653 INFO:teuthology.orchestra.run.trial132.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-13T03:27:43.675 INFO:teuthology.orchestra.run.trial132.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-13T03:27:43.681 INFO:teuthology.orchestra.run.trial132.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-13T03:27:43.763 INFO:teuthology.orchestra.run.trial132.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T03:27:43.771 INFO:teuthology.orchestra.run.trial132.stderr:done 2026-02-13T03:27:43.774 DEBUG:teuthology.orchestra.run.trial132:> test -d /sys/firmware/efi 2026-02-13T03:27:43.790 DEBUG:teuthology.orchestra.run.trial132:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-13T03:27:43.854 INFO:teuthology.orchestra.run.trial132.stdout:/boot/efi/EFI/BOOT 2026-02-13T03:27:43.854 INFO:teuthology.orchestra.run.trial132.stdout:/boot/efi/EFI/centos 2026-02-13T03:27:43.856 DEBUG:teuthology.orchestra.run.trial132:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-13T03:27:43.924 INFO:teuthology.orchestra.run.trial132.stdout:no 2026-02-13T03:27:43.924 DEBUG:teuthology.orchestra.run.trial132:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-13T03:27:43.988 INFO:teuthology.orchestra.run.trial132.stdout:yes 2026-02-13T03:27:43.989 DEBUG:teuthology.orchestra.run.trial132:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-13T03:27:44.052 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial132 2026-02-13T03:27:44.052 DEBUG:teuthology.orchestra.run.trial132:> sudo bash -c 'echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-13T03:27:45.534 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:27:45.557 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:27:45.620 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:27:45.620 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-13T03:27:45.620 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T03:27:45.620 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T03:27:45.672 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:27:45.672 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:27:45.672 INFO:teuthology.orchestra.run.trial096.stdout:Installed: 2026-02-13T03:27:45.672 INFO:teuthology.orchestra.run.trial096.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-13T03:27:45.672 INFO:teuthology.orchestra.run.trial096.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-13T03:27:45.672 INFO:teuthology.orchestra.run.trial096.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-13T03:27:45.672 INFO:teuthology.orchestra.run.trial096.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-13T03:27:45.672 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:27:45.672 INFO:teuthology.orchestra.run.trial096.stdout:Complete! 2026-02-13T03:27:45.730 DEBUG:teuthology.orchestra.run.trial096:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T03:27:45.756 INFO:teuthology.orchestra.run.trial096.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T03:27:45.757 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T03:27:45.757 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-13T03:27:45.758 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-13T03:27:45.758 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-13T03:27:45.758 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-13T03:27:45.758 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial096.front.sepia.ceph.com, path=None, version=distro) 2026-02-13T03:27:45.758 DEBUG:teuthology.orchestra.run.trial096:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T03:27:45.821 INFO:teuthology.orchestra.run.trial096.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T03:27:45.822 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T03:27:45.822 DEBUG:teuthology.orchestra.run.trial096:> sudo rpm -qi grub2-tools 2026-02-13T03:27:45.891 INFO:teuthology.orchestra.run.trial096.stdout:Name : grub2-tools 2026-02-13T03:27:45.892 INFO:teuthology.orchestra.run.trial096.stdout:Epoch : 1 2026-02-13T03:27:45.892 INFO:teuthology.orchestra.run.trial096.stdout:Version : 2.06 2026-02-13T03:27:45.892 INFO:teuthology.orchestra.run.trial096.stdout:Release : 118.el9 2026-02-13T03:27:45.892 INFO:teuthology.orchestra.run.trial096.stdout:Architecture: x86_64 2026-02-13T03:27:45.892 INFO:teuthology.orchestra.run.trial096.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-13T03:27:45.892 INFO:teuthology.orchestra.run.trial096.stdout:Group : Unspecified 2026-02-13T03:27:45.892 INFO:teuthology.orchestra.run.trial096.stdout:Size : 8393909 2026-02-13T03:27:45.892 INFO:teuthology.orchestra.run.trial096.stdout:License : GPLv3+ 2026-02-13T03:27:45.892 INFO:teuthology.orchestra.run.trial096.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-13T03:27:45.892 INFO:teuthology.orchestra.run.trial096.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-13T03:27:45.892 INFO:teuthology.orchestra.run.trial096.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-13T03:27:45.893 INFO:teuthology.orchestra.run.trial096.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-13T03:27:45.893 INFO:teuthology.orchestra.run.trial096.stdout:Packager : builder@centos.org 2026-02-13T03:27:45.893 INFO:teuthology.orchestra.run.trial096.stdout:Vendor : CentOS 2026-02-13T03:27:45.893 INFO:teuthology.orchestra.run.trial096.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-13T03:27:45.893 INFO:teuthology.orchestra.run.trial096.stdout:Summary : Support tools for GRUB. 2026-02-13T03:27:45.893 INFO:teuthology.orchestra.run.trial096.stdout:Description : 2026-02-13T03:27:45.893 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:27:45.893 INFO:teuthology.orchestra.run.trial096.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-13T03:27:45.893 INFO:teuthology.orchestra.run.trial096.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-13T03:27:45.893 INFO:teuthology.orchestra.run.trial096.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-13T03:27:45.893 INFO:teuthology.orchestra.run.trial096.stdout:hardware devices. 2026-02-13T03:27:45.894 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:27:45.894 INFO:teuthology.orchestra.run.trial096.stdout:This subpackage provides tools for support of all platforms. 2026-02-13T03:27:45.895 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-13T03:27:45.895 INFO:teuthology.task.kernel:Updating grub on trial096 to boot 5.14.0-677.el9.x86_64 2026-02-13T03:27:45.895 DEBUG:teuthology.orchestra.run.trial096:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-13T03:27:45.959 INFO:teuthology.orchestra.run.trial096.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-13T03:27:45.960 DEBUG:teuthology.orchestra.run.trial096:> sudo command -v grubby && echo yes || echo no 2026-02-13T03:27:46.023 INFO:teuthology.orchestra.run.trial096.stdout:/sbin/grubby 2026-02-13T03:27:46.025 INFO:teuthology.orchestra.run.trial096.stdout:yes 2026-02-13T03:27:46.025 DEBUG:teuthology.orchestra.run.trial096:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-13T03:27:46.088 INFO:teuthology.orchestra.run.trial096.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-13T03:27:46.089 DEBUG:teuthology.orchestra.run.trial096:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-13T03:27:46.164 DEBUG:teuthology.orchestra.run.trial096:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-13T03:27:46.373 INFO:teuthology.orchestra.run.trial096.stderr:Generating grub configuration file ... 2026-02-13T03:27:46.434 INFO:teuthology.orchestra.run.trial096.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-13T03:27:46.440 INFO:teuthology.orchestra.run.trial096.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-13T03:27:46.688 INFO:teuthology.orchestra.run.trial096.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-13T03:27:46.695 INFO:teuthology.orchestra.run.trial096.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-13T03:27:46.726 INFO:teuthology.orchestra.run.trial096.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-13T03:27:46.733 INFO:teuthology.orchestra.run.trial096.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-13T03:27:46.756 INFO:teuthology.orchestra.run.trial096.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-13T03:27:46.763 INFO:teuthology.orchestra.run.trial096.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-13T03:27:46.844 INFO:teuthology.orchestra.run.trial096.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T03:27:46.853 INFO:teuthology.orchestra.run.trial096.stderr:done 2026-02-13T03:27:46.855 DEBUG:teuthology.orchestra.run.trial096:> test -d /sys/firmware/efi 2026-02-13T03:27:46.871 DEBUG:teuthology.orchestra.run.trial096:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-13T03:27:46.937 INFO:teuthology.orchestra.run.trial096.stdout:/boot/efi/EFI/BOOT 2026-02-13T03:27:46.937 INFO:teuthology.orchestra.run.trial096.stdout:/boot/efi/EFI/centos 2026-02-13T03:27:46.939 DEBUG:teuthology.orchestra.run.trial096:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-13T03:27:47.005 INFO:teuthology.orchestra.run.trial096.stdout:no 2026-02-13T03:27:47.006 DEBUG:teuthology.orchestra.run.trial096:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-13T03:27:47.069 INFO:teuthology.orchestra.run.trial096.stdout:yes 2026-02-13T03:27:47.069 DEBUG:teuthology.orchestra.run.trial096:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-13T03:27:47.135 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial096 2026-02-13T03:27:47.135 DEBUG:teuthology.orchestra.run.trial096:> sudo bash -c 'echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-13T03:28:13.236 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-13T03:28:13.236 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-13T03:28:13.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:28:14.095 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-13T03:28:14.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-13T03:28:14.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:28:17.177 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-13T03:28:17.178 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial096.front.sepia.ceph.com' 2026-02-13T03:28:17.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:28:27.549 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.133 2026-02-13T03:28:28.381 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.132 2026-02-13T03:28:31.453 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.96 2026-02-13T03:28:36.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-13T03:28:36.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:28:37.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-13T03:28:37.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:28:40.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial096.front.sepia.ceph.com' 2026-02-13T03:28:40.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:29:12.514 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-13T03:29:12.672 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-13T03:29:12.672 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-13T03:29:12.672 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-13T03:29:12.727 INFO:teuthology.orchestra.run.trial133.stdout:5.14.0-677.el9.x86_64 2026-02-13T03:29:12.728 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-13T03:29:12.728 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T03:29:12.728 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-13T03:29:13.508 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-13T03:29:13.676 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-13T03:29:13.676 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-13T03:29:13.677 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-13T03:29:13.729 DEBUG:teuthology.parallel:result is None 2026-02-13T03:29:13.733 INFO:teuthology.orchestra.run.trial132.stdout:5.14.0-677.el9.x86_64 2026-02-13T03:29:13.733 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-13T03:29:13.733 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T03:29:13.733 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-13T03:29:14.734 DEBUG:teuthology.parallel:result is None 2026-02-13T03:29:16.582 DEBUG:teuthology.orchestra.run.trial096:> true 2026-02-13T03:29:16.735 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial096.front.sepia.ceph.com' 2026-02-13T03:29:16.735 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-13T03:29:16.735 DEBUG:teuthology.orchestra.run.trial096:> uname -r 2026-02-13T03:29:16.792 INFO:teuthology.orchestra.run.trial096.stdout:5.14.0-677.el9.x86_64 2026-02-13T03:29:16.792 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-13T03:29:16.792 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T03:29:16.793 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-13T03:29:17.793 DEBUG:teuthology.parallel:result is None 2026-02-13T03:29:17.794 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-13T03:29:17.806 INFO:teuthology.task.internal:Creating test directory... 2026-02-13T03:29:17.806 DEBUG:teuthology.orchestra.run.trial096:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T03:29:17.809 DEBUG:teuthology.orchestra.run.trial132:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T03:29:17.812 DEBUG:teuthology.orchestra.run.trial133:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T03:29:17.829 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-13T03:29:17.841 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-13T03:29:17.854 INFO:teuthology.task.internal:Creating archive directory... 2026-02-13T03:29:17.855 DEBUG:teuthology.orchestra.run.trial096:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T03:29:17.866 DEBUG:teuthology.orchestra.run.trial132:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T03:29:17.868 DEBUG:teuthology.orchestra.run.trial133:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T03:29:17.896 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-13T03:29:17.907 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-13T03:29:17.907 DEBUG:teuthology.orchestra.run.trial096:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T03:29:17.922 DEBUG:teuthology.orchestra.run.trial132:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T03:29:17.925 DEBUG:teuthology.orchestra.run.trial133:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T03:29:17.948 INFO:teuthology.orchestra.run.trial096.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T03:29:17.951 INFO:teuthology.orchestra.run.trial132.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T03:29:17.955 INFO:teuthology.orchestra.run.trial133.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T03:29:17.957 INFO:teuthology.orchestra.run.trial096.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T03:29:17.960 INFO:teuthology.orchestra.run.trial132.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T03:29:17.964 INFO:teuthology.orchestra.run.trial133.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T03:29:17.965 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-13T03:29:17.978 INFO:teuthology.task.internal:Configuring sudo... 2026-02-13T03:29:17.978 DEBUG:teuthology.orchestra.run.trial096:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T03:29:18.002 DEBUG:teuthology.orchestra.run.trial132:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T03:29:18.006 DEBUG:teuthology.orchestra.run.trial133:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T03:29:18.033 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-13T03:29:18.052 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-13T03:29:18.064 DEBUG:teuthology.orchestra.run.trial096:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T03:29:18.068 DEBUG:teuthology.orchestra.run.trial132:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T03:29:18.075 DEBUG:teuthology.orchestra.run.trial133:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T03:29:18.097 DEBUG:teuthology.orchestra.run.trial096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T03:29:18.243 DEBUG:teuthology.orchestra.run.trial096:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T03:29:18.267 DEBUG:teuthology.orchestra.run.trial096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T03:29:18.406 DEBUG:teuthology.orchestra.run.trial096:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T03:29:18.431 DEBUG:teuthology.orchestra.run.trial096:> set -ex 2026-02-13T03:29:18.431 DEBUG:teuthology.orchestra.run.trial096:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T03:29:18.496 DEBUG:teuthology.orchestra.run.trial132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T03:29:18.608 DEBUG:teuthology.orchestra.run.trial132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T03:29:18.634 DEBUG:teuthology.orchestra.run.trial132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T03:29:18.779 DEBUG:teuthology.orchestra.run.trial132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T03:29:18.804 DEBUG:teuthology.orchestra.run.trial132:> set -ex 2026-02-13T03:29:18.804 DEBUG:teuthology.orchestra.run.trial132:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T03:29:18.867 DEBUG:teuthology.orchestra.run.trial133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T03:29:18.984 DEBUG:teuthology.orchestra.run.trial133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T03:29:19.009 DEBUG:teuthology.orchestra.run.trial133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T03:29:19.155 DEBUG:teuthology.orchestra.run.trial133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T03:29:19.180 DEBUG:teuthology.orchestra.run.trial133:> set -ex 2026-02-13T03:29:19.180 DEBUG:teuthology.orchestra.run.trial133:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T03:29:19.244 DEBUG:teuthology.orchestra.run.trial096:> sudo service rsyslog restart 2026-02-13T03:29:19.247 DEBUG:teuthology.orchestra.run.trial132:> sudo service rsyslog restart 2026-02-13T03:29:19.250 DEBUG:teuthology.orchestra.run.trial133:> sudo service rsyslog restart 2026-02-13T03:29:19.274 INFO:teuthology.orchestra.run.trial096.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T03:29:19.276 INFO:teuthology.orchestra.run.trial132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T03:29:19.312 INFO:teuthology.orchestra.run.trial133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T03:29:19.797 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-13T03:29:19.810 INFO:teuthology.task.internal:Starting timer... 2026-02-13T03:29:19.810 INFO:teuthology.run_tasks:Running task pcp... 2026-02-13T03:29:19.831 INFO:teuthology.run_tasks:Running task selinux... 2026-02-13T03:29:19.849 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-02-13T03:29:19.849 DEBUG:teuthology.orchestra.run.trial096:> sudo service auditd rotate 2026-02-13T03:29:19.878 INFO:teuthology.orchestra.run.trial096.stdout:Rotating logs: 2026-02-13T03:29:19.880 DEBUG:teuthology.orchestra.run.trial132:> sudo service auditd rotate 2026-02-13T03:29:19.910 INFO:teuthology.orchestra.run.trial132.stdout:Rotating logs: 2026-02-13T03:29:19.911 DEBUG:teuthology.orchestra.run.trial133:> sudo service auditd rotate 2026-02-13T03:29:19.941 INFO:teuthology.orchestra.run.trial133.stdout:Rotating logs: 2026-02-13T03:29:19.943 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-13T03:29:19.943 DEBUG:teuthology.orchestra.run.trial096:> /usr/sbin/getenforce 2026-02-13T03:29:19.959 INFO:teuthology.orchestra.run.trial096.stdout:Permissive 2026-02-13T03:29:19.959 DEBUG:teuthology.orchestra.run.trial132:> /usr/sbin/getenforce 2026-02-13T03:29:19.975 INFO:teuthology.orchestra.run.trial132.stdout:Permissive 2026-02-13T03:29:19.975 DEBUG:teuthology.orchestra.run.trial133:> /usr/sbin/getenforce 2026-02-13T03:29:19.998 INFO:teuthology.orchestra.run.trial133.stdout:Permissive 2026-02-13T03:29:19.999 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial096.front.sepia.ceph.com': 'permissive', 'ubuntu@trial132.front.sepia.ceph.com': 'permissive', 'ubuntu@trial133.front.sepia.ceph.com': 'permissive'} 2026-02-13T03:29:19.999 DEBUG:teuthology.orchestra.run.trial096:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T03:29:20.023 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:29:20.024 DEBUG:teuthology.orchestra.run.trial132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T03:29:20.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:29:20.049 DEBUG:teuthology.orchestra.run.trial133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T03:29:20.073 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:29:20.074 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-13T03:29:20.074 DEBUG:teuthology.orchestra.run.trial096:> sudo /usr/sbin/setenforce permissive 2026-02-13T03:29:20.098 DEBUG:teuthology.orchestra.run.trial132:> sudo /usr/sbin/setenforce permissive 2026-02-13T03:29:20.123 DEBUG:teuthology.orchestra.run.trial133:> sudo /usr/sbin/setenforce permissive 2026-02-13T03:29:20.146 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-13T03:29:20.161 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-13T03:29:20.172 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-13T03:29:20.173 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial096.front.sepia.ceph.com,trial132.front.sepia.ceph.com,trial133.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-13T03:30:29.996 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial096.front.sepia.ceph.com'), Remote(name='ubuntu@trial132.front.sepia.ceph.com'), Remote(name='ubuntu@trial133.front.sepia.ceph.com')] 2026-02-13T03:30:29.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial096.front.sepia.ceph.com' 2026-02-13T03:30:29.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:30:30.109 DEBUG:teuthology.orchestra.run.trial096:> true 2026-02-13T03:30:30.186 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial096.front.sepia.ceph.com' 2026-02-13T03:30:30.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-13T03:30:30.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:30:30.275 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-13T03:30:30.351 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-13T03:30:30.352 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-13T03:30:30.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:30:30.444 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-13T03:30:30.527 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-13T03:30:30.527 INFO:teuthology.run_tasks:Running task clock... 2026-02-13T03:30:30.542 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-13T03:30:30.542 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T03:30:30.543 DEBUG:teuthology.orchestra.run.trial096:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T03:30:30.545 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T03:30:30.545 DEBUG:teuthology.orchestra.run.trial132:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T03:30:30.548 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T03:30:30.548 DEBUG:teuthology.orchestra.run.trial133:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T03:30:30.571 INFO:teuthology.orchestra.run.trial096.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T03:30:30.574 INFO:teuthology.orchestra.run.trial132.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T03:30:30.583 INFO:teuthology.orchestra.run.trial096.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T03:30:30.586 INFO:teuthology.orchestra.run.trial132.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T03:30:30.593 INFO:teuthology.orchestra.run.trial133.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T03:30:30.602 INFO:teuthology.orchestra.run.trial096.stderr:sudo: ntpd: command not found 2026-02-13T03:30:30.605 INFO:teuthology.orchestra.run.trial133.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T03:30:30.606 INFO:teuthology.orchestra.run.trial132.stderr:sudo: ntpd: command not found 2026-02-13T03:30:30.611 INFO:teuthology.orchestra.run.trial096.stdout:506 Cannot talk to daemon 2026-02-13T03:30:30.616 INFO:teuthology.orchestra.run.trial132.stdout:506 Cannot talk to daemon 2026-02-13T03:30:30.623 INFO:teuthology.orchestra.run.trial096.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T03:30:30.625 INFO:teuthology.orchestra.run.trial133.stderr:sudo: ntpd: command not found 2026-02-13T03:30:30.628 INFO:teuthology.orchestra.run.trial132.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T03:30:30.634 INFO:teuthology.orchestra.run.trial096.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T03:30:30.635 INFO:teuthology.orchestra.run.trial133.stdout:506 Cannot talk to daemon 2026-02-13T03:30:30.639 INFO:teuthology.orchestra.run.trial132.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T03:30:30.647 INFO:teuthology.orchestra.run.trial133.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T03:30:30.658 INFO:teuthology.orchestra.run.trial133.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T03:30:30.681 INFO:teuthology.orchestra.run.trial096.stderr:bash: line 1: ntpq: command not found 2026-02-13T03:30:30.687 INFO:teuthology.orchestra.run.trial132.stderr:bash: line 1: ntpq: command not found 2026-02-13T03:30:30.703 INFO:teuthology.orchestra.run.trial096.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T03:30:30.704 INFO:teuthology.orchestra.run.trial096.stdout:=============================================================================== 2026-02-13T03:30:30.704 INFO:teuthology.orchestra.run.trial096.stdout:^? time-ord.far.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:30:30.704 INFO:teuthology.orchestra.run.trial096.stdout:^? ntp.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:30:30.704 INFO:teuthology.orchestra.run.trial096.stdout:^? 69-10-208-170.rainiercon> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:30:30.704 INFO:teuthology.orchestra.run.trial096.stdout:^? pool-96-231-54-40.washdc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:30:30.706 INFO:teuthology.orchestra.run.trial133.stderr:bash: line 1: ntpq: command not found 2026-02-13T03:30:30.711 INFO:teuthology.orchestra.run.trial132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T03:30:30.711 INFO:teuthology.orchestra.run.trial132.stdout:=============================================================================== 2026-02-13T03:30:30.711 INFO:teuthology.orchestra.run.trial132.stdout:^? time-dfw.far.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:30:30.711 INFO:teuthology.orchestra.run.trial132.stdout:^? 172-104-209-204.ip.linod> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:30:30.711 INFO:teuthology.orchestra.run.trial132.stdout:^? 23.186.168.129 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:30:30.711 INFO:teuthology.orchestra.run.trial132.stdout:^? t2.time.bf1.yahoo.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:30:30.721 INFO:teuthology.orchestra.run.trial133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T03:30:30.721 INFO:teuthology.orchestra.run.trial133.stdout:=============================================================================== 2026-02-13T03:30:30.721 INFO:teuthology.orchestra.run.trial133.stdout:^? ntp.shastacoe.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:30:30.721 INFO:teuthology.orchestra.run.trial133.stdout:^? pool-96-231-54-40.washdc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:30:30.721 INFO:teuthology.orchestra.run.trial133.stdout:^? 172-233-157-223.ip.linod> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:30:30.721 INFO:teuthology.orchestra.run.trial133.stdout:^? t2.time.gq1.yahoo.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:30:30.722 INFO:teuthology.run_tasks:Running task pexec... 2026-02-13T03:30:30.739 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-13T03:30:30.740 DEBUG:teuthology.orchestra.run.trial096:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T03:30:30.741 DEBUG:teuthology.orchestra.run.trial132:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T03:30:30.741 DEBUG:teuthology.orchestra.run.trial133:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T03:30:30.748 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial096.front.sepia.ceph.com 2026-02-13T03:30:30.748 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T03:30:30.748 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T03:30:30.755 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial132.front.sepia.ceph.com 2026-02-13T03:30:30.755 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T03:30:30.755 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T03:30:30.764 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial133.front.sepia.ceph.com 2026-02-13T03:30:30.765 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T03:30:30.765 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T03:30:30.918 INFO:teuthology.orchestra.run.trial096.stdout:No match for argument: nvme-cli 2026-02-13T03:30:30.919 INFO:teuthology.orchestra.run.trial096.stderr:No packages marked for removal. 2026-02-13T03:30:30.921 INFO:teuthology.orchestra.run.trial096.stdout:Dependencies resolved. 2026-02-13T03:30:30.921 INFO:teuthology.orchestra.run.trial096.stdout:Nothing to do. 2026-02-13T03:30:30.921 INFO:teuthology.orchestra.run.trial096.stdout:Complete! 2026-02-13T03:30:30.928 INFO:teuthology.orchestra.run.trial132.stdout:No match for argument: nvme-cli 2026-02-13T03:30:30.929 INFO:teuthology.orchestra.run.trial132.stderr:No packages marked for removal. 2026-02-13T03:30:30.931 INFO:teuthology.orchestra.run.trial132.stdout:Dependencies resolved. 2026-02-13T03:30:30.931 INFO:teuthology.orchestra.run.trial132.stdout:Nothing to do. 2026-02-13T03:30:30.932 INFO:teuthology.orchestra.run.trial132.stdout:Complete! 2026-02-13T03:30:30.936 INFO:teuthology.orchestra.run.trial133.stdout:No match for argument: nvme-cli 2026-02-13T03:30:30.936 INFO:teuthology.orchestra.run.trial133.stderr:No packages marked for removal. 2026-02-13T03:30:30.938 INFO:teuthology.orchestra.run.trial133.stdout:Dependencies resolved. 2026-02-13T03:30:30.939 INFO:teuthology.orchestra.run.trial133.stdout:Nothing to do. 2026-02-13T03:30:30.939 INFO:teuthology.orchestra.run.trial133.stdout:Complete! 2026-02-13T03:30:31.213 INFO:teuthology.orchestra.run.trial096.stdout:Last metadata expiration check: 0:00:30 ago on Fri 13 Feb 2026 03:30:01 AM UTC. 2026-02-13T03:30:31.232 INFO:teuthology.orchestra.run.trial133.stdout:Last metadata expiration check: 0:00:30 ago on Fri 13 Feb 2026 03:30:01 AM UTC. 2026-02-13T03:30:31.236 INFO:teuthology.orchestra.run.trial132.stdout:Last metadata expiration check: 0:00:29 ago on Fri 13 Feb 2026 03:30:02 AM UTC. 2026-02-13T03:30:31.294 INFO:teuthology.orchestra.run.trial096.stdout:Dependencies resolved. 2026-02-13T03:30:31.295 INFO:teuthology.orchestra.run.trial096.stdout:================================================================================ 2026-02-13T03:30:31.295 INFO:teuthology.orchestra.run.trial096.stdout: Package Architecture Version Repository Size 2026-02-13T03:30:31.295 INFO:teuthology.orchestra.run.trial096.stdout:================================================================================ 2026-02-13T03:30:31.295 INFO:teuthology.orchestra.run.trial096.stdout:Installing: 2026-02-13T03:30:31.296 INFO:teuthology.orchestra.run.trial096.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-13T03:30:31.296 INFO:teuthology.orchestra.run.trial096.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-13T03:30:31.296 INFO:teuthology.orchestra.run.trial096.stdout:Upgrading: 2026-02-13T03:30:31.296 INFO:teuthology.orchestra.run.trial096.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-13T03:30:31.296 INFO:teuthology.orchestra.run.trial096.stdout:Installing dependencies: 2026-02-13T03:30:31.296 INFO:teuthology.orchestra.run.trial096.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-13T03:30:31.296 INFO:teuthology.orchestra.run.trial096.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-13T03:30:31.296 INFO:teuthology.orchestra.run.trial096.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T03:30:31.296 INFO:teuthology.orchestra.run.trial096.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-13T03:30:31.296 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:30:31.296 INFO:teuthology.orchestra.run.trial096.stdout:Transaction Summary 2026-02-13T03:30:31.296 INFO:teuthology.orchestra.run.trial096.stdout:================================================================================ 2026-02-13T03:30:31.297 INFO:teuthology.orchestra.run.trial096.stdout:Install 6 Packages 2026-02-13T03:30:31.297 INFO:teuthology.orchestra.run.trial096.stdout:Upgrade 1 Package 2026-02-13T03:30:31.297 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:30:31.297 INFO:teuthology.orchestra.run.trial096.stdout:Total download size: 2.4 M 2026-02-13T03:30:31.297 INFO:teuthology.orchestra.run.trial096.stdout:Downloading Packages: 2026-02-13T03:30:31.313 INFO:teuthology.orchestra.run.trial133.stdout:Dependencies resolved. 2026-02-13T03:30:31.314 INFO:teuthology.orchestra.run.trial133.stdout:================================================================================ 2026-02-13T03:30:31.314 INFO:teuthology.orchestra.run.trial133.stdout: Package Architecture Version Repository Size 2026-02-13T03:30:31.314 INFO:teuthology.orchestra.run.trial133.stdout:================================================================================ 2026-02-13T03:30:31.315 INFO:teuthology.orchestra.run.trial133.stdout:Installing: 2026-02-13T03:30:31.315 INFO:teuthology.orchestra.run.trial133.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-13T03:30:31.315 INFO:teuthology.orchestra.run.trial133.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-13T03:30:31.315 INFO:teuthology.orchestra.run.trial133.stdout:Upgrading: 2026-02-13T03:30:31.315 INFO:teuthology.orchestra.run.trial133.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-13T03:30:31.315 INFO:teuthology.orchestra.run.trial133.stdout:Installing dependencies: 2026-02-13T03:30:31.315 INFO:teuthology.orchestra.run.trial133.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-13T03:30:31.315 INFO:teuthology.orchestra.run.trial133.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-13T03:30:31.315 INFO:teuthology.orchestra.run.trial133.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T03:30:31.315 INFO:teuthology.orchestra.run.trial133.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-13T03:30:31.315 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:30:31.315 INFO:teuthology.orchestra.run.trial133.stdout:Transaction Summary 2026-02-13T03:30:31.316 INFO:teuthology.orchestra.run.trial133.stdout:================================================================================ 2026-02-13T03:30:31.316 INFO:teuthology.orchestra.run.trial133.stdout:Install 6 Packages 2026-02-13T03:30:31.316 INFO:teuthology.orchestra.run.trial133.stdout:Upgrade 1 Package 2026-02-13T03:30:31.316 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:30:31.316 INFO:teuthology.orchestra.run.trial133.stdout:Total download size: 2.4 M 2026-02-13T03:30:31.316 INFO:teuthology.orchestra.run.trial133.stdout:Downloading Packages: 2026-02-13T03:30:31.317 INFO:teuthology.orchestra.run.trial132.stdout:Dependencies resolved. 2026-02-13T03:30:31.318 INFO:teuthology.orchestra.run.trial132.stdout:================================================================================ 2026-02-13T03:30:31.318 INFO:teuthology.orchestra.run.trial132.stdout: Package Architecture Version Repository Size 2026-02-13T03:30:31.318 INFO:teuthology.orchestra.run.trial132.stdout:================================================================================ 2026-02-13T03:30:31.318 INFO:teuthology.orchestra.run.trial132.stdout:Installing: 2026-02-13T03:30:31.319 INFO:teuthology.orchestra.run.trial132.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-13T03:30:31.319 INFO:teuthology.orchestra.run.trial132.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-13T03:30:31.319 INFO:teuthology.orchestra.run.trial132.stdout:Upgrading: 2026-02-13T03:30:31.319 INFO:teuthology.orchestra.run.trial132.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-13T03:30:31.319 INFO:teuthology.orchestra.run.trial132.stdout:Installing dependencies: 2026-02-13T03:30:31.319 INFO:teuthology.orchestra.run.trial132.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-13T03:30:31.319 INFO:teuthology.orchestra.run.trial132.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-13T03:30:31.319 INFO:teuthology.orchestra.run.trial132.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T03:30:31.319 INFO:teuthology.orchestra.run.trial132.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-13T03:30:31.319 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:30:31.319 INFO:teuthology.orchestra.run.trial132.stdout:Transaction Summary 2026-02-13T03:30:31.319 INFO:teuthology.orchestra.run.trial132.stdout:================================================================================ 2026-02-13T03:30:31.320 INFO:teuthology.orchestra.run.trial132.stdout:Install 6 Packages 2026-02-13T03:30:31.320 INFO:teuthology.orchestra.run.trial132.stdout:Upgrade 1 Package 2026-02-13T03:30:31.320 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:30:31.320 INFO:teuthology.orchestra.run.trial132.stdout:Total download size: 2.4 M 2026-02-13T03:30:31.320 INFO:teuthology.orchestra.run.trial132.stdout:Downloading Packages: 2026-02-13T03:30:31.403 INFO:teuthology.orchestra.run.trial096.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 2.3 MB/s | 44 kB 00:00 2026-02-13T03:30:31.404 INFO:teuthology.orchestra.run.trial096.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 3.6 MB/s | 72 kB 00:00 2026-02-13T03:30:31.412 INFO:teuthology.orchestra.run.trial096.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 9.8 MB/s | 84 kB 00:00 2026-02-13T03:30:31.413 INFO:teuthology.orchestra.run.trial096.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 16 MB/s | 150 kB 00:00 2026-02-13T03:30:31.419 INFO:teuthology.orchestra.run.trial096.stdout:(5/7): nvme-cli-2.16-1.el9.x86_64.rpm 33 MB/s | 1.2 MB 00:00 2026-02-13T03:30:31.420 INFO:teuthology.orchestra.run.trial096.stdout:(6/7): libnvme-1.16.1-2.el9.x86_64.rpm 17 MB/s | 116 kB 00:00 2026-02-13T03:30:31.427 INFO:teuthology.orchestra.run.trial096.stdout:(7/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 56 MB/s | 837 kB 00:00 2026-02-13T03:30:31.427 INFO:teuthology.orchestra.run.trial096.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:30:31.427 INFO:teuthology.orchestra.run.trial096.stdout:Total 19 MB/s | 2.4 MB 00:00 2026-02-13T03:30:31.490 INFO:teuthology.orchestra.run.trial096.stdout:Running transaction check 2026-02-13T03:30:31.497 INFO:teuthology.orchestra.run.trial096.stdout:Transaction check succeeded. 2026-02-13T03:30:31.498 INFO:teuthology.orchestra.run.trial096.stdout:Running transaction test 2026-02-13T03:30:31.520 INFO:teuthology.orchestra.run.trial132.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 375 kB/s | 44 kB 00:00 2026-02-13T03:30:31.535 INFO:teuthology.orchestra.run.trial132.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 547 kB/s | 72 kB 00:00 2026-02-13T03:30:31.559 INFO:teuthology.orchestra.run.trial096.stdout:Transaction test succeeded. 2026-02-13T03:30:31.559 INFO:teuthology.orchestra.run.trial096.stdout:Running transaction 2026-02-13T03:30:31.576 INFO:teuthology.orchestra.run.trial132.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 1.5 MB/s | 84 kB 00:00 2026-02-13T03:30:31.601 INFO:teuthology.orchestra.run.trial132.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 2.2 MB/s | 150 kB 00:00 2026-02-13T03:30:31.632 INFO:teuthology.orchestra.run.trial096.stdout: Preparing : 1/1 2026-02-13T03:30:31.634 INFO:teuthology.orchestra.run.trial132.stdout:(5/7): nvme-cli-2.16-1.el9.x86_64.rpm 5.0 MB/s | 1.2 MB 00:00 2026-02-13T03:30:31.636 INFO:teuthology.orchestra.run.trial132.stdout:(6/7): libnvme-1.16.1-2.el9.x86_64.rpm 3.3 MB/s | 116 kB 00:00 2026-02-13T03:30:31.679 INFO:teuthology.orchestra.run.trial132.stdout:(7/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 8.0 MB/s | 837 kB 00:00 2026-02-13T03:30:31.679 INFO:teuthology.orchestra.run.trial132.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:30:31.680 INFO:teuthology.orchestra.run.trial132.stdout:Total 6.7 MB/s | 2.4 MB 00:00 2026-02-13T03:30:31.700 INFO:teuthology.orchestra.run.trial096.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-13T03:30:31.707 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-13T03:30:31.716 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-13T03:30:31.721 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-13T03:30:31.727 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-13T03:30:31.728 INFO:teuthology.orchestra.run.trial096.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T03:30:31.744 INFO:teuthology.orchestra.run.trial132.stdout:Running transaction check 2026-02-13T03:30:31.752 INFO:teuthology.orchestra.run.trial132.stdout:Transaction check succeeded. 2026-02-13T03:30:31.752 INFO:teuthology.orchestra.run.trial132.stdout:Running transaction test 2026-02-13T03:30:31.815 INFO:teuthology.orchestra.run.trial132.stdout:Transaction test succeeded. 2026-02-13T03:30:31.816 INFO:teuthology.orchestra.run.trial132.stdout:Running transaction 2026-02-13T03:30:31.858 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T03:30:31.860 INFO:teuthology.orchestra.run.trial096.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T03:30:31.885 INFO:teuthology.orchestra.run.trial132.stdout: Preparing : 1/1 2026-02-13T03:30:31.888 INFO:teuthology.orchestra.run.trial133.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 91 kB/s | 44 kB 00:00 2026-02-13T03:30:31.896 INFO:teuthology.orchestra.run.trial133.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 147 kB/s | 72 kB 00:00 2026-02-13T03:30:31.952 INFO:teuthology.orchestra.run.trial132.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-13T03:30:31.959 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-13T03:30:31.968 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-13T03:30:31.975 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-13T03:30:31.981 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-13T03:30:31.982 INFO:teuthology.orchestra.run.trial132.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T03:30:32.050 INFO:teuthology.orchestra.run.trial133.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 522 kB/s | 84 kB 00:00 2026-02-13T03:30:32.110 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T03:30:32.113 INFO:teuthology.orchestra.run.trial132.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T03:30:32.133 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T03:30:32.133 INFO:teuthology.orchestra.run.trial096.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T03:30:32.133 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:30:32.136 INFO:teuthology.orchestra.run.trial133.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 626 kB/s | 150 kB 00:00 2026-02-13T03:30:32.158 INFO:teuthology.orchestra.run.trial096.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:30:32.298 INFO:teuthology.orchestra.run.trial133.stdout:(5/7): libnvme-1.16.1-2.el9.x86_64.rpm 719 kB/s | 116 kB 00:00 2026-02-13T03:30:32.379 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:30:32.379 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-13T03:30:32.379 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-13T03:30:32.379 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-13T03:30:32.379 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-13T03:30:32.379 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-13T03:30:32.379 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-13T03:30:32.379 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-13T03:30:32.387 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T03:30:32.387 INFO:teuthology.orchestra.run.trial132.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T03:30:32.387 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:30:32.411 INFO:teuthology.orchestra.run.trial132.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:30:32.432 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:30:32.432 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:30:32.432 INFO:teuthology.orchestra.run.trial096.stdout:Upgraded: 2026-02-13T03:30:32.432 INFO:teuthology.orchestra.run.trial096.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-13T03:30:32.432 INFO:teuthology.orchestra.run.trial096.stdout:Installed: 2026-02-13T03:30:32.432 INFO:teuthology.orchestra.run.trial096.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-13T03:30:32.433 INFO:teuthology.orchestra.run.trial096.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-13T03:30:32.433 INFO:teuthology.orchestra.run.trial096.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-13T03:30:32.433 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:30:32.433 INFO:teuthology.orchestra.run.trial096.stdout:Complete! 2026-02-13T03:30:32.462 DEBUG:teuthology.parallel:result is None 2026-02-13T03:30:32.627 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:30:32.627 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-13T03:30:32.627 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-13T03:30:32.627 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-13T03:30:32.627 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-13T03:30:32.627 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-13T03:30:32.627 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-13T03:30:32.627 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-13T03:30:32.679 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:30:32.679 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:30:32.679 INFO:teuthology.orchestra.run.trial132.stdout:Upgraded: 2026-02-13T03:30:32.679 INFO:teuthology.orchestra.run.trial132.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-13T03:30:32.679 INFO:teuthology.orchestra.run.trial132.stdout:Installed: 2026-02-13T03:30:32.680 INFO:teuthology.orchestra.run.trial132.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-13T03:30:32.680 INFO:teuthology.orchestra.run.trial132.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-13T03:30:32.680 INFO:teuthology.orchestra.run.trial132.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-13T03:30:32.680 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:30:32.680 INFO:teuthology.orchestra.run.trial132.stdout:Complete! 2026-02-13T03:30:32.710 DEBUG:teuthology.parallel:result is None 2026-02-13T03:30:33.067 INFO:teuthology.orchestra.run.trial133.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 823 kB/s | 837 kB 00:01 2026-02-13T03:30:33.157 INFO:teuthology.orchestra.run.trial133.stdout:(7/7): nvme-cli-2.16-1.el9.x86_64.rpm 673 kB/s | 1.2 MB 00:01 2026-02-13T03:30:33.158 INFO:teuthology.orchestra.run.trial133.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:30:33.158 INFO:teuthology.orchestra.run.trial133.stdout:Total 1.3 MB/s | 2.4 MB 00:01 2026-02-13T03:30:33.218 INFO:teuthology.orchestra.run.trial133.stdout:Running transaction check 2026-02-13T03:30:33.226 INFO:teuthology.orchestra.run.trial133.stdout:Transaction check succeeded. 2026-02-13T03:30:33.226 INFO:teuthology.orchestra.run.trial133.stdout:Running transaction test 2026-02-13T03:30:33.287 INFO:teuthology.orchestra.run.trial133.stdout:Transaction test succeeded. 2026-02-13T03:30:33.287 INFO:teuthology.orchestra.run.trial133.stdout:Running transaction 2026-02-13T03:30:33.356 INFO:teuthology.orchestra.run.trial133.stdout: Preparing : 1/1 2026-02-13T03:30:33.422 INFO:teuthology.orchestra.run.trial133.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-13T03:30:33.429 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-13T03:30:33.438 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-13T03:30:33.444 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-13T03:30:33.450 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-13T03:30:33.451 INFO:teuthology.orchestra.run.trial133.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T03:30:33.577 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T03:30:33.580 INFO:teuthology.orchestra.run.trial133.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T03:30:33.851 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T03:30:33.851 INFO:teuthology.orchestra.run.trial133.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T03:30:33.851 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:30:33.876 INFO:teuthology.orchestra.run.trial133.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:30:34.088 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:30:34.088 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-13T03:30:34.089 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-13T03:30:34.089 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-13T03:30:34.089 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-13T03:30:34.089 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-13T03:30:34.089 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-13T03:30:34.089 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-13T03:30:34.142 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:30:34.142 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:30:34.142 INFO:teuthology.orchestra.run.trial133.stdout:Upgraded: 2026-02-13T03:30:34.142 INFO:teuthology.orchestra.run.trial133.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-13T03:30:34.142 INFO:teuthology.orchestra.run.trial133.stdout:Installed: 2026-02-13T03:30:34.143 INFO:teuthology.orchestra.run.trial133.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-13T03:30:34.143 INFO:teuthology.orchestra.run.trial133.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-13T03:30:34.143 INFO:teuthology.orchestra.run.trial133.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-13T03:30:34.143 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:30:34.143 INFO:teuthology.orchestra.run.trial133.stdout:Complete! 2026-02-13T03:30:34.174 DEBUG:teuthology.parallel:result is None 2026-02-13T03:30:34.174 INFO:teuthology.run_tasks:Running task install... 2026-02-13T03:30:34.190 DEBUG:teuthology.task.install:project ceph 2026-02-13T03:30:34.191 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f'}} 2026-02-13T03:30:34.191 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f'} 2026-02-13T03:30:34.191 INFO:teuthology.task.install:Using flavor: default 2026-02-13T03:30:34.200 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-13T03:30:34.200 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2026-02-13T03:30:34.201 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'tag': None, 'wait_for_package': False} 2026-02-13T03:30:34.201 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:30:34.204 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'tag': None, 'wait_for_package': False} 2026-02-13T03:30:34.204 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:30:34.206 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'tag': None, 'wait_for_package': False} 2026-02-13T03:30:34.206 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:30:34.434 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/ 2026-02-13T03:30:34.434 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5241.g8f8d3829 2026-02-13T03:30:34.445 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/ 2026-02-13T03:30:34.445 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5241.g8f8d3829 2026-02-13T03:30:34.447 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/ 2026-02-13T03:30:34.447 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5241.g8f8d3829 2026-02-13T03:30:34.636 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T03:30:34.636 DEBUG:teuthology.orchestra.run.trial133:> set -ex 2026-02-13T03:30:34.636 DEBUG:teuthology.orchestra.run.trial133:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T03:30:34.637 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T03:30:34.637 DEBUG:teuthology.orchestra.run.trial096:> set -ex 2026-02-13T03:30:34.637 DEBUG:teuthology.orchestra.run.trial096:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T03:30:34.647 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T03:30:34.647 DEBUG:teuthology.orchestra.run.trial132:> set -ex 2026-02-13T03:30:34.647 DEBUG:teuthology.orchestra.run.trial132:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T03:30:34.665 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-13T03:30:34.665 DEBUG:teuthology.orchestra.run.trial133:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f8d38294e4db8750b4b1649f62ce37caa63080f/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T03:30:34.665 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-13T03:30:34.665 DEBUG:teuthology.orchestra.run.trial096:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f8d38294e4db8750b4b1649f62ce37caa63080f/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T03:30:34.675 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-13T03:30:34.675 DEBUG:teuthology.orchestra.run.trial132:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f8d38294e4db8750b4b1649f62ce37caa63080f/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T03:30:34.730 DEBUG:teuthology.orchestra.run.trial133:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T03:30:34.732 DEBUG:teuthology.orchestra.run.trial096:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T03:30:34.741 DEBUG:teuthology.orchestra.run.trial132:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T03:30:34.804 DEBUG:teuthology.orchestra.run.trial133:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T03:30:34.806 DEBUG:teuthology.orchestra.run.trial096:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T03:30:34.814 DEBUG:teuthology.orchestra.run.trial132:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T03:30:34.868 INFO:teuthology.orchestra.run.trial133.stdout:check_obsoletes = 1 2026-02-13T03:30:34.870 DEBUG:teuthology.orchestra.run.trial133:> sudo yum clean all 2026-02-13T03:30:34.871 INFO:teuthology.orchestra.run.trial096.stdout:check_obsoletes = 1 2026-02-13T03:30:34.871 DEBUG:teuthology.orchestra.run.trial096:> sudo yum clean all 2026-02-13T03:30:34.880 INFO:teuthology.orchestra.run.trial132.stdout:check_obsoletes = 1 2026-02-13T03:30:34.881 DEBUG:teuthology.orchestra.run.trial132:> sudo yum clean all 2026-02-13T03:30:35.020 INFO:teuthology.orchestra.run.trial096.stdout:41 files removed 2026-02-13T03:30:35.021 INFO:teuthology.orchestra.run.trial133.stdout:41 files removed 2026-02-13T03:30:35.034 INFO:teuthology.orchestra.run.trial132.stdout:41 files removed 2026-02-13T03:30:35.035 DEBUG:teuthology.orchestra.run.trial096:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-13T03:30:35.037 DEBUG:teuthology.orchestra.run.trial133:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-13T03:30:35.048 DEBUG:teuthology.orchestra.run.trial132:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-13T03:30:35.315 INFO:teuthology.orchestra.run.trial133.stdout:ceph packages for x86_64 685 kB/s | 91 kB 00:00 2026-02-13T03:30:35.316 INFO:teuthology.orchestra.run.trial096.stdout:ceph packages for x86_64 677 kB/s | 91 kB 00:00 2026-02-13T03:30:35.319 INFO:teuthology.orchestra.run.trial132.stdout:ceph packages for x86_64 728 kB/s | 91 kB 00:00 2026-02-13T03:30:35.457 INFO:teuthology.orchestra.run.trial133.stdout:ceph noarch packages 204 kB/s | 23 kB 00:00 2026-02-13T03:30:35.460 INFO:teuthology.orchestra.run.trial132.stdout:ceph noarch packages 207 kB/s | 23 kB 00:00 2026-02-13T03:30:35.460 INFO:teuthology.orchestra.run.trial096.stdout:ceph noarch packages 200 kB/s | 23 kB 00:00 2026-02-13T03:30:35.584 INFO:teuthology.orchestra.run.trial133.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-13T03:30:35.588 INFO:teuthology.orchestra.run.trial096.stdout:ceph source packages 19 kB/s | 2.1 kB 00:00 2026-02-13T03:30:35.589 INFO:teuthology.orchestra.run.trial132.stdout:ceph source packages 19 kB/s | 2.1 kB 00:00 2026-02-13T03:30:36.347 INFO:teuthology.orchestra.run.trial132.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-13T03:30:36.658 INFO:teuthology.orchestra.run.trial133.stdout:CentOS Stream 9 - BaseOS 8.4 MB/s | 8.9 MB 00:01 2026-02-13T03:30:36.751 INFO:teuthology.orchestra.run.trial096.stdout:CentOS Stream 9 - BaseOS 7.8 MB/s | 8.9 MB 00:01 2026-02-13T03:30:39.216 INFO:teuthology.orchestra.run.trial096.stdout:CentOS Stream 9 - AppStream 14 MB/s | 27 MB 00:01 2026-02-13T03:30:39.231 INFO:teuthology.orchestra.run.trial133.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-13T03:30:39.420 INFO:teuthology.orchestra.run.trial132.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-13T03:30:42.529 INFO:teuthology.orchestra.run.trial096.stdout:CentOS Stream 9 - CRB 8.8 MB/s | 7.8 MB 00:00 2026-02-13T03:30:42.802 INFO:teuthology.orchestra.run.trial133.stdout:CentOS Stream 9 - CRB 6.5 MB/s | 7.8 MB 00:01 2026-02-13T03:30:43.114 INFO:teuthology.orchestra.run.trial132.stdout:CentOS Stream 9 - CRB 6.3 MB/s | 7.8 MB 00:01 2026-02-13T03:30:43.450 INFO:teuthology.orchestra.run.trial096.stdout:CentOS Stream 9 - Extras packages 105 kB/s | 20 kB 00:00 2026-02-13T03:30:43.625 INFO:teuthology.orchestra.run.trial133.stdout:CentOS Stream 9 - Extras packages 188 kB/s | 20 kB 00:00 2026-02-13T03:30:43.999 INFO:teuthology.orchestra.run.trial132.stdout:CentOS Stream 9 - Extras packages 137 kB/s | 20 kB 00:00 2026-02-13T03:30:44.004 INFO:teuthology.orchestra.run.trial096.stdout:Extra Packages for Enterprise Linux 42 MB/s | 20 MB 00:00 2026-02-13T03:30:44.260 INFO:teuthology.orchestra.run.trial132.stdout:Extra Packages for Enterprise Linux 109 MB/s | 20 MB 00:00 2026-02-13T03:30:47.238 INFO:teuthology.orchestra.run.trial096.stdout:lab-extras 1.2 MB/s | 50 kB 00:00 2026-02-13T03:30:47.522 INFO:teuthology.orchestra.run.trial132.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-13T03:30:48.510 INFO:teuthology.orchestra.run.trial096.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T03:30:48.510 INFO:teuthology.orchestra.run.trial096.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T03:30:48.516 INFO:teuthology.orchestra.run.trial096.stdout:Package NetworkManager-1:1.54.1-1.el9.x86_64 is already installed. 2026-02-13T03:30:48.516 INFO:teuthology.orchestra.run.trial096.stdout:Package iproute-6.17.0-1.el9.x86_64 is already installed. 2026-02-13T03:30:48.517 INFO:teuthology.orchestra.run.trial096.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-13T03:30:48.517 INFO:teuthology.orchestra.run.trial096.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-13T03:30:48.518 INFO:teuthology.orchestra.run.trial096.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-13T03:30:48.520 INFO:teuthology.orchestra.run.trial096.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-13T03:30:48.520 INFO:teuthology.orchestra.run.trial096.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-13T03:30:48.547 INFO:teuthology.orchestra.run.trial096.stdout:Dependencies resolved. 2026-02-13T03:30:48.552 INFO:teuthology.orchestra.run.trial096.stdout:======================================================================================= 2026-02-13T03:30:48.552 INFO:teuthology.orchestra.run.trial096.stdout: Package Arch Version Repository Size 2026-02-13T03:30:48.552 INFO:teuthology.orchestra.run.trial096.stdout:======================================================================================= 2026-02-13T03:30:48.553 INFO:teuthology.orchestra.run.trial096.stdout:Installing: 2026-02-13T03:30:48.553 INFO:teuthology.orchestra.run.trial096.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-13T03:30:48.553 INFO:teuthology.orchestra.run.trial096.stdout: ceph x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 k 2026-02-13T03:30:48.553 INFO:teuthology.orchestra.run.trial096.stdout: ceph-base x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.2 M 2026-02-13T03:30:48.553 INFO:teuthology.orchestra.run.trial096.stdout: ceph-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 987 k 2026-02-13T03:30:48.553 INFO:teuthology.orchestra.run.trial096.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 147 k 2026-02-13T03:30:48.553 INFO:teuthology.orchestra.run.trial096.stdout: ceph-mgr x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 940 k 2026-02-13T03:30:48.553 INFO:teuthology.orchestra.run.trial096.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 183 k 2026-02-13T03:30:48.553 INFO:teuthology.orchestra.run.trial096.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 15 M 2026-02-13T03:30:48.553 INFO:teuthology.orchestra.run.trial096.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 7.4 M 2026-02-13T03:30:48.554 INFO:teuthology.orchestra.run.trial096.stdout: ceph-mgr-rook noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 50 k 2026-02-13T03:30:48.554 INFO:teuthology.orchestra.run.trial096.stdout: ceph-osd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 166 k 2026-02-13T03:30:48.554 INFO:teuthology.orchestra.run.trial096.stdout: ceph-osd-classic x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 16 M 2026-02-13T03:30:48.554 INFO:teuthology.orchestra.run.trial096.stdout: ceph-radosgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 13 M 2026-02-13T03:30:48.554 INFO:teuthology.orchestra.run.trial096.stdout: ceph-test x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 78 M 2026-02-13T03:30:48.554 INFO:teuthology.orchestra.run.trial096.stdout: ceph-volume noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 299 k 2026-02-13T03:30:48.554 INFO:teuthology.orchestra.run.trial096.stdout: cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 1.0 M 2026-02-13T03:30:48.554 INFO:teuthology.orchestra.run.trial096.stdout: cephfs-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 243 k 2026-02-13T03:30:48.554 INFO:teuthology.orchestra.run.trial096.stdout: cephfs-shell x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 27 k 2026-02-13T03:30:48.554 INFO:teuthology.orchestra.run.trial096.stdout: cephfs-top noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 18 k 2026-02-13T03:30:48.554 INFO:teuthology.orchestra.run.trial096.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-13T03:30:48.554 INFO:teuthology.orchestra.run.trial096.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-13T03:30:48.555 INFO:teuthology.orchestra.run.trial096.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-13T03:30:48.555 INFO:teuthology.orchestra.run.trial096.stdout: libcephfs-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 37 k 2026-02-13T03:30:48.555 INFO:teuthology.orchestra.run.trial096.stdout: libcephfs2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 909 k 2026-02-13T03:30:48.555 INFO:teuthology.orchestra.run.trial096.stdout: librados-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 123 k 2026-02-13T03:30:48.555 INFO:teuthology.orchestra.run.trial096.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-13T03:30:48.555 INFO:teuthology.orchestra.run.trial096.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-13T03:30:48.555 INFO:teuthology.orchestra.run.trial096.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-13T03:30:48.555 INFO:teuthology.orchestra.run.trial096.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-13T03:30:48.555 INFO:teuthology.orchestra.run.trial096.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-13T03:30:48.555 INFO:teuthology.orchestra.run.trial096.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-13T03:30:48.555 INFO:teuthology.orchestra.run.trial096.stdout: python3-cephfs x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 204 k 2026-02-13T03:30:48.555 INFO:teuthology.orchestra.run.trial096.stdout: python3-rados x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 324 k 2026-02-13T03:30:48.555 INFO:teuthology.orchestra.run.trial096.stdout: python3-rbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 306 k 2026-02-13T03:30:48.556 INFO:teuthology.orchestra.run.trial096.stdout: python3-rgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 100 k 2026-02-13T03:30:48.556 INFO:teuthology.orchestra.run.trial096.stdout: rbd-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 84 k 2026-02-13T03:30:48.556 INFO:teuthology.orchestra.run.trial096.stdout: rbd-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.9 M 2026-02-13T03:30:48.556 INFO:teuthology.orchestra.run.trial096.stdout: rbd-nbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 172 k 2026-02-13T03:30:48.556 INFO:teuthology.orchestra.run.trial096.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-13T03:30:48.556 INFO:teuthology.orchestra.run.trial096.stdout:Upgrading: 2026-02-13T03:30:48.556 INFO:teuthology.orchestra.run.trial096.stdout: NetworkManager x86_64 1:1.54.3-2.el9 baseos 2.4 M 2026-02-13T03:30:48.556 INFO:teuthology.orchestra.run.trial096.stdout: NetworkManager-libnm x86_64 1:1.54.3-2.el9 baseos 1.9 M 2026-02-13T03:30:48.556 INFO:teuthology.orchestra.run.trial096.stdout: NetworkManager-team x86_64 1:1.54.3-2.el9 baseos 37 k 2026-02-13T03:30:48.556 INFO:teuthology.orchestra.run.trial096.stdout: NetworkManager-tui x86_64 1:1.54.3-2.el9 baseos 248 k 2026-02-13T03:30:48.556 INFO:teuthology.orchestra.run.trial096.stdout: iproute x86_64 6.17.0-2.el9 baseos 866 k 2026-02-13T03:30:48.557 INFO:teuthology.orchestra.run.trial096.stdout: iproute-tc x86_64 6.17.0-2.el9 baseos 454 k 2026-02-13T03:30:48.557 INFO:teuthology.orchestra.run.trial096.stdout: librados2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 3.5 M 2026-02-13T03:30:48.557 INFO:teuthology.orchestra.run.trial096.stdout: librbd1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.8 M 2026-02-13T03:30:48.557 INFO:teuthology.orchestra.run.trial096.stdout: openssl x86_64 1:3.5.5-1.el9 baseos 1.5 M 2026-02-13T03:30:48.557 INFO:teuthology.orchestra.run.trial096.stdout: openssl-fips-provider x86_64 1:3.5.5-1.el9 baseos 814 k 2026-02-13T03:30:48.557 INFO:teuthology.orchestra.run.trial096.stdout: openssl-libs x86_64 1:3.5.5-1.el9 baseos 2.3 M 2026-02-13T03:30:48.557 INFO:teuthology.orchestra.run.trial096.stdout:Installing dependencies: 2026-02-13T03:30:48.557 INFO:teuthology.orchestra.run.trial096.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T03:30:48.557 INFO:teuthology.orchestra.run.trial096.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-13T03:30:48.557 INFO:teuthology.orchestra.run.trial096.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T03:30:48.557 INFO:teuthology.orchestra.run.trial096.stdout: ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 M 2026-02-13T03:30:48.557 INFO:teuthology.orchestra.run.trial096.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 57 k 2026-02-13T03:30:48.558 INFO:teuthology.orchestra.run.trial096.stdout: ceph-mds x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.4 M 2026-02-13T03:30:48.558 INFO:teuthology.orchestra.run.trial096.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 297 k 2026-02-13T03:30:48.558 INFO:teuthology.orchestra.run.trial096.stdout: ceph-mon x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.0 M 2026-02-13T03:30:48.558 INFO:teuthology.orchestra.run.trial096.stdout: ceph-osd-crimson x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 19 M 2026-02-13T03:30:48.558 INFO:teuthology.orchestra.run.trial096.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 17 k 2026-02-13T03:30:48.558 INFO:teuthology.orchestra.run.trial096.stdout: ceph-selinux x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 25 k 2026-02-13T03:30:48.558 INFO:teuthology.orchestra.run.trial096.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T03:30:48.558 INFO:teuthology.orchestra.run.trial096.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T03:30:48.558 INFO:teuthology.orchestra.run.trial096.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T03:30:48.558 INFO:teuthology.orchestra.run.trial096.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T03:30:48.558 INFO:teuthology.orchestra.run.trial096.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T03:30:48.558 INFO:teuthology.orchestra.run.trial096.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T03:30:48.559 INFO:teuthology.orchestra.run.trial096.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-13T03:30:48.559 INFO:teuthology.orchestra.run.trial096.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T03:30:48.559 INFO:teuthology.orchestra.run.trial096.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T03:30:48.559 INFO:teuthology.orchestra.run.trial096.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T03:30:48.559 INFO:teuthology.orchestra.run.trial096.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-13T03:30:48.559 INFO:teuthology.orchestra.run.trial096.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 k 2026-02-13T03:30:48.559 INFO:teuthology.orchestra.run.trial096.stdout: libcephsqlite x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 159 k 2026-02-13T03:30:48.559 INFO:teuthology.orchestra.run.trial096.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T03:30:48.559 INFO:teuthology.orchestra.run.trial096.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T03:30:48.559 INFO:teuthology.orchestra.run.trial096.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T03:30:48.559 INFO:teuthology.orchestra.run.trial096.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T03:30:48.559 INFO:teuthology.orchestra.run.trial096.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T03:30:48.560 INFO:teuthology.orchestra.run.trial096.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T03:30:48.560 INFO:teuthology.orchestra.run.trial096.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T03:30:48.560 INFO:teuthology.orchestra.run.trial096.stdout: libradosstriper1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 248 k 2026-02-13T03:30:48.560 INFO:teuthology.orchestra.run.trial096.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T03:30:48.560 INFO:teuthology.orchestra.run.trial096.stdout: librgw2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 M 2026-02-13T03:30:48.560 INFO:teuthology.orchestra.run.trial096.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T03:30:48.560 INFO:teuthology.orchestra.run.trial096.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T03:30:48.560 INFO:teuthology.orchestra.run.trial096.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T03:30:48.560 INFO:teuthology.orchestra.run.trial096.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-13T03:30:48.560 INFO:teuthology.orchestra.run.trial096.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-13T03:30:48.560 INFO:teuthology.orchestra.run.trial096.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T03:30:48.560 INFO:teuthology.orchestra.run.trial096.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T03:30:48.561 INFO:teuthology.orchestra.run.trial096.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T03:30:48.561 INFO:teuthology.orchestra.run.trial096.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T03:30:48.561 INFO:teuthology.orchestra.run.trial096.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T03:30:48.561 INFO:teuthology.orchestra.run.trial096.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T03:30:48.561 INFO:teuthology.orchestra.run.trial096.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T03:30:48.561 INFO:teuthology.orchestra.run.trial096.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T03:30:48.561 INFO:teuthology.orchestra.run.trial096.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T03:30:48.561 INFO:teuthology.orchestra.run.trial096.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-13T03:30:48.561 INFO:teuthology.orchestra.run.trial096.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-13T03:30:48.561 INFO:teuthology.orchestra.run.trial096.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-13T03:30:48.561 INFO:teuthology.orchestra.run.trial096.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-13T03:30:48.562 INFO:teuthology.orchestra.run.trial096.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T03:30:48.562 INFO:teuthology.orchestra.run.trial096.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T03:30:48.562 INFO:teuthology.orchestra.run.trial096.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T03:30:48.562 INFO:teuthology.orchestra.run.trial096.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T03:30:48.562 INFO:teuthology.orchestra.run.trial096.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T03:30:48.562 INFO:teuthology.orchestra.run.trial096.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T03:30:48.562 INFO:teuthology.orchestra.run.trial096.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T03:30:48.562 INFO:teuthology.orchestra.run.trial096.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T03:30:48.562 INFO:teuthology.orchestra.run.trial096.stdout: python3-ceph-argparse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 45 k 2026-02-13T03:30:48.562 INFO:teuthology.orchestra.run.trial096.stdout: python3-ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 185 k 2026-02-13T03:30:48.562 INFO:teuthology.orchestra.run.trial096.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T03:30:48.562 INFO:teuthology.orchestra.run.trial096.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T03:30:48.562 INFO:teuthology.orchestra.run.trial096.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T03:30:48.563 INFO:teuthology.orchestra.run.trial096.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T03:30:48.563 INFO:teuthology.orchestra.run.trial096.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-13T03:30:48.563 INFO:teuthology.orchestra.run.trial096.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-13T03:30:48.563 INFO:teuthology.orchestra.run.trial096.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T03:30:48.563 INFO:teuthology.orchestra.run.trial096.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T03:30:48.563 INFO:teuthology.orchestra.run.trial096.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T03:30:48.563 INFO:teuthology.orchestra.run.trial096.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T03:30:48.563 INFO:teuthology.orchestra.run.trial096.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T03:30:48.563 INFO:teuthology.orchestra.run.trial096.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T03:30:48.563 INFO:teuthology.orchestra.run.trial096.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T03:30:48.563 INFO:teuthology.orchestra.run.trial096.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-13T03:30:48.564 INFO:teuthology.orchestra.run.trial096.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T03:30:48.564 INFO:teuthology.orchestra.run.trial096.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T03:30:48.564 INFO:teuthology.orchestra.run.trial096.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T03:30:48.564 INFO:teuthology.orchestra.run.trial096.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T03:30:48.564 INFO:teuthology.orchestra.run.trial096.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T03:30:48.564 INFO:teuthology.orchestra.run.trial096.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T03:30:48.564 INFO:teuthology.orchestra.run.trial096.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T03:30:48.564 INFO:teuthology.orchestra.run.trial096.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T03:30:48.564 INFO:teuthology.orchestra.run.trial096.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T03:30:48.564 INFO:teuthology.orchestra.run.trial096.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T03:30:48.564 INFO:teuthology.orchestra.run.trial096.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T03:30:48.564 INFO:teuthology.orchestra.run.trial096.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T03:30:48.564 INFO:teuthology.orchestra.run.trial096.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T03:30:48.565 INFO:teuthology.orchestra.run.trial096.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T03:30:48.565 INFO:teuthology.orchestra.run.trial096.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T03:30:48.565 INFO:teuthology.orchestra.run.trial096.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T03:30:48.565 INFO:teuthology.orchestra.run.trial096.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T03:30:48.565 INFO:teuthology.orchestra.run.trial096.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T03:30:48.565 INFO:teuthology.orchestra.run.trial096.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T03:30:48.565 INFO:teuthology.orchestra.run.trial096.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T03:30:48.565 INFO:teuthology.orchestra.run.trial096.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-13T03:30:48.565 INFO:teuthology.orchestra.run.trial096.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T03:30:48.565 INFO:teuthology.orchestra.run.trial096.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T03:30:48.565 INFO:teuthology.orchestra.run.trial096.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T03:30:48.565 INFO:teuthology.orchestra.run.trial096.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T03:30:48.566 INFO:teuthology.orchestra.run.trial096.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T03:30:48.566 INFO:teuthology.orchestra.run.trial096.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T03:30:48.566 INFO:teuthology.orchestra.run.trial096.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T03:30:48.566 INFO:teuthology.orchestra.run.trial096.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T03:30:48.566 INFO:teuthology.orchestra.run.trial096.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T03:30:48.566 INFO:teuthology.orchestra.run.trial096.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T03:30:48.566 INFO:teuthology.orchestra.run.trial096.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-13T03:30:48.566 INFO:teuthology.orchestra.run.trial096.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T03:30:48.566 INFO:teuthology.orchestra.run.trial096.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T03:30:48.566 INFO:teuthology.orchestra.run.trial096.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T03:30:48.566 INFO:teuthology.orchestra.run.trial096.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T03:30:48.566 INFO:teuthology.orchestra.run.trial096.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T03:30:48.566 INFO:teuthology.orchestra.run.trial096.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T03:30:48.567 INFO:teuthology.orchestra.run.trial096.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T03:30:48.567 INFO:teuthology.orchestra.run.trial096.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T03:30:48.567 INFO:teuthology.orchestra.run.trial096.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T03:30:48.567 INFO:teuthology.orchestra.run.trial096.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-13T03:30:48.567 INFO:teuthology.orchestra.run.trial096.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T03:30:48.567 INFO:teuthology.orchestra.run.trial096.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-13T03:30:48.567 INFO:teuthology.orchestra.run.trial096.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T03:30:48.567 INFO:teuthology.orchestra.run.trial096.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-13T03:30:48.567 INFO:teuthology.orchestra.run.trial096.stdout:Installing weak dependencies: 2026-02-13T03:30:48.567 INFO:teuthology.orchestra.run.trial096.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T03:30:48.567 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:30:48.568 INFO:teuthology.orchestra.run.trial096.stdout:Transaction Summary 2026-02-13T03:30:48.568 INFO:teuthology.orchestra.run.trial096.stdout:======================================================================================= 2026-02-13T03:30:48.568 INFO:teuthology.orchestra.run.trial096.stdout:Install 162 Packages 2026-02-13T03:30:48.568 INFO:teuthology.orchestra.run.trial096.stdout:Upgrade 11 Packages 2026-02-13T03:30:48.568 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:30:48.569 INFO:teuthology.orchestra.run.trial096.stdout:Total download size: 302 M 2026-02-13T03:30:48.569 INFO:teuthology.orchestra.run.trial096.stdout:Downloading Packages: 2026-02-13T03:30:48.799 INFO:teuthology.orchestra.run.trial132.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T03:30:48.800 INFO:teuthology.orchestra.run.trial132.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T03:30:48.805 INFO:teuthology.orchestra.run.trial132.stdout:Package NetworkManager-1:1.54.1-1.el9.x86_64 is already installed. 2026-02-13T03:30:48.806 INFO:teuthology.orchestra.run.trial132.stdout:Package iproute-6.17.0-1.el9.x86_64 is already installed. 2026-02-13T03:30:48.806 INFO:teuthology.orchestra.run.trial132.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-13T03:30:48.807 INFO:teuthology.orchestra.run.trial132.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-13T03:30:48.807 INFO:teuthology.orchestra.run.trial132.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-13T03:30:48.809 INFO:teuthology.orchestra.run.trial132.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-13T03:30:48.809 INFO:teuthology.orchestra.run.trial132.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-13T03:30:48.837 INFO:teuthology.orchestra.run.trial132.stdout:Dependencies resolved. 2026-02-13T03:30:48.841 INFO:teuthology.orchestra.run.trial132.stdout:======================================================================================= 2026-02-13T03:30:48.842 INFO:teuthology.orchestra.run.trial132.stdout: Package Arch Version Repository Size 2026-02-13T03:30:48.842 INFO:teuthology.orchestra.run.trial132.stdout:======================================================================================= 2026-02-13T03:30:48.842 INFO:teuthology.orchestra.run.trial132.stdout:Installing: 2026-02-13T03:30:48.842 INFO:teuthology.orchestra.run.trial132.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-13T03:30:48.842 INFO:teuthology.orchestra.run.trial132.stdout: ceph x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 k 2026-02-13T03:30:48.842 INFO:teuthology.orchestra.run.trial132.stdout: ceph-base x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.2 M 2026-02-13T03:30:48.842 INFO:teuthology.orchestra.run.trial132.stdout: ceph-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 987 k 2026-02-13T03:30:48.842 INFO:teuthology.orchestra.run.trial132.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 147 k 2026-02-13T03:30:48.842 INFO:teuthology.orchestra.run.trial132.stdout: ceph-mgr x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 940 k 2026-02-13T03:30:48.843 INFO:teuthology.orchestra.run.trial132.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 183 k 2026-02-13T03:30:48.843 INFO:teuthology.orchestra.run.trial132.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 15 M 2026-02-13T03:30:48.843 INFO:teuthology.orchestra.run.trial132.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 7.4 M 2026-02-13T03:30:48.843 INFO:teuthology.orchestra.run.trial132.stdout: ceph-mgr-rook noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 50 k 2026-02-13T03:30:48.843 INFO:teuthology.orchestra.run.trial132.stdout: ceph-osd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 166 k 2026-02-13T03:30:48.843 INFO:teuthology.orchestra.run.trial132.stdout: ceph-osd-classic x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 16 M 2026-02-13T03:30:48.843 INFO:teuthology.orchestra.run.trial132.stdout: ceph-radosgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 13 M 2026-02-13T03:30:48.843 INFO:teuthology.orchestra.run.trial132.stdout: ceph-test x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 78 M 2026-02-13T03:30:48.843 INFO:teuthology.orchestra.run.trial132.stdout: ceph-volume noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 299 k 2026-02-13T03:30:48.843 INFO:teuthology.orchestra.run.trial132.stdout: cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 1.0 M 2026-02-13T03:30:48.843 INFO:teuthology.orchestra.run.trial132.stdout: cephfs-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 243 k 2026-02-13T03:30:48.844 INFO:teuthology.orchestra.run.trial132.stdout: cephfs-shell x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 27 k 2026-02-13T03:30:48.844 INFO:teuthology.orchestra.run.trial132.stdout: cephfs-top noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 18 k 2026-02-13T03:30:48.844 INFO:teuthology.orchestra.run.trial132.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-13T03:30:48.844 INFO:teuthology.orchestra.run.trial132.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-13T03:30:48.844 INFO:teuthology.orchestra.run.trial132.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-13T03:30:48.844 INFO:teuthology.orchestra.run.trial132.stdout: libcephfs-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 37 k 2026-02-13T03:30:48.844 INFO:teuthology.orchestra.run.trial132.stdout: libcephfs2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 909 k 2026-02-13T03:30:48.844 INFO:teuthology.orchestra.run.trial132.stdout: librados-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 123 k 2026-02-13T03:30:48.844 INFO:teuthology.orchestra.run.trial132.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-13T03:30:48.844 INFO:teuthology.orchestra.run.trial132.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-13T03:30:48.844 INFO:teuthology.orchestra.run.trial132.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-13T03:30:48.845 INFO:teuthology.orchestra.run.trial132.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-13T03:30:48.845 INFO:teuthology.orchestra.run.trial132.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-13T03:30:48.845 INFO:teuthology.orchestra.run.trial132.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-13T03:30:48.845 INFO:teuthology.orchestra.run.trial132.stdout: python3-cephfs x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 204 k 2026-02-13T03:30:48.845 INFO:teuthology.orchestra.run.trial132.stdout: python3-rados x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 324 k 2026-02-13T03:30:48.845 INFO:teuthology.orchestra.run.trial132.stdout: python3-rbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 306 k 2026-02-13T03:30:48.845 INFO:teuthology.orchestra.run.trial132.stdout: python3-rgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 100 k 2026-02-13T03:30:48.845 INFO:teuthology.orchestra.run.trial132.stdout: rbd-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 84 k 2026-02-13T03:30:48.845 INFO:teuthology.orchestra.run.trial132.stdout: rbd-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.9 M 2026-02-13T03:30:48.845 INFO:teuthology.orchestra.run.trial132.stdout: rbd-nbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 172 k 2026-02-13T03:30:48.846 INFO:teuthology.orchestra.run.trial132.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-13T03:30:48.846 INFO:teuthology.orchestra.run.trial132.stdout:Upgrading: 2026-02-13T03:30:48.846 INFO:teuthology.orchestra.run.trial132.stdout: NetworkManager x86_64 1:1.54.3-2.el9 baseos 2.4 M 2026-02-13T03:30:48.846 INFO:teuthology.orchestra.run.trial132.stdout: NetworkManager-libnm x86_64 1:1.54.3-2.el9 baseos 1.9 M 2026-02-13T03:30:48.846 INFO:teuthology.orchestra.run.trial132.stdout: NetworkManager-team x86_64 1:1.54.3-2.el9 baseos 37 k 2026-02-13T03:30:48.846 INFO:teuthology.orchestra.run.trial132.stdout: NetworkManager-tui x86_64 1:1.54.3-2.el9 baseos 248 k 2026-02-13T03:30:48.846 INFO:teuthology.orchestra.run.trial132.stdout: iproute x86_64 6.17.0-2.el9 baseos 866 k 2026-02-13T03:30:48.846 INFO:teuthology.orchestra.run.trial132.stdout: iproute-tc x86_64 6.17.0-2.el9 baseos 454 k 2026-02-13T03:30:48.846 INFO:teuthology.orchestra.run.trial132.stdout: librados2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 3.5 M 2026-02-13T03:30:48.846 INFO:teuthology.orchestra.run.trial132.stdout: librbd1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.8 M 2026-02-13T03:30:48.846 INFO:teuthology.orchestra.run.trial132.stdout: openssl x86_64 1:3.5.5-1.el9 baseos 1.5 M 2026-02-13T03:30:48.847 INFO:teuthology.orchestra.run.trial132.stdout: openssl-fips-provider x86_64 1:3.5.5-1.el9 baseos 814 k 2026-02-13T03:30:48.847 INFO:teuthology.orchestra.run.trial132.stdout: openssl-libs x86_64 1:3.5.5-1.el9 baseos 2.3 M 2026-02-13T03:30:48.847 INFO:teuthology.orchestra.run.trial132.stdout:Installing dependencies: 2026-02-13T03:30:48.847 INFO:teuthology.orchestra.run.trial132.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T03:30:48.847 INFO:teuthology.orchestra.run.trial132.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-13T03:30:48.847 INFO:teuthology.orchestra.run.trial132.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T03:30:48.847 INFO:teuthology.orchestra.run.trial132.stdout: ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 M 2026-02-13T03:30:48.847 INFO:teuthology.orchestra.run.trial132.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 57 k 2026-02-13T03:30:48.847 INFO:teuthology.orchestra.run.trial132.stdout: ceph-mds x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.4 M 2026-02-13T03:30:48.847 INFO:teuthology.orchestra.run.trial132.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 297 k 2026-02-13T03:30:48.848 INFO:teuthology.orchestra.run.trial132.stdout: ceph-mon x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.0 M 2026-02-13T03:30:48.848 INFO:teuthology.orchestra.run.trial132.stdout: ceph-osd-crimson x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 19 M 2026-02-13T03:30:48.848 INFO:teuthology.orchestra.run.trial132.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 17 k 2026-02-13T03:30:48.848 INFO:teuthology.orchestra.run.trial132.stdout: ceph-selinux x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 25 k 2026-02-13T03:30:48.848 INFO:teuthology.orchestra.run.trial132.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T03:30:48.848 INFO:teuthology.orchestra.run.trial132.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T03:30:48.848 INFO:teuthology.orchestra.run.trial132.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T03:30:48.848 INFO:teuthology.orchestra.run.trial132.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T03:30:48.848 INFO:teuthology.orchestra.run.trial132.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T03:30:48.848 INFO:teuthology.orchestra.run.trial132.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T03:30:48.848 INFO:teuthology.orchestra.run.trial132.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-13T03:30:48.848 INFO:teuthology.orchestra.run.trial132.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T03:30:48.849 INFO:teuthology.orchestra.run.trial132.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T03:30:48.849 INFO:teuthology.orchestra.run.trial132.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T03:30:48.849 INFO:teuthology.orchestra.run.trial132.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-13T03:30:48.849 INFO:teuthology.orchestra.run.trial132.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 k 2026-02-13T03:30:48.849 INFO:teuthology.orchestra.run.trial132.stdout: libcephsqlite x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 159 k 2026-02-13T03:30:48.849 INFO:teuthology.orchestra.run.trial132.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T03:30:48.849 INFO:teuthology.orchestra.run.trial132.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T03:30:48.849 INFO:teuthology.orchestra.run.trial132.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T03:30:48.849 INFO:teuthology.orchestra.run.trial132.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T03:30:48.849 INFO:teuthology.orchestra.run.trial132.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T03:30:48.849 INFO:teuthology.orchestra.run.trial132.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T03:30:48.850 INFO:teuthology.orchestra.run.trial132.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T03:30:48.850 INFO:teuthology.orchestra.run.trial132.stdout: libradosstriper1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 248 k 2026-02-13T03:30:48.850 INFO:teuthology.orchestra.run.trial132.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T03:30:48.850 INFO:teuthology.orchestra.run.trial132.stdout: librgw2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 M 2026-02-13T03:30:48.850 INFO:teuthology.orchestra.run.trial132.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T03:30:48.850 INFO:teuthology.orchestra.run.trial132.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T03:30:48.850 INFO:teuthology.orchestra.run.trial132.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T03:30:48.850 INFO:teuthology.orchestra.run.trial132.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-13T03:30:48.850 INFO:teuthology.orchestra.run.trial132.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-13T03:30:48.850 INFO:teuthology.orchestra.run.trial132.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T03:30:48.851 INFO:teuthology.orchestra.run.trial132.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T03:30:48.851 INFO:teuthology.orchestra.run.trial132.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T03:30:48.851 INFO:teuthology.orchestra.run.trial132.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T03:30:48.851 INFO:teuthology.orchestra.run.trial132.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T03:30:48.851 INFO:teuthology.orchestra.run.trial132.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T03:30:48.851 INFO:teuthology.orchestra.run.trial132.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T03:30:48.851 INFO:teuthology.orchestra.run.trial132.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T03:30:48.851 INFO:teuthology.orchestra.run.trial132.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T03:30:48.851 INFO:teuthology.orchestra.run.trial132.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-13T03:30:48.851 INFO:teuthology.orchestra.run.trial132.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-13T03:30:48.851 INFO:teuthology.orchestra.run.trial132.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-13T03:30:48.852 INFO:teuthology.orchestra.run.trial132.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-13T03:30:48.852 INFO:teuthology.orchestra.run.trial132.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T03:30:48.852 INFO:teuthology.orchestra.run.trial132.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T03:30:48.852 INFO:teuthology.orchestra.run.trial132.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T03:30:48.852 INFO:teuthology.orchestra.run.trial132.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T03:30:48.852 INFO:teuthology.orchestra.run.trial132.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T03:30:48.852 INFO:teuthology.orchestra.run.trial132.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T03:30:48.852 INFO:teuthology.orchestra.run.trial132.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T03:30:48.852 INFO:teuthology.orchestra.run.trial132.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T03:30:48.852 INFO:teuthology.orchestra.run.trial132.stdout: python3-ceph-argparse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 45 k 2026-02-13T03:30:48.852 INFO:teuthology.orchestra.run.trial132.stdout: python3-ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 185 k 2026-02-13T03:30:48.853 INFO:teuthology.orchestra.run.trial132.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T03:30:48.853 INFO:teuthology.orchestra.run.trial132.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T03:30:48.853 INFO:teuthology.orchestra.run.trial132.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T03:30:48.853 INFO:teuthology.orchestra.run.trial132.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T03:30:48.853 INFO:teuthology.orchestra.run.trial132.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-13T03:30:48.853 INFO:teuthology.orchestra.run.trial132.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-13T03:30:48.853 INFO:teuthology.orchestra.run.trial132.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T03:30:48.853 INFO:teuthology.orchestra.run.trial132.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T03:30:48.853 INFO:teuthology.orchestra.run.trial132.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T03:30:48.853 INFO:teuthology.orchestra.run.trial132.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T03:30:48.853 INFO:teuthology.orchestra.run.trial132.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T03:30:48.853 INFO:teuthology.orchestra.run.trial132.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T03:30:48.854 INFO:teuthology.orchestra.run.trial132.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T03:30:48.854 INFO:teuthology.orchestra.run.trial132.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-13T03:30:48.854 INFO:teuthology.orchestra.run.trial132.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T03:30:48.854 INFO:teuthology.orchestra.run.trial132.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T03:30:48.854 INFO:teuthology.orchestra.run.trial132.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T03:30:48.854 INFO:teuthology.orchestra.run.trial132.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T03:30:48.854 INFO:teuthology.orchestra.run.trial132.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T03:30:48.854 INFO:teuthology.orchestra.run.trial132.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T03:30:48.854 INFO:teuthology.orchestra.run.trial132.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T03:30:48.854 INFO:teuthology.orchestra.run.trial132.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T03:30:48.854 INFO:teuthology.orchestra.run.trial132.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T03:30:48.855 INFO:teuthology.orchestra.run.trial132.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T03:30:48.855 INFO:teuthology.orchestra.run.trial132.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T03:30:48.855 INFO:teuthology.orchestra.run.trial132.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T03:30:48.855 INFO:teuthology.orchestra.run.trial132.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T03:30:48.855 INFO:teuthology.orchestra.run.trial132.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T03:30:48.855 INFO:teuthology.orchestra.run.trial132.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T03:30:48.855 INFO:teuthology.orchestra.run.trial132.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T03:30:48.855 INFO:teuthology.orchestra.run.trial132.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T03:30:48.855 INFO:teuthology.orchestra.run.trial132.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T03:30:48.855 INFO:teuthology.orchestra.run.trial132.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T03:30:48.856 INFO:teuthology.orchestra.run.trial132.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T03:30:48.856 INFO:teuthology.orchestra.run.trial132.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-13T03:30:48.856 INFO:teuthology.orchestra.run.trial132.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T03:30:48.856 INFO:teuthology.orchestra.run.trial132.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T03:30:48.856 INFO:teuthology.orchestra.run.trial132.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T03:30:48.856 INFO:teuthology.orchestra.run.trial132.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T03:30:48.856 INFO:teuthology.orchestra.run.trial132.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T03:30:48.856 INFO:teuthology.orchestra.run.trial132.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T03:30:48.856 INFO:teuthology.orchestra.run.trial132.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T03:30:48.856 INFO:teuthology.orchestra.run.trial132.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T03:30:48.856 INFO:teuthology.orchestra.run.trial132.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T03:30:48.856 INFO:teuthology.orchestra.run.trial132.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T03:30:48.857 INFO:teuthology.orchestra.run.trial132.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-13T03:30:48.857 INFO:teuthology.orchestra.run.trial132.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T03:30:48.857 INFO:teuthology.orchestra.run.trial132.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T03:30:48.857 INFO:teuthology.orchestra.run.trial132.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T03:30:48.857 INFO:teuthology.orchestra.run.trial132.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T03:30:48.857 INFO:teuthology.orchestra.run.trial132.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T03:30:48.857 INFO:teuthology.orchestra.run.trial132.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T03:30:48.857 INFO:teuthology.orchestra.run.trial132.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T03:30:48.857 INFO:teuthology.orchestra.run.trial132.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T03:30:48.857 INFO:teuthology.orchestra.run.trial132.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T03:30:48.857 INFO:teuthology.orchestra.run.trial132.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-13T03:30:48.858 INFO:teuthology.orchestra.run.trial132.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T03:30:48.858 INFO:teuthology.orchestra.run.trial132.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-13T03:30:48.858 INFO:teuthology.orchestra.run.trial132.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T03:30:48.858 INFO:teuthology.orchestra.run.trial132.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-13T03:30:48.858 INFO:teuthology.orchestra.run.trial132.stdout:Installing weak dependencies: 2026-02-13T03:30:48.858 INFO:teuthology.orchestra.run.trial132.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T03:30:48.858 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:30:48.858 INFO:teuthology.orchestra.run.trial132.stdout:Transaction Summary 2026-02-13T03:30:48.858 INFO:teuthology.orchestra.run.trial132.stdout:======================================================================================= 2026-02-13T03:30:48.858 INFO:teuthology.orchestra.run.trial132.stdout:Install 162 Packages 2026-02-13T03:30:48.859 INFO:teuthology.orchestra.run.trial132.stdout:Upgrade 11 Packages 2026-02-13T03:30:48.859 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:30:48.860 INFO:teuthology.orchestra.run.trial132.stdout:Total download size: 302 M 2026-02-13T03:30:48.860 INFO:teuthology.orchestra.run.trial132.stdout:Downloading Packages: 2026-02-13T03:30:49.153 INFO:teuthology.orchestra.run.trial096.stdout:(1/173): ceph-20.3.0-5241.g8f8d3829.el9.x86_64. 101 kB/s | 6.5 kB 00:00 2026-02-13T03:30:49.233 INFO:teuthology.orchestra.run.trial132.stdout:(1/173): ceph-20.3.0-5241.g8f8d3829.el9.x86_64. 89 kB/s | 6.5 kB 00:00 2026-02-13T03:30:49.284 INFO:teuthology.orchestra.run.trial096.stdout:(2/173): ceph-fuse-20.3.0-5241.g8f8d3829.el9.x8 7.3 MB/s | 987 kB 00:00 2026-02-13T03:30:49.331 INFO:teuthology.orchestra.run.trial096.stdout:(3/173): ceph-immutable-object-cache-20.3.0-524 3.1 MB/s | 147 kB 00:00 2026-02-13T03:30:49.347 INFO:teuthology.orchestra.run.trial096.stdout:(4/173): ceph-base-20.3.0-5241.g8f8d3829.el9.x8 20 MB/s | 5.2 MB 00:00 2026-02-13T03:30:49.392 INFO:teuthology.orchestra.run.trial096.stdout:(5/173): ceph-mgr-20.3.0-5241.g8f8d3829.el9.x86 20 MB/s | 940 kB 00:00 2026-02-13T03:30:49.606 INFO:teuthology.orchestra.run.trial096.stdout:(6/173): ceph-mon-20.3.0-5241.g8f8d3829.el9.x86 23 MB/s | 5.0 MB 00:00 2026-02-13T03:30:49.620 INFO:teuthology.orchestra.run.trial096.stdout:(7/173): ceph-mds-20.3.0-5241.g8f8d3829.el9.x86 8.2 MB/s | 2.4 MB 00:00 2026-02-13T03:30:49.638 INFO:teuthology.orchestra.run.trial096.stdout:(8/173): ceph-osd-20.3.0-5241.g8f8d3829.el9.x86 5.2 MB/s | 166 kB 00:00 2026-02-13T03:30:49.964 INFO:teuthology.orchestra.run.trial132.stdout:(2/173): ceph-fuse-20.3.0-5241.g8f8d3829.el9.x8 1.3 MB/s | 987 kB 00:00 2026-02-13T03:30:50.076 INFO:teuthology.orchestra.run.trial132.stdout:(3/173): ceph-immutable-object-cache-20.3.0-524 1.3 MB/s | 147 kB 00:00 2026-02-13T03:30:50.356 INFO:teuthology.orchestra.run.trial096.stdout:(9/173): ceph-common-20.3.0-5241.g8f8d3829.el9. 19 MB/s | 24 MB 00:01 2026-02-13T03:30:50.419 INFO:teuthology.orchestra.run.trial096.stdout:(10/173): ceph-osd-crimson-20.3.0-5241.g8f8d382 24 MB/s | 19 MB 00:00 2026-02-13T03:30:50.460 INFO:teuthology.orchestra.run.trial096.stdout:(11/173): ceph-selinux-20.3.0-5241.g8f8d3829.el 617 kB/s | 25 kB 00:00 2026-02-13T03:30:50.920 INFO:teuthology.orchestra.run.trial132.stdout:(4/173): ceph-mds-20.3.0-5241.g8f8d3829.el9.x86 2.8 MB/s | 2.4 MB 00:00 2026-02-13T03:30:50.957 INFO:teuthology.orchestra.run.trial132.stdout:(5/173): ceph-base-20.3.0-5241.g8f8d3829.el9.x8 2.9 MB/s | 5.2 MB 00:01 2026-02-13T03:30:51.095 INFO:teuthology.orchestra.run.trial096.stdout:(12/173): ceph-radosgw-20.3.0-5241.g8f8d3829.el 18 MB/s | 13 MB 00:00 2026-02-13T03:30:51.153 INFO:teuthology.orchestra.run.trial096.stdout:(13/173): cephfs-mirror-20.3.0-5241.g8f8d3829.e 4.1 MB/s | 243 kB 00:00 2026-02-13T03:30:51.181 INFO:teuthology.orchestra.run.trial132.stdout:(6/173): ceph-mgr-20.3.0-5241.g8f8d3829.el9.x86 3.5 MB/s | 940 kB 00:00 2026-02-13T03:30:51.205 INFO:teuthology.orchestra.run.trial096.stdout:(14/173): cephfs-shell-20.3.0-5241.g8f8d3829.el 523 kB/s | 27 kB 00:00 2026-02-13T03:30:51.234 INFO:teuthology.orchestra.run.trial132.stdout:(7/173): ceph-osd-20.3.0-5241.g8f8d3829.el9.x86 3.1 MB/s | 166 kB 00:00 2026-02-13T03:30:51.257 INFO:teuthology.orchestra.run.trial096.stdout:(15/173): libcephfs-devel-20.3.0-5241.g8f8d3829 716 kB/s | 37 kB 00:00 2026-02-13T03:30:51.312 INFO:teuthology.orchestra.run.trial096.stdout:(16/173): libcephfs-proxy2-20.3.0-5241.g8f8d382 446 kB/s | 24 kB 00:00 2026-02-13T03:30:51.387 INFO:teuthology.orchestra.run.trial096.stdout:(17/173): libcephfs2-20.3.0-5241.g8f8d3829.el9. 12 MB/s | 909 kB 00:00 2026-02-13T03:30:51.444 INFO:teuthology.orchestra.run.trial096.stdout:(18/173): libcephsqlite-20.3.0-5241.g8f8d3829.e 2.7 MB/s | 159 kB 00:00 2026-02-13T03:30:51.498 INFO:teuthology.orchestra.run.trial096.stdout:(19/173): librados-devel-20.3.0-5241.g8f8d3829. 2.3 MB/s | 123 kB 00:00 2026-02-13T03:30:51.529 INFO:teuthology.orchestra.run.trial096.stdout:(20/173): ceph-osd-classic-20.3.0-5241.g8f8d382 8.2 MB/s | 16 MB 00:01 2026-02-13T03:30:51.544 INFO:teuthology.orchestra.run.trial096.stdout:(21/173): libradosstriper1-20.3.0-5241.g8f8d382 5.3 MB/s | 248 kB 00:00 2026-02-13T03:30:51.590 INFO:teuthology.orchestra.run.trial096.stdout:(22/173): python3-ceph-argparse-20.3.0-5241.g8f 977 kB/s | 45 kB 00:00 2026-02-13T03:30:51.639 INFO:teuthology.orchestra.run.trial096.stdout:(23/173): python3-ceph-common-20.3.0-5241.g8f8d 3.6 MB/s | 185 kB 00:00 2026-02-13T03:30:51.664 INFO:teuthology.orchestra.run.trial132.stdout:(8/173): ceph-mon-20.3.0-5241.g8f8d3829.el9.x86 7.0 MB/s | 5.0 MB 00:00 2026-02-13T03:30:51.690 INFO:teuthology.orchestra.run.trial096.stdout:(24/173): python3-cephfs-20.3.0-5241.g8f8d3829. 4.0 MB/s | 204 kB 00:00 2026-02-13T03:30:51.743 INFO:teuthology.orchestra.run.trial096.stdout:(25/173): python3-rados-20.3.0-5241.g8f8d3829.e 5.9 MB/s | 324 kB 00:00 2026-02-13T03:30:51.798 INFO:teuthology.orchestra.run.trial096.stdout:(26/173): python3-rbd-20.3.0-5241.g8f8d3829.el9 5.5 MB/s | 306 kB 00:00 2026-02-13T03:30:51.847 INFO:teuthology.orchestra.run.trial096.stdout:(27/173): python3-rgw-20.3.0-5241.g8f8d3829.el9 2.0 MB/s | 100 kB 00:00 2026-02-13T03:30:51.898 INFO:teuthology.orchestra.run.trial096.stdout:(28/173): rbd-fuse-20.3.0-5241.g8f8d3829.el9.x8 1.6 MB/s | 84 kB 00:00 2026-02-13T03:30:52.150 INFO:teuthology.orchestra.run.trial096.stdout:(29/173): rbd-mirror-20.3.0-5241.g8f8d3829.el9. 11 MB/s | 2.9 MB 00:00 2026-02-13T03:30:52.197 INFO:teuthology.orchestra.run.trial096.stdout:(30/173): rbd-nbd-20.3.0-5241.g8f8d3829.el9.x86 3.6 MB/s | 172 kB 00:00 2026-02-13T03:30:52.220 INFO:teuthology.orchestra.run.trial096.stdout:(31/173): librgw2-20.3.0-5241.g8f8d3829.el9.x86 9.4 MB/s | 6.5 MB 00:00 2026-02-13T03:30:52.234 INFO:teuthology.orchestra.run.trial096.stdout:(32/173): ceph-grafana-dashboards-20.3.0-5241.g 1.5 MB/s | 57 kB 00:00 2026-02-13T03:30:52.259 INFO:teuthology.orchestra.run.trial096.stdout:(33/173): ceph-mgr-cephadm-20.3.0-5241.g8f8d382 4.6 MB/s | 183 kB 00:00 2026-02-13T03:30:53.094 INFO:teuthology.orchestra.run.trial096.stdout:(34/173): ceph-mgr-diskprediction-local-20.3.0- 8.9 MB/s | 7.4 MB 00:00 2026-02-13T03:30:53.153 INFO:teuthology.orchestra.run.trial096.stdout:(35/173): ceph-mgr-modules-core-20.3.0-5241.g8f 5.0 MB/s | 297 kB 00:00 2026-02-13T03:30:53.207 INFO:teuthology.orchestra.run.trial096.stdout:(36/173): ceph-mgr-rook-20.3.0-5241.g8f8d3829.e 932 kB/s | 50 kB 00:00 2026-02-13T03:30:53.228 INFO:teuthology.orchestra.run.trial132.stdout:(9/173): ceph-osd-classic-20.3.0-5241.g8f8d3829 7.8 MB/s | 16 MB 00:01 2026-02-13T03:30:53.252 INFO:teuthology.orchestra.run.trial096.stdout:(37/173): ceph-prometheus-alerts-20.3.0-5241.g8 386 kB/s | 17 kB 00:00 2026-02-13T03:30:53.277 INFO:teuthology.orchestra.run.trial096.stdout:(38/173): ceph-mgr-dashboard-20.3.0-5241.g8f8d3 14 MB/s | 15 MB 00:01 2026-02-13T03:30:53.300 INFO:teuthology.orchestra.run.trial096.stdout:(39/173): ceph-volume-20.3.0-5241.g8f8d3829.el9 6.0 MB/s | 299 kB 00:00 2026-02-13T03:30:53.353 INFO:teuthology.orchestra.run.trial096.stdout:(40/173): cephfs-top-20.3.0-5241.g8f8d3829.el9. 347 kB/s | 18 kB 00:00 2026-02-13T03:30:53.378 INFO:teuthology.orchestra.run.trial096.stdout:(41/173): cephadm-20.3.0-5241.g8f8d3829.el9.noa 10 MB/s | 1.0 MB 00:00 2026-02-13T03:30:53.459 INFO:teuthology.orchestra.run.trial096.stdout:(42/173): cryptsetup-2.8.1-2.el9.x86_64.rpm 3.2 MB/s | 350 kB 00:00 2026-02-13T03:30:53.481 INFO:teuthology.orchestra.run.trial096.stdout:(43/173): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.8 MB/s | 40 kB 00:00 2026-02-13T03:30:53.502 INFO:teuthology.orchestra.run.trial096.stdout:(44/173): libatomic-11.5.0-14.el9.x86_64.rpm 1.0 MB/s | 23 kB 00:00 2026-02-13T03:30:53.525 INFO:teuthology.orchestra.run.trial096.stdout:(45/173): libconfig-1.7.2-9.el9.x86_64.rpm 3.2 MB/s | 72 kB 00:00 2026-02-13T03:30:53.529 INFO:teuthology.orchestra.run.trial096.stdout:(46/173): hwloc-libs-2.4.1-6.el9.x86_64.rpm 14 MB/s | 2.1 MB 00:00 2026-02-13T03:30:53.553 INFO:teuthology.orchestra.run.trial096.stdout:(47/173): libquadmath-11.5.0-14.el9.x86_64.rpm 7.7 MB/s | 184 kB 00:00 2026-02-13T03:30:53.567 INFO:teuthology.orchestra.run.trial096.stdout:(48/173): libgfortran-11.5.0-14.el9.x86_64.rpm 18 MB/s | 794 kB 00:00 2026-02-13T03:30:53.575 INFO:teuthology.orchestra.run.trial096.stdout:(49/173): lksctp-tools-1.0.19-2.el9.x86_64.rpm 4.1 MB/s | 94 kB 00:00 2026-02-13T03:30:53.589 INFO:teuthology.orchestra.run.trial096.stdout:(50/173): mailcap-2.1.49-5.el9.noarch.rpm 1.5 MB/s | 33 kB 00:00 2026-02-13T03:30:53.597 INFO:teuthology.orchestra.run.trial096.stdout:(51/173): pciutils-3.7.0-7.el9.x86_64.rpm 4.1 MB/s | 93 kB 00:00 2026-02-13T03:30:53.616 INFO:teuthology.orchestra.run.trial096.stdout:(52/173): python3-cffi-1.14.5-5.el9.x86_64.rpm 9.2 MB/s | 253 kB 00:00 2026-02-13T03:30:53.625 INFO:teuthology.orchestra.run.trial096.stdout:(53/173): python3-cryptography-36.0.1-5.el9.x86 46 MB/s | 1.2 MB 00:00 2026-02-13T03:30:53.639 INFO:teuthology.orchestra.run.trial096.stdout:(54/173): python3-ply-3.11-14.el9.noarch.rpm 4.5 MB/s | 106 kB 00:00 2026-02-13T03:30:53.649 INFO:teuthology.orchestra.run.trial096.stdout:(55/173): python3-pycparser-2.20-6.el9.noarch.r 5.6 MB/s | 135 kB 00:00 2026-02-13T03:30:53.663 INFO:teuthology.orchestra.run.trial096.stdout:(56/173): python3-requests-2.25.1-10.el9.noarch 5.3 MB/s | 126 kB 00:00 2026-02-13T03:30:53.671 INFO:teuthology.orchestra.run.trial096.stdout:(57/173): python3-urllib3-1.26.5-7.el9.noarch.r 9.6 MB/s | 218 kB 00:00 2026-02-13T03:30:53.686 INFO:teuthology.orchestra.run.trial096.stdout:(58/173): unzip-6.0-59.el9.x86_64.rpm 7.6 MB/s | 182 kB 00:00 2026-02-13T03:30:53.695 INFO:teuthology.orchestra.run.trial096.stdout:(59/173): zip-3.0-35.el9.x86_64.rpm 11 MB/s | 266 kB 00:00 2026-02-13T03:30:53.721 INFO:teuthology.orchestra.run.trial096.stdout:(60/173): bison-3.7.4-5.el9.x86_64.rpm 36 MB/s | 943 kB 00:00 2026-02-13T03:30:53.722 INFO:teuthology.orchestra.run.trial096.stdout:(61/173): automake-1.16.2-8.el9.noarch.rpm 19 MB/s | 689 kB 00:00 2026-02-13T03:30:53.744 INFO:teuthology.orchestra.run.trial096.stdout:(62/173): boost-program-options-1.75.0-13.el9.x 4.5 MB/s | 104 kB 00:00 2026-02-13T03:30:53.745 INFO:teuthology.orchestra.run.trial096.stdout:(63/173): elfutils-libelf-devel-0.194-1.el9.x86 3.4 MB/s | 79 kB 00:00 2026-02-13T03:30:53.766 INFO:teuthology.orchestra.run.trial096.stdout:(64/173): flex-2.6.4-9.el9.x86_64.rpm 14 MB/s | 313 kB 00:00 2026-02-13T03:30:53.767 INFO:teuthology.orchestra.run.trial096.stdout:(65/173): flexiblas-3.0.4-8.el9.x86_64.rpm 1.5 MB/s | 33 kB 00:00 2026-02-13T03:30:53.791 INFO:teuthology.orchestra.run.trial096.stdout:(66/173): flexiblas-openblas-openmp-3.0.4-8.el9 754 kB/s | 18 kB 00:00 2026-02-13T03:30:53.798 INFO:teuthology.orchestra.run.trial096.stdout:(67/173): flexiblas-netlib-3.0.4-8.el9.x86_64.r 95 MB/s | 3.0 MB 00:00 2026-02-13T03:30:53.798 INFO:teuthology.orchestra.run.trial132.stdout:(10/173): ceph-common-20.3.0-5241.g8f8d3829.el9 5.2 MB/s | 24 MB 00:04 2026-02-13T03:30:53.812 INFO:teuthology.orchestra.run.trial096.stdout:(68/173): libaio-devel-0.3.111-13.el9.x86_64.rp 523 kB/s | 11 kB 00:00 2026-02-13T03:30:53.821 INFO:teuthology.orchestra.run.trial096.stdout:(69/173): libnbd-1.20.3-4.el9.x86_64.rpm 6.8 MB/s | 164 kB 00:00 2026-02-13T03:30:53.823 INFO:teuthology.orchestra.run.trial132.stdout:(11/173): ceph-selinux-20.3.0-5241.g8f8d3829.el 1.0 MB/s | 25 kB 00:00 2026-02-13T03:30:53.836 INFO:teuthology.orchestra.run.trial096.stdout:(70/173): libpmemobj-1.12.1-1.el9.x86_64.rpm 6.7 MB/s | 160 kB 00:00 2026-02-13T03:30:53.843 INFO:teuthology.orchestra.run.trial096.stdout:(71/173): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.0 MB/s | 45 kB 00:00 2026-02-13T03:30:53.866 INFO:teuthology.orchestra.run.trial096.stdout:(72/173): libstoragemgmt-1.10.1-1.el9.x86_64.rp 10 MB/s | 246 kB 00:00 2026-02-13T03:30:53.870 INFO:teuthology.orchestra.run.trial096.stdout:(73/173): librdkafka-1.6.1-102.el9.x86_64.rpm 19 MB/s | 662 kB 00:00 2026-02-13T03:30:53.891 INFO:teuthology.orchestra.run.trial096.stdout:(74/173): libtool-2.4.6-46.el9.x86_64.rpm 23 MB/s | 581 kB 00:00 2026-02-13T03:30:53.891 INFO:teuthology.orchestra.run.trial096.stdout:(75/173): libuuid-devel-2.37.4-21.el9.x86_64.rp 1.1 MB/s | 25 kB 00:00 2026-02-13T03:30:53.914 INFO:teuthology.orchestra.run.trial096.stdout:(76/173): libxslt-1.1.34-12.el9.x86_64.rpm 9.7 MB/s | 233 kB 00:00 2026-02-13T03:30:53.915 INFO:teuthology.orchestra.run.trial096.stdout:(77/173): libzstd-devel-1.5.5-1.el9.x86_64.rpm 2.1 MB/s | 51 kB 00:00 2026-02-13T03:30:53.938 INFO:teuthology.orchestra.run.trial096.stdout:(78/173): lttng-ust-2.12.0-6.el9.x86_64.rpm 12 MB/s | 292 kB 00:00 2026-02-13T03:30:53.940 INFO:teuthology.orchestra.run.trial096.stdout:(79/173): lua-5.4.4-4.el9.x86_64.rpm 7.3 MB/s | 188 kB 00:00 2026-02-13T03:30:53.960 INFO:teuthology.orchestra.run.trial096.stdout:(80/173): openblas-0.3.29-1.el9.x86_64.rpm 1.9 MB/s | 42 kB 00:00 2026-02-13T03:30:53.993 INFO:teuthology.orchestra.run.trial132.stdout:(12/173): ceph-osd-crimson-20.3.0-5241.g8f8d382 8.2 MB/s | 19 MB 00:02 2026-02-13T03:30:54.011 INFO:teuthology.orchestra.run.trial096.stdout:(81/173): openssl-devel-3.5.5-1.el9.x86_64.rpm 95 MB/s | 4.8 MB 00:00 2026-02-13T03:30:54.032 INFO:teuthology.orchestra.run.trial132.stdout:(13/173): cephfs-mirror-20.3.0-5241.g8f8d3829.e 6.2 MB/s | 243 kB 00:00 2026-02-13T03:30:54.033 INFO:teuthology.orchestra.run.trial096.stdout:(82/173): perl-Thread-Queue-3.14-460.el9.noarch 1.0 MB/s | 22 kB 00:00 2026-02-13T03:30:54.055 INFO:teuthology.orchestra.run.trial096.stdout:(83/173): perl-threads-2.25-460.el9.x86_64.rpm 2.6 MB/s | 58 kB 00:00 2026-02-13T03:30:54.063 INFO:teuthology.orchestra.run.trial132.stdout:(14/173): cephfs-shell-20.3.0-5241.g8f8d3829.el 877 kB/s | 27 kB 00:00 2026-02-13T03:30:54.079 INFO:teuthology.orchestra.run.trial096.stdout:(84/173): openblas-openmp-0.3.29-1.el9.x86_64.r 38 MB/s | 5.3 MB 00:00 2026-02-13T03:30:54.080 INFO:teuthology.orchestra.run.trial096.stdout:(85/173): perl-threads-shared-1.61-460.el9.x86_ 1.8 MB/s | 45 kB 00:00 2026-02-13T03:30:54.094 INFO:teuthology.orchestra.run.trial132.stdout:(15/173): libcephfs-devel-20.3.0-5241.g8f8d3829 1.2 MB/s | 37 kB 00:00 2026-02-13T03:30:54.126 INFO:teuthology.orchestra.run.trial132.stdout:(16/173): libcephfs-proxy2-20.3.0-5241.g8f8d382 759 kB/s | 24 kB 00:00 2026-02-13T03:30:54.129 INFO:teuthology.orchestra.run.trial096.stdout:(86/173): postgresql-13.23-1.el9.x86_64.rpm 33 MB/s | 1.6 MB 00:00 2026-02-13T03:30:54.130 INFO:teuthology.orchestra.run.trial096.stdout:(87/173): postgresql-contrib-13.23-1.el9.x86_64 18 MB/s | 903 kB 00:00 2026-02-13T03:30:54.166 INFO:teuthology.orchestra.run.trial133.stdout:Extra Packages for Enterprise Linux 1.9 MB/s | 20 MB 00:10 2026-02-13T03:30:54.225 INFO:teuthology.orchestra.run.trial132.stdout:(17/173): libcephfs2-20.3.0-5241.g8f8d3829.el9. 9.0 MB/s | 909 kB 00:00 2026-02-13T03:30:54.248 INFO:teuthology.orchestra.run.trial132.stdout:(18/173): ceph-radosgw-20.3.0-5241.g8f8d3829.el 13 MB/s | 13 MB 00:01 2026-02-13T03:30:54.249 INFO:teuthology.orchestra.run.trial132.stdout:(19/173): libcephsqlite-20.3.0-5241.g8f8d3829.e 6.5 MB/s | 159 kB 00:00 2026-02-13T03:30:54.261 INFO:teuthology.orchestra.run.trial132.stdout:(20/173): librados-devel-20.3.0-5241.g8f8d3829. 9.6 MB/s | 123 kB 00:00 2026-02-13T03:30:54.263 INFO:teuthology.orchestra.run.trial132.stdout:(21/173): libradosstriper1-20.3.0-5241.g8f8d382 18 MB/s | 248 kB 00:00 2026-02-13T03:30:54.279 INFO:teuthology.orchestra.run.trial132.stdout:(22/173): python3-ceph-argparse-20.3.0-5241.g8f 2.7 MB/s | 45 kB 00:00 2026-02-13T03:30:54.299 INFO:teuthology.orchestra.run.trial132.stdout:(23/173): python3-ceph-common-20.3.0-5241.g8f8d 9.3 MB/s | 185 kB 00:00 2026-02-13T03:30:54.319 INFO:teuthology.orchestra.run.trial132.stdout:(24/173): python3-cephfs-20.3.0-5241.g8f8d3829. 10 MB/s | 204 kB 00:00 2026-02-13T03:30:54.320 INFO:teuthology.orchestra.run.trial096.stdout:(88/173): ceph-test-20.3.0-5241.g8f8d3829.el9.x 20 MB/s | 78 MB 00:03 2026-02-13T03:30:54.333 INFO:teuthology.orchestra.run.trial096.stdout:(89/173): postgresql-private-libs-13.23-1.el9.x 676 kB/s | 138 kB 00:00 2026-02-13T03:30:54.342 INFO:teuthology.orchestra.run.trial132.stdout:(25/173): python3-rados-20.3.0-5241.g8f8d3829.e 14 MB/s | 324 kB 00:00 2026-02-13T03:30:54.365 INFO:teuthology.orchestra.run.trial132.stdout:(26/173): python3-rbd-20.3.0-5241.g8f8d3829.el9 13 MB/s | 306 kB 00:00 2026-02-13T03:30:54.384 INFO:teuthology.orchestra.run.trial132.stdout:(27/173): python3-rgw-20.3.0-5241.g8f8d3829.el9 5.2 MB/s | 100 kB 00:00 2026-02-13T03:30:54.402 INFO:teuthology.orchestra.run.trial132.stdout:(28/173): rbd-fuse-20.3.0-5241.g8f8d3829.el9.x8 4.5 MB/s | 84 kB 00:00 2026-02-13T03:30:54.447 INFO:teuthology.orchestra.run.trial096.stdout:(90/173): protobuf-3.14.0-17.el9.x86_64.rpm 7.9 MB/s | 1.0 MB 00:00 2026-02-13T03:30:54.468 INFO:teuthology.orchestra.run.trial096.stdout:(91/173): postgresql-server-13.23-1.el9.x86_64. 17 MB/s | 5.8 MB 00:00 2026-02-13T03:30:54.470 INFO:teuthology.orchestra.run.trial096.stdout:(92/173): python3-colorama-0.4.6-3.el9.noarch.r 2.6 MB/s | 61 kB 00:00 2026-02-13T03:30:54.484 INFO:teuthology.orchestra.run.trial096.stdout:(93/173): python3-babel-2.9.1-2.el9.noarch.rpm 40 MB/s | 6.0 MB 00:00 2026-02-13T03:30:54.492 INFO:teuthology.orchestra.run.trial096.stdout:(94/173): python3-devel-3.9.25-2.el9.x86_64.rpm 9.8 MB/s | 244 kB 00:00 2026-02-13T03:30:54.494 INFO:teuthology.orchestra.run.trial096.stdout:(95/173): python3-jinja2-2.11.3-8.el9.noarch.rp 10 MB/s | 249 kB 00:00 2026-02-13T03:30:54.507 INFO:teuthology.orchestra.run.trial096.stdout:(96/173): python3-jmespath-1.0.1-1.el9.noarch.r 2.1 MB/s | 48 kB 00:00 2026-02-13T03:30:54.517 INFO:teuthology.orchestra.run.trial096.stdout:(97/173): python3-libstoragemgmt-1.10.1-1.el9.x 7.2 MB/s | 177 kB 00:00 2026-02-13T03:30:54.517 INFO:teuthology.orchestra.run.trial096.stdout:(98/173): python3-markupsafe-1.1.1-12.el9.x86_6 1.5 MB/s | 35 kB 00:00 2026-02-13T03:30:54.533 INFO:teuthology.orchestra.run.trial132.stdout:(29/173): librgw2-20.3.0-5241.g8f8d3829.el9.x86 24 MB/s | 6.5 MB 00:00 2026-02-13T03:30:54.540 INFO:teuthology.orchestra.run.trial096.stdout:(99/173): python3-packaging-20.9-5.el9.noarch.r 3.3 MB/s | 77 kB 00:00 2026-02-13T03:30:54.542 INFO:teuthology.orchestra.run.trial096.stdout:(100/173): python3-numpy-f2py-1.23.5-2.el9.x86_ 17 MB/s | 442 kB 00:00 2026-02-13T03:30:54.555 INFO:teuthology.orchestra.run.trial132.stdout:(30/173): rbd-mirror-20.3.0-5241.g8f8d3829.el9. 19 MB/s | 2.9 MB 00:00 2026-02-13T03:30:54.555 INFO:teuthology.orchestra.run.trial132.stdout:(31/173): rbd-nbd-20.3.0-5241.g8f8d3829.el9.x86 7.5 MB/s | 172 kB 00:00 2026-02-13T03:30:54.563 INFO:teuthology.orchestra.run.trial096.stdout:(101/173): python3-protobuf-3.14.0-17.el9.noarc 11 MB/s | 267 kB 00:00 2026-02-13T03:30:54.566 INFO:teuthology.orchestra.run.trial096.stdout:(102/173): python3-pyasn1-0.4.8-6.el9.noarch.rp 6.5 MB/s | 159 kB 00:00 2026-02-13T03:30:54.569 INFO:teuthology.orchestra.run.trial132.stdout:(32/173): ceph-grafana-dashboards-20.3.0-5241.g 4.1 MB/s | 57 kB 00:00 2026-02-13T03:30:54.570 INFO:teuthology.orchestra.run.trial132.stdout:(33/173): ceph-mgr-cephadm-20.3.0-5241.g8f8d382 13 MB/s | 183 kB 00:00 2026-02-13T03:30:54.588 INFO:teuthology.orchestra.run.trial096.stdout:(103/173): python3-pyasn1-modules-0.4.8-6.el9.n 11 MB/s | 279 kB 00:00 2026-02-13T03:30:54.589 INFO:teuthology.orchestra.run.trial096.stdout:(104/173): python3-requests-oauthlib-1.3.0-12.e 2.3 MB/s | 54 kB 00:00 2026-02-13T03:30:54.599 INFO:teuthology.orchestra.run.trial096.stdout:(105/173): python3-numpy-1.23.5-2.el9.x86_64.rp 66 MB/s | 6.1 MB 00:00 2026-02-13T03:30:54.612 INFO:teuthology.orchestra.run.trial096.stdout:(106/173): python3-toml-0.10.2-6.el9.noarch.rpm 1.8 MB/s | 42 kB 00:00 2026-02-13T03:30:54.622 INFO:teuthology.orchestra.run.trial096.stdout:(107/173): python3-wcwidth-0.2.5-8.el9.noarch.r 1.9 MB/s | 44 kB 00:00 2026-02-13T03:30:54.635 INFO:teuthology.orchestra.run.trial096.stdout:(108/173): qatlib-25.08.0-2.el9.x86_64.rpm 9.9 MB/s | 240 kB 00:00 2026-02-13T03:30:54.643 INFO:teuthology.orchestra.run.trial096.stdout:(109/173): qatlib-service-25.08.0-2.el9.x86_64. 1.7 MB/s | 37 kB 00:00 2026-02-13T03:30:54.658 INFO:teuthology.orchestra.run.trial096.stdout:(110/173): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.9 MB/s | 66 kB 00:00 2026-02-13T03:30:54.666 INFO:teuthology.orchestra.run.trial096.stdout:(111/173): socat-1.7.4.1-8.el9.x86_64.rpm 13 MB/s | 303 kB 00:00 2026-02-13T03:30:54.680 INFO:teuthology.orchestra.run.trial096.stdout:(112/173): uuid-1.6.2-55.el9.x86_64.rpm 2.6 MB/s | 58 kB 00:00 2026-02-13T03:30:54.689 INFO:teuthology.orchestra.run.trial096.stdout:(113/173): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 4.1 MB/s | 96 kB 00:00 2026-02-13T03:30:54.702 INFO:teuthology.orchestra.run.trial096.stdout:(114/173): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.8 MB/s | 64 kB 00:00 2026-02-13T03:30:54.711 INFO:teuthology.orchestra.run.trial096.stdout:(115/173): zlib-devel-1.2.11-41.el9.x86_64.rpm 2.0 MB/s | 45 kB 00:00 2026-02-13T03:30:54.731 INFO:teuthology.orchestra.run.trial096.stdout:(116/173): lua-devel-5.4.4-4.el9.x86_64.rpm 786 kB/s | 22 kB 00:00 2026-02-13T03:30:54.763 INFO:teuthology.orchestra.run.trial096.stdout:(117/173): python3-scipy-1.9.3-2.el9.x86_64.rpm 110 MB/s | 19 MB 00:00 2026-02-13T03:30:54.793 INFO:teuthology.orchestra.run.trial096.stdout:(118/173): protobuf-compiler-3.14.0-17.el9.x86_ 10 MB/s | 862 kB 00:00 2026-02-13T03:30:54.916 INFO:teuthology.orchestra.run.trial132.stdout:(34/173): ceph-mgr-diskprediction-local-20.3.0- 21 MB/s | 7.4 MB 00:00 2026-02-13T03:30:54.924 INFO:teuthology.orchestra.run.trial096.stdout:(119/173): grpc-data-1.46.7-10.el9.noarch.rpm 156 kB/s | 19 kB 00:00 2026-02-13T03:30:54.939 INFO:teuthology.orchestra.run.trial132.stdout:(35/173): ceph-mgr-modules-core-20.3.0-5241.g8f 13 MB/s | 297 kB 00:00 2026-02-13T03:30:54.955 INFO:teuthology.orchestra.run.trial132.stdout:(36/173): ceph-mgr-rook-20.3.0-5241.g8f8d3829.e 3.0 MB/s | 50 kB 00:00 2026-02-13T03:30:54.972 INFO:teuthology.orchestra.run.trial132.stdout:(37/173): ceph-prometheus-alerts-20.3.0-5241.g8 1.1 MB/s | 17 kB 00:00 2026-02-13T03:30:54.993 INFO:teuthology.orchestra.run.trial132.stdout:(38/173): ceph-volume-20.3.0-5241.g8f8d3829.el9 14 MB/s | 299 kB 00:00 2026-02-13T03:30:54.997 INFO:teuthology.orchestra.run.trial096.stdout:(120/173): gperftools-libs-2.9.1-3.el9.x86_64.r 1.3 MB/s | 308 kB 00:00 2026-02-13T03:30:55.017 INFO:teuthology.orchestra.run.trial096.stdout:(121/173): abseil-cpp-20211102.0-4.el9.x86_64.r 1.9 MB/s | 551 kB 00:00 2026-02-13T03:30:55.028 INFO:teuthology.orchestra.run.trial096.stdout:(122/173): libarrow-doc-9.0.0-15.el9.noarch.rpm 813 kB/s | 25 kB 00:00 2026-02-13T03:30:55.044 INFO:teuthology.orchestra.run.trial132.stdout:(39/173): cephadm-20.3.0-5241.g8f8d3829.el9.noa 20 MB/s | 1.0 MB 00:00 2026-02-13T03:30:55.049 INFO:teuthology.orchestra.run.trial096.stdout:(123/173): liboath-2.6.12-1.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2026-02-13T03:30:55.060 INFO:teuthology.orchestra.run.trial132.stdout:(40/173): cephfs-top-20.3.0-5241.g8f8d3829.el9. 1.1 MB/s | 18 kB 00:00 2026-02-13T03:30:55.061 INFO:teuthology.orchestra.run.trial096.stdout:(124/173): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2026-02-13T03:30:55.084 INFO:teuthology.orchestra.run.trial096.stdout:(125/173): luarocks-3.9.2-5.el9.noarch.rpm 4.2 MB/s | 151 kB 00:00 2026-02-13T03:30:55.134 INFO:teuthology.orchestra.run.trial096.stdout:(126/173): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2026-02-13T03:30:55.148 INFO:teuthology.orchestra.run.trial096.stdout:(127/173): parquet-libs-9.0.0-15.el9.x86_64.rpm 9.4 MB/s | 838 kB 00:00 2026-02-13T03:30:55.164 INFO:teuthology.orchestra.run.trial096.stdout:(128/173): python3-autocommand-2.2.2-8.el9.noar 975 kB/s | 29 kB 00:00 2026-02-13T03:30:55.173 INFO:teuthology.orchestra.run.trial096.stdout:(129/173): libarrow-9.0.0-15.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2026-02-13T03:30:55.180 INFO:teuthology.orchestra.run.trial096.stdout:(130/173): python3-backports-tarfile-1.2.0-1.el 1.9 MB/s | 60 kB 00:00 2026-02-13T03:30:55.195 INFO:teuthology.orchestra.run.trial096.stdout:(131/173): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.4 MB/s | 43 kB 00:00 2026-02-13T03:30:55.203 INFO:teuthology.orchestra.run.trial096.stdout:(132/173): python3-cachetools-4.2.4-1.el9.noarc 1.0 MB/s | 32 kB 00:00 2026-02-13T03:30:55.210 INFO:teuthology.orchestra.run.trial096.stdout:(133/173): python3-certifi-2023.05.07-4.el9.noa 469 kB/s | 14 kB 00:00 2026-02-13T03:30:55.229 INFO:teuthology.orchestra.run.trial096.stdout:(134/173): python3-cheroot-10.0.1-4.el9.noarch. 4.9 MB/s | 173 kB 00:00 2026-02-13T03:30:55.234 INFO:teuthology.orchestra.run.trial132.stdout:(41/173): ceph-mgr-dashboard-20.3.0-5241.g8f8d3 22 MB/s | 15 MB 00:00 2026-02-13T03:30:55.236 INFO:teuthology.orchestra.run.trial096.stdout:(135/173): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2026-02-13T03:30:55.247 INFO:teuthology.orchestra.run.trial096.stdout:(136/173): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.1 MB/s | 303 kB 00:00 2026-02-13T03:30:55.267 INFO:teuthology.orchestra.run.trial096.stdout:(137/173): python3-google-auth-2.45.0-1.el9.noa 6.6 MB/s | 254 kB 00:00 2026-02-13T03:30:55.278 INFO:teuthology.orchestra.run.trial096.stdout:(138/173): python3-grpcio-1.46.7-10.el9.x86_64. 49 MB/s | 2.0 MB 00:00 2026-02-13T03:30:55.280 INFO:teuthology.orchestra.run.trial096.stdout:(139/173): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2026-02-13T03:30:55.297 INFO:teuthology.orchestra.run.trial096.stdout:(140/173): python3-jaraco-8.2.1-3.el9.noarch.rp 354 kB/s | 11 kB 00:00 2026-02-13T03:30:55.308 INFO:teuthology.orchestra.run.trial096.stdout:(141/173): python3-jaraco-classes-3.2.1-5.el9.n 589 kB/s | 18 kB 00:00 2026-02-13T03:30:55.310 INFO:teuthology.orchestra.run.trial096.stdout:(142/173): python3-jaraco-collections-3.0.0-8.e 766 kB/s | 23 kB 00:00 2026-02-13T03:30:55.328 INFO:teuthology.orchestra.run.trial096.stdout:(143/173): python3-jaraco-context-6.0.1-3.el9.n 648 kB/s | 20 kB 00:00 2026-02-13T03:30:55.338 INFO:teuthology.orchestra.run.trial096.stdout:(144/173): python3-jaraco-functools-3.5.0-2.el9 647 kB/s | 19 kB 00:00 2026-02-13T03:30:55.340 INFO:teuthology.orchestra.run.trial096.stdout:(145/173): python3-jaraco-text-4.0.0-2.el9.noar 875 kB/s | 26 kB 00:00 2026-02-13T03:30:55.368 INFO:teuthology.orchestra.run.trial096.stdout:(146/173): python3-more-itertools-8.12.0-2.el9. 2.5 MB/s | 79 kB 00:00 2026-02-13T03:30:55.372 INFO:teuthology.orchestra.run.trial096.stdout:(147/173): python3-natsort-7.1.1-5.el9.noarch.r 1.8 MB/s | 58 kB 00:00 2026-02-13T03:30:55.391 INFO:teuthology.orchestra.run.trial096.stdout:(148/173): python3-kubernetes-26.1.0-3.el9.noar 16 MB/s | 1.0 MB 00:00 2026-02-13T03:30:55.398 INFO:teuthology.orchestra.run.trial096.stdout:(149/173): python3-portend-3.1.0-2.el9.noarch.r 546 kB/s | 16 kB 00:00 2026-02-13T03:30:55.403 INFO:teuthology.orchestra.run.trial096.stdout:(150/173): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.8 MB/s | 90 kB 00:00 2026-02-13T03:30:55.421 INFO:teuthology.orchestra.run.trial096.stdout:(151/173): python3-pyperclip-1.8.2-2.el9.noarch 936 kB/s | 28 kB 00:00 2026-02-13T03:30:55.428 INFO:teuthology.orchestra.run.trial096.stdout:(152/173): python3-repoze-lru-0.7-16.el9.noarch 1.0 MB/s | 31 kB 00:00 2026-02-13T03:30:55.440 INFO:teuthology.orchestra.run.trial096.stdout:(153/173): python3-routes-2.5.1-5.el9.noarch.rp 5.0 MB/s | 188 kB 00:00 2026-02-13T03:30:55.452 INFO:teuthology.orchestra.run.trial096.stdout:(154/173): python3-rsa-4.9-2.el9.noarch.rpm 1.9 MB/s | 59 kB 00:00 2026-02-13T03:30:55.459 INFO:teuthology.orchestra.run.trial096.stdout:(155/173): python3-tempora-5.0.0-2.el9.noarch.r 1.2 MB/s | 36 kB 00:00 2026-02-13T03:30:55.472 INFO:teuthology.orchestra.run.trial096.stdout:(156/173): python3-typing-extensions-4.15.0-1.e 2.7 MB/s | 86 kB 00:00 2026-02-13T03:30:55.483 INFO:teuthology.orchestra.run.trial096.stdout:(157/173): python3-websocket-client-1.2.3-2.el9 2.8 MB/s | 90 kB 00:00 2026-02-13T03:30:55.489 INFO:teuthology.orchestra.run.trial096.stdout:(158/173): python3-xmltodict-0.12.0-15.el9.noar 737 kB/s | 22 kB 00:00 2026-02-13T03:30:55.502 INFO:teuthology.orchestra.run.trial096.stdout:(159/173): python3-zc-lockfile-2.0-10.el9.noarc 661 kB/s | 20 kB 00:00 2026-02-13T03:30:55.514 INFO:teuthology.orchestra.run.trial096.stdout:(160/173): re2-20211101-20.el9.x86_64.rpm 5.9 MB/s | 191 kB 00:00 2026-02-13T03:30:55.528 INFO:teuthology.orchestra.run.trial096.stdout:(161/173): thrift-0.15.0-4.el9.x86_64.rpm 41 MB/s | 1.6 MB 00:00 2026-02-13T03:30:55.535 INFO:teuthology.orchestra.run.trial096.stdout:(162/173): yaml-cpp-0.6.3-5.el9.x86_64.rpm 3.6 MB/s | 122 kB 00:00 2026-02-13T03:30:55.664 INFO:teuthology.orchestra.run.trial096.stdout:(163/173): NetworkManager-1.54.3-2.el9.x86_64.r 18 MB/s | 2.4 MB 00:00 2026-02-13T03:30:55.684 INFO:teuthology.orchestra.run.trial096.stdout:(164/173): librbd1-20.3.0-5241.g8f8d3829.el9.x8 18 MB/s | 2.8 MB 00:00 2026-02-13T03:30:55.708 INFO:teuthology.orchestra.run.trial096.stdout:(165/173): librados2-20.3.0-5241.g8f8d3829.el9. 18 MB/s | 3.5 MB 00:00 2026-02-13T03:30:55.711 INFO:teuthology.orchestra.run.trial096.stdout:(166/173): NetworkManager-libnm-1.54.3-2.el9.x8 41 MB/s | 1.9 MB 00:00 2026-02-13T03:30:55.711 INFO:teuthology.orchestra.run.trial096.stdout:(167/173): NetworkManager-team-1.54.3-2.el9.x86 1.4 MB/s | 37 kB 00:00 2026-02-13T03:30:55.737 INFO:teuthology.orchestra.run.trial096.stdout:(168/173): iproute-6.17.0-2.el9.x86_64.rpm 33 MB/s | 866 kB 00:00 2026-02-13T03:30:55.764 INFO:teuthology.orchestra.run.trial096.stdout:(169/173): openssl-3.5.5-1.el9.x86_64.rpm 54 MB/s | 1.5 MB 00:00 2026-02-13T03:30:55.773 INFO:teuthology.orchestra.run.trial096.stdout:(170/173): NetworkManager-tui-1.54.3-2.el9.x86_ 3.7 MB/s | 248 kB 00:00 2026-02-13T03:30:55.776 INFO:teuthology.orchestra.run.trial096.stdout:(171/173): iproute-tc-6.17.0-2.el9.x86_64.rpm 6.8 MB/s | 454 kB 00:00 2026-02-13T03:30:55.790 INFO:teuthology.orchestra.run.trial096.stdout:(172/173): openssl-fips-provider-3.5.5-1.el9.x8 31 MB/s | 814 kB 00:00 2026-02-13T03:30:55.861 INFO:teuthology.orchestra.run.trial096.stdout:(173/173): openssl-libs-3.5.5-1.el9.x86_64.rpm 26 MB/s | 2.3 MB 00:00 2026-02-13T03:30:55.864 INFO:teuthology.orchestra.run.trial096.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:30:55.865 INFO:teuthology.orchestra.run.trial096.stdout:Total 41 MB/s | 302 MB 00:07 2026-02-13T03:30:56.163 INFO:teuthology.orchestra.run.trial132.stdout:(42/173): cryptsetup-2.8.1-2.el9.x86_64.rpm 317 kB/s | 350 kB 00:01 2026-02-13T03:30:56.323 INFO:teuthology.orchestra.run.trial132.stdout:(43/173): ledmon-libs-1.1.0-3.el9.x86_64.rpm 253 kB/s | 40 kB 00:00 2026-02-13T03:30:56.482 INFO:teuthology.orchestra.run.trial132.stdout:(44/173): libatomic-11.5.0-14.el9.x86_64.rpm 144 kB/s | 23 kB 00:00 2026-02-13T03:30:56.494 INFO:teuthology.orchestra.run.trial132.stdout:(45/173): hwloc-libs-2.4.1-6.el9.x86_64.rpm 1.7 MB/s | 2.1 MB 00:01 2026-02-13T03:30:56.664 INFO:teuthology.orchestra.run.trial096.stdout:Running transaction check 2026-02-13T03:30:56.700 INFO:teuthology.orchestra.run.trial132.stdout:(46/173): ceph-test-20.3.0-5241.g8f8d3829.el9.x 27 MB/s | 78 MB 00:02 2026-02-13T03:30:56.703 INFO:teuthology.orchestra.run.trial132.stdout:(47/173): libgfortran-11.5.0-14.el9.x86_64.rpm 3.7 MB/s | 794 kB 00:00 2026-02-13T03:30:56.719 INFO:teuthology.orchestra.run.trial132.stdout:(48/173): libconfig-1.7.2-9.el9.x86_64.rpm 304 kB/s | 72 kB 00:00 2026-02-13T03:30:56.736 INFO:teuthology.orchestra.run.trial096.stdout:Transaction check succeeded. 2026-02-13T03:30:56.737 INFO:teuthology.orchestra.run.trial096.stdout:Running transaction test 2026-02-13T03:30:56.859 INFO:teuthology.orchestra.run.trial132.stdout:(49/173): libquadmath-11.5.0-14.el9.x86_64.rpm 1.1 MB/s | 184 kB 00:00 2026-02-13T03:30:56.863 INFO:teuthology.orchestra.run.trial132.stdout:(50/173): lksctp-tools-1.0.19-2.el9.x86_64.rpm 591 kB/s | 94 kB 00:00 2026-02-13T03:30:56.956 INFO:teuthology.orchestra.run.trial132.stdout:(51/173): mailcap-2.1.49-5.el9.noarch.rpm 140 kB/s | 33 kB 00:00 2026-02-13T03:30:57.017 INFO:teuthology.orchestra.run.trial132.stdout:(52/173): pciutils-3.7.0-7.el9.x86_64.rpm 590 kB/s | 93 kB 00:00 2026-02-13T03:30:57.176 INFO:teuthology.orchestra.run.trial132.stdout:(53/173): python3-ply-3.11-14.el9.noarch.rpm 670 kB/s | 106 kB 00:00 2026-02-13T03:30:57.274 INFO:teuthology.orchestra.run.trial132.stdout:(54/173): python3-cryptography-36.0.1-5.el9.x86 3.9 MB/s | 1.2 MB 00:00 2026-02-13T03:30:57.336 INFO:teuthology.orchestra.run.trial132.stdout:(55/173): python3-pycparser-2.20-6.el9.noarch.r 845 kB/s | 135 kB 00:00 2026-02-13T03:30:57.408 INFO:teuthology.orchestra.run.trial133.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-13T03:30:57.433 INFO:teuthology.orchestra.run.trial132.stdout:(56/173): python3-requests-2.25.1-10.el9.noarch 793 kB/s | 126 kB 00:00 2026-02-13T03:30:57.496 INFO:teuthology.orchestra.run.trial132.stdout:(57/173): python3-urllib3-1.26.5-7.el9.noarch.r 1.3 MB/s | 218 kB 00:00 2026-02-13T03:30:57.579 INFO:teuthology.orchestra.run.trial132.stdout:(58/173): python3-cffi-1.14.5-5.el9.x86_64.rpm 354 kB/s | 253 kB 00:00 2026-02-13T03:30:57.594 INFO:teuthology.orchestra.run.trial132.stdout:(59/173): unzip-6.0-59.el9.x86_64.rpm 1.1 MB/s | 182 kB 00:00 2026-02-13T03:30:57.657 INFO:teuthology.orchestra.run.trial132.stdout:(60/173): zip-3.0-35.el9.x86_64.rpm 1.6 MB/s | 266 kB 00:00 2026-02-13T03:30:57.829 INFO:teuthology.orchestra.run.trial096.stdout:Transaction test succeeded. 2026-02-13T03:30:57.829 INFO:teuthology.orchestra.run.trial096.stdout:Running transaction 2026-02-13T03:30:58.071 INFO:teuthology.orchestra.run.trial132.stdout:(61/173): boost-program-options-1.75.0-13.el9.x 251 kB/s | 104 kB 00:00 2026-02-13T03:30:58.195 INFO:teuthology.orchestra.run.trial132.stdout:(62/173): elfutils-libelf-devel-0.194-1.el9.x86 645 kB/s | 79 kB 00:00 2026-02-13T03:30:58.225 INFO:teuthology.orchestra.run.trial132.stdout:(63/173): automake-1.16.2-8.el9.noarch.rpm 1.0 MB/s | 689 kB 00:00 2026-02-13T03:30:58.273 INFO:teuthology.orchestra.run.trial132.stdout:(64/173): bison-3.7.4-5.el9.x86_64.rpm 1.4 MB/s | 943 kB 00:00 2026-02-13T03:30:58.308 INFO:teuthology.orchestra.run.trial132.stdout:(65/173): flexiblas-3.0.4-8.el9.x86_64.rpm 397 kB/s | 33 kB 00:00 2026-02-13T03:30:58.389 INFO:teuthology.orchestra.run.trial132.stdout:(66/173): flexiblas-openblas-openmp-3.0.4-8.el9 224 kB/s | 18 kB 00:00 2026-02-13T03:30:58.433 INFO:teuthology.orchestra.run.trial132.stdout:(67/173): flex-2.6.4-9.el9.x86_64.rpm 1.3 MB/s | 313 kB 00:00 2026-02-13T03:30:58.470 INFO:teuthology.orchestra.run.trial132.stdout:(68/173): libaio-devel-0.3.111-13.el9.x86_64.rp 137 kB/s | 11 kB 00:00 2026-02-13T03:30:58.538 INFO:teuthology.orchestra.run.trial132.stdout:(69/173): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2026-02-13T03:30:58.541 INFO:teuthology.orchestra.run.trial132.stdout:(70/173): libnbd-1.20.3-4.el9.x86_64.rpm 1.5 MB/s | 164 kB 00:00 2026-02-13T03:30:58.563 INFO:teuthology.orchestra.run.trial132.stdout:(71/173): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2026-02-13T03:30:58.621 INFO:teuthology.orchestra.run.trial132.stdout:(72/173): librabbitmq-0.11.0-7.el9.x86_64.rpm 547 kB/s | 45 kB 00:00 2026-02-13T03:30:58.663 INFO:teuthology.orchestra.run.trial132.stdout:(73/173): libstoragemgmt-1.10.1-1.el9.x86_64.rp 2.4 MB/s | 246 kB 00:00 2026-02-13T03:30:58.681 INFO:teuthology.orchestra.run.trial133.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T03:30:58.681 INFO:teuthology.orchestra.run.trial133.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T03:30:58.687 INFO:teuthology.orchestra.run.trial133.stdout:Package NetworkManager-1:1.54.1-1.el9.x86_64 is already installed. 2026-02-13T03:30:58.687 INFO:teuthology.orchestra.run.trial133.stdout:Package iproute-6.17.0-1.el9.x86_64 is already installed. 2026-02-13T03:30:58.688 INFO:teuthology.orchestra.run.trial133.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-13T03:30:58.688 INFO:teuthology.orchestra.run.trial133.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-13T03:30:58.689 INFO:teuthology.orchestra.run.trial133.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-13T03:30:58.690 INFO:teuthology.orchestra.run.trial133.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-13T03:30:58.691 INFO:teuthology.orchestra.run.trial133.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-13T03:30:58.712 INFO:teuthology.orchestra.run.trial132.stdout:(74/173): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2026-02-13T03:30:58.718 INFO:teuthology.orchestra.run.trial133.stdout:Dependencies resolved. 2026-02-13T03:30:58.723 INFO:teuthology.orchestra.run.trial133.stdout:======================================================================================= 2026-02-13T03:30:58.723 INFO:teuthology.orchestra.run.trial133.stdout: Package Arch Version Repository Size 2026-02-13T03:30:58.723 INFO:teuthology.orchestra.run.trial133.stdout:======================================================================================= 2026-02-13T03:30:58.723 INFO:teuthology.orchestra.run.trial133.stdout:Installing: 2026-02-13T03:30:58.724 INFO:teuthology.orchestra.run.trial133.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-13T03:30:58.724 INFO:teuthology.orchestra.run.trial133.stdout: ceph x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 k 2026-02-13T03:30:58.724 INFO:teuthology.orchestra.run.trial133.stdout: ceph-base x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.2 M 2026-02-13T03:30:58.724 INFO:teuthology.orchestra.run.trial133.stdout: ceph-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 987 k 2026-02-13T03:30:58.724 INFO:teuthology.orchestra.run.trial133.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 147 k 2026-02-13T03:30:58.724 INFO:teuthology.orchestra.run.trial133.stdout: ceph-mgr x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 940 k 2026-02-13T03:30:58.724 INFO:teuthology.orchestra.run.trial133.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 183 k 2026-02-13T03:30:58.724 INFO:teuthology.orchestra.run.trial133.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 15 M 2026-02-13T03:30:58.724 INFO:teuthology.orchestra.run.trial133.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 7.4 M 2026-02-13T03:30:58.724 INFO:teuthology.orchestra.run.trial133.stdout: ceph-mgr-rook noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 50 k 2026-02-13T03:30:58.724 INFO:teuthology.orchestra.run.trial133.stdout: ceph-osd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 166 k 2026-02-13T03:30:58.724 INFO:teuthology.orchestra.run.trial133.stdout: ceph-osd-classic x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 16 M 2026-02-13T03:30:58.725 INFO:teuthology.orchestra.run.trial133.stdout: ceph-radosgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 13 M 2026-02-13T03:30:58.725 INFO:teuthology.orchestra.run.trial133.stdout: ceph-test x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 78 M 2026-02-13T03:30:58.725 INFO:teuthology.orchestra.run.trial133.stdout: ceph-volume noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 299 k 2026-02-13T03:30:58.725 INFO:teuthology.orchestra.run.trial133.stdout: cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 1.0 M 2026-02-13T03:30:58.725 INFO:teuthology.orchestra.run.trial133.stdout: cephfs-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 243 k 2026-02-13T03:30:58.725 INFO:teuthology.orchestra.run.trial133.stdout: cephfs-shell x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 27 k 2026-02-13T03:30:58.725 INFO:teuthology.orchestra.run.trial133.stdout: cephfs-top noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 18 k 2026-02-13T03:30:58.725 INFO:teuthology.orchestra.run.trial133.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-13T03:30:58.725 INFO:teuthology.orchestra.run.trial133.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-13T03:30:58.725 INFO:teuthology.orchestra.run.trial133.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-13T03:30:58.725 INFO:teuthology.orchestra.run.trial133.stdout: libcephfs-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 37 k 2026-02-13T03:30:58.725 INFO:teuthology.orchestra.run.trial133.stdout: libcephfs2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 909 k 2026-02-13T03:30:58.725 INFO:teuthology.orchestra.run.trial133.stdout: librados-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 123 k 2026-02-13T03:30:58.726 INFO:teuthology.orchestra.run.trial133.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-13T03:30:58.726 INFO:teuthology.orchestra.run.trial133.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-13T03:30:58.726 INFO:teuthology.orchestra.run.trial133.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-13T03:30:58.726 INFO:teuthology.orchestra.run.trial133.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-13T03:30:58.726 INFO:teuthology.orchestra.run.trial133.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-13T03:30:58.726 INFO:teuthology.orchestra.run.trial133.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-13T03:30:58.726 INFO:teuthology.orchestra.run.trial133.stdout: python3-cephfs x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 204 k 2026-02-13T03:30:58.726 INFO:teuthology.orchestra.run.trial133.stdout: python3-rados x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 324 k 2026-02-13T03:30:58.726 INFO:teuthology.orchestra.run.trial133.stdout: python3-rbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 306 k 2026-02-13T03:30:58.726 INFO:teuthology.orchestra.run.trial133.stdout: python3-rgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 100 k 2026-02-13T03:30:58.726 INFO:teuthology.orchestra.run.trial133.stdout: rbd-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 84 k 2026-02-13T03:30:58.726 INFO:teuthology.orchestra.run.trial133.stdout: rbd-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.9 M 2026-02-13T03:30:58.726 INFO:teuthology.orchestra.run.trial133.stdout: rbd-nbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 172 k 2026-02-13T03:30:58.727 INFO:teuthology.orchestra.run.trial133.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-13T03:30:58.727 INFO:teuthology.orchestra.run.trial133.stdout:Upgrading: 2026-02-13T03:30:58.727 INFO:teuthology.orchestra.run.trial133.stdout: NetworkManager x86_64 1:1.54.3-2.el9 baseos 2.4 M 2026-02-13T03:30:58.727 INFO:teuthology.orchestra.run.trial133.stdout: NetworkManager-libnm x86_64 1:1.54.3-2.el9 baseos 1.9 M 2026-02-13T03:30:58.727 INFO:teuthology.orchestra.run.trial133.stdout: NetworkManager-team x86_64 1:1.54.3-2.el9 baseos 37 k 2026-02-13T03:30:58.727 INFO:teuthology.orchestra.run.trial133.stdout: NetworkManager-tui x86_64 1:1.54.3-2.el9 baseos 248 k 2026-02-13T03:30:58.727 INFO:teuthology.orchestra.run.trial133.stdout: iproute x86_64 6.17.0-2.el9 baseos 866 k 2026-02-13T03:30:58.727 INFO:teuthology.orchestra.run.trial133.stdout: iproute-tc x86_64 6.17.0-2.el9 baseos 454 k 2026-02-13T03:30:58.727 INFO:teuthology.orchestra.run.trial133.stdout: librados2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 3.5 M 2026-02-13T03:30:58.727 INFO:teuthology.orchestra.run.trial133.stdout: librbd1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.8 M 2026-02-13T03:30:58.727 INFO:teuthology.orchestra.run.trial133.stdout: openssl x86_64 1:3.5.5-1.el9 baseos 1.5 M 2026-02-13T03:30:58.727 INFO:teuthology.orchestra.run.trial133.stdout: openssl-fips-provider x86_64 1:3.5.5-1.el9 baseos 814 k 2026-02-13T03:30:58.728 INFO:teuthology.orchestra.run.trial133.stdout: openssl-libs x86_64 1:3.5.5-1.el9 baseos 2.3 M 2026-02-13T03:30:58.728 INFO:teuthology.orchestra.run.trial133.stdout:Installing dependencies: 2026-02-13T03:30:58.728 INFO:teuthology.orchestra.run.trial133.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T03:30:58.728 INFO:teuthology.orchestra.run.trial133.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-13T03:30:58.728 INFO:teuthology.orchestra.run.trial133.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T03:30:58.728 INFO:teuthology.orchestra.run.trial133.stdout: ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 M 2026-02-13T03:30:58.728 INFO:teuthology.orchestra.run.trial133.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 57 k 2026-02-13T03:30:58.728 INFO:teuthology.orchestra.run.trial133.stdout: ceph-mds x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.4 M 2026-02-13T03:30:58.728 INFO:teuthology.orchestra.run.trial133.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 297 k 2026-02-13T03:30:58.728 INFO:teuthology.orchestra.run.trial133.stdout: ceph-mon x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.0 M 2026-02-13T03:30:58.728 INFO:teuthology.orchestra.run.trial133.stdout: ceph-osd-crimson x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 19 M 2026-02-13T03:30:58.728 INFO:teuthology.orchestra.run.trial133.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 17 k 2026-02-13T03:30:58.728 INFO:teuthology.orchestra.run.trial133.stdout: ceph-selinux x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 25 k 2026-02-13T03:30:58.729 INFO:teuthology.orchestra.run.trial133.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T03:30:58.729 INFO:teuthology.orchestra.run.trial133.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T03:30:58.729 INFO:teuthology.orchestra.run.trial133.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T03:30:58.729 INFO:teuthology.orchestra.run.trial133.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T03:30:58.729 INFO:teuthology.orchestra.run.trial133.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T03:30:58.729 INFO:teuthology.orchestra.run.trial133.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T03:30:58.729 INFO:teuthology.orchestra.run.trial133.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-13T03:30:58.729 INFO:teuthology.orchestra.run.trial133.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T03:30:58.729 INFO:teuthology.orchestra.run.trial133.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T03:30:58.729 INFO:teuthology.orchestra.run.trial133.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T03:30:58.729 INFO:teuthology.orchestra.run.trial133.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-13T03:30:58.729 INFO:teuthology.orchestra.run.trial133.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 k 2026-02-13T03:30:58.729 INFO:teuthology.orchestra.run.trial133.stdout: libcephsqlite x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 159 k 2026-02-13T03:30:58.730 INFO:teuthology.orchestra.run.trial133.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T03:30:58.730 INFO:teuthology.orchestra.run.trial133.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T03:30:58.730 INFO:teuthology.orchestra.run.trial133.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T03:30:58.730 INFO:teuthology.orchestra.run.trial133.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T03:30:58.730 INFO:teuthology.orchestra.run.trial133.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T03:30:58.730 INFO:teuthology.orchestra.run.trial133.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T03:30:58.730 INFO:teuthology.orchestra.run.trial133.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T03:30:58.730 INFO:teuthology.orchestra.run.trial133.stdout: libradosstriper1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 248 k 2026-02-13T03:30:58.730 INFO:teuthology.orchestra.run.trial133.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T03:30:58.730 INFO:teuthology.orchestra.run.trial133.stdout: librgw2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 M 2026-02-13T03:30:58.730 INFO:teuthology.orchestra.run.trial133.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T03:30:58.730 INFO:teuthology.orchestra.run.trial133.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T03:30:58.731 INFO:teuthology.orchestra.run.trial133.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T03:30:58.731 INFO:teuthology.orchestra.run.trial133.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-13T03:30:58.731 INFO:teuthology.orchestra.run.trial133.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-13T03:30:58.731 INFO:teuthology.orchestra.run.trial133.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T03:30:58.731 INFO:teuthology.orchestra.run.trial133.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T03:30:58.731 INFO:teuthology.orchestra.run.trial133.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T03:30:58.731 INFO:teuthology.orchestra.run.trial133.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T03:30:58.731 INFO:teuthology.orchestra.run.trial133.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T03:30:58.731 INFO:teuthology.orchestra.run.trial133.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T03:30:58.731 INFO:teuthology.orchestra.run.trial133.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T03:30:58.731 INFO:teuthology.orchestra.run.trial133.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T03:30:58.731 INFO:teuthology.orchestra.run.trial133.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T03:30:58.731 INFO:teuthology.orchestra.run.trial133.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-13T03:30:58.732 INFO:teuthology.orchestra.run.trial133.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-13T03:30:58.732 INFO:teuthology.orchestra.run.trial133.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-13T03:30:58.732 INFO:teuthology.orchestra.run.trial133.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-13T03:30:58.732 INFO:teuthology.orchestra.run.trial133.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T03:30:58.732 INFO:teuthology.orchestra.run.trial133.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T03:30:58.732 INFO:teuthology.orchestra.run.trial133.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T03:30:58.732 INFO:teuthology.orchestra.run.trial133.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T03:30:58.732 INFO:teuthology.orchestra.run.trial133.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T03:30:58.732 INFO:teuthology.orchestra.run.trial133.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T03:30:58.732 INFO:teuthology.orchestra.run.trial133.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T03:30:58.732 INFO:teuthology.orchestra.run.trial133.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T03:30:58.732 INFO:teuthology.orchestra.run.trial133.stdout: python3-ceph-argparse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 45 k 2026-02-13T03:30:58.733 INFO:teuthology.orchestra.run.trial133.stdout: python3-ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 185 k 2026-02-13T03:30:58.733 INFO:teuthology.orchestra.run.trial133.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T03:30:58.733 INFO:teuthology.orchestra.run.trial133.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T03:30:58.733 INFO:teuthology.orchestra.run.trial133.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T03:30:58.733 INFO:teuthology.orchestra.run.trial133.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T03:30:58.733 INFO:teuthology.orchestra.run.trial133.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-13T03:30:58.733 INFO:teuthology.orchestra.run.trial133.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-13T03:30:58.733 INFO:teuthology.orchestra.run.trial133.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T03:30:58.733 INFO:teuthology.orchestra.run.trial133.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T03:30:58.733 INFO:teuthology.orchestra.run.trial133.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T03:30:58.733 INFO:teuthology.orchestra.run.trial133.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T03:30:58.733 INFO:teuthology.orchestra.run.trial133.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T03:30:58.733 INFO:teuthology.orchestra.run.trial133.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T03:30:58.734 INFO:teuthology.orchestra.run.trial133.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T03:30:58.734 INFO:teuthology.orchestra.run.trial133.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-13T03:30:58.734 INFO:teuthology.orchestra.run.trial133.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T03:30:58.734 INFO:teuthology.orchestra.run.trial133.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T03:30:58.734 INFO:teuthology.orchestra.run.trial133.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T03:30:58.734 INFO:teuthology.orchestra.run.trial133.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T03:30:58.734 INFO:teuthology.orchestra.run.trial133.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T03:30:58.734 INFO:teuthology.orchestra.run.trial133.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T03:30:58.734 INFO:teuthology.orchestra.run.trial133.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T03:30:58.734 INFO:teuthology.orchestra.run.trial133.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T03:30:58.734 INFO:teuthology.orchestra.run.trial133.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T03:30:58.734 INFO:teuthology.orchestra.run.trial133.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T03:30:58.735 INFO:teuthology.orchestra.run.trial133.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T03:30:58.735 INFO:teuthology.orchestra.run.trial133.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T03:30:58.735 INFO:teuthology.orchestra.run.trial133.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T03:30:58.735 INFO:teuthology.orchestra.run.trial133.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T03:30:58.735 INFO:teuthology.orchestra.run.trial133.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T03:30:58.735 INFO:teuthology.orchestra.run.trial133.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T03:30:58.735 INFO:teuthology.orchestra.run.trial133.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T03:30:58.735 INFO:teuthology.orchestra.run.trial133.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T03:30:58.735 INFO:teuthology.orchestra.run.trial133.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T03:30:58.735 INFO:teuthology.orchestra.run.trial133.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T03:30:58.735 INFO:teuthology.orchestra.run.trial133.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-13T03:30:58.735 INFO:teuthology.orchestra.run.trial133.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T03:30:58.735 INFO:teuthology.orchestra.run.trial133.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T03:30:58.735 INFO:teuthology.orchestra.run.trial133.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T03:30:58.736 INFO:teuthology.orchestra.run.trial133.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T03:30:58.736 INFO:teuthology.orchestra.run.trial133.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T03:30:58.736 INFO:teuthology.orchestra.run.trial133.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T03:30:58.736 INFO:teuthology.orchestra.run.trial133.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T03:30:58.736 INFO:teuthology.orchestra.run.trial133.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T03:30:58.736 INFO:teuthology.orchestra.run.trial133.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T03:30:58.736 INFO:teuthology.orchestra.run.trial133.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T03:30:58.736 INFO:teuthology.orchestra.run.trial133.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-13T03:30:58.736 INFO:teuthology.orchestra.run.trial133.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T03:30:58.736 INFO:teuthology.orchestra.run.trial133.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T03:30:58.736 INFO:teuthology.orchestra.run.trial133.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T03:30:58.736 INFO:teuthology.orchestra.run.trial133.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T03:30:58.736 INFO:teuthology.orchestra.run.trial133.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T03:30:58.737 INFO:teuthology.orchestra.run.trial133.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T03:30:58.737 INFO:teuthology.orchestra.run.trial133.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T03:30:58.737 INFO:teuthology.orchestra.run.trial133.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T03:30:58.737 INFO:teuthology.orchestra.run.trial133.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T03:30:58.737 INFO:teuthology.orchestra.run.trial133.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-13T03:30:58.737 INFO:teuthology.orchestra.run.trial133.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T03:30:58.737 INFO:teuthology.orchestra.run.trial133.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-13T03:30:58.737 INFO:teuthology.orchestra.run.trial133.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T03:30:58.737 INFO:teuthology.orchestra.run.trial133.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-13T03:30:58.737 INFO:teuthology.orchestra.run.trial133.stdout:Installing weak dependencies: 2026-02-13T03:30:58.737 INFO:teuthology.orchestra.run.trial133.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T03:30:58.737 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:30:58.738 INFO:teuthology.orchestra.run.trial133.stdout:Transaction Summary 2026-02-13T03:30:58.738 INFO:teuthology.orchestra.run.trial133.stdout:======================================================================================= 2026-02-13T03:30:58.738 INFO:teuthology.orchestra.run.trial133.stdout:Install 162 Packages 2026-02-13T03:30:58.738 INFO:teuthology.orchestra.run.trial133.stdout:Upgrade 11 Packages 2026-02-13T03:30:58.738 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:30:58.739 INFO:teuthology.orchestra.run.trial132.stdout:(75/173): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2026-02-13T03:30:58.739 INFO:teuthology.orchestra.run.trial133.stdout:Total download size: 302 M 2026-02-13T03:30:58.739 INFO:teuthology.orchestra.run.trial133.stdout:Downloading Packages: 2026-02-13T03:30:58.746 INFO:teuthology.orchestra.run.trial132.stdout:(76/173): libuuid-devel-2.37.4-21.el9.x86_64.rp 298 kB/s | 25 kB 00:00 2026-02-13T03:30:58.796 INFO:teuthology.orchestra.run.trial132.stdout:(77/173): libxslt-1.1.34-12.el9.x86_64.rpm 2.7 MB/s | 233 kB 00:00 2026-02-13T03:30:58.817 INFO:teuthology.orchestra.run.trial132.stdout:(78/173): libzstd-devel-1.5.5-1.el9.x86_64.rpm 612 kB/s | 51 kB 00:00 2026-02-13T03:30:58.850 INFO:teuthology.orchestra.run.trial132.stdout:(79/173): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.7 MB/s | 292 kB 00:00 2026-02-13T03:30:58.881 INFO:teuthology.orchestra.run.trial132.stdout:(80/173): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2026-02-13T03:30:58.900 INFO:teuthology.orchestra.run.trial132.stdout:(81/173): openblas-0.3.29-1.el9.x86_64.rpm 511 kB/s | 42 kB 00:00 2026-02-13T03:30:58.981 INFO:teuthology.orchestra.run.trial132.stdout:(82/173): perl-Thread-Queue-3.14-460.el9.noarch 273 kB/s | 22 kB 00:00 2026-02-13T03:30:58.991 INFO:teuthology.orchestra.run.trial096.stdout: Preparing : 1/1 2026-02-13T03:30:58.993 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/184 2026-02-13T03:30:59.001 INFO:teuthology.orchestra.run.trial096.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/184 2026-02-13T03:30:59.012 INFO:teuthology.orchestra.run.trial096.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/184 2026-02-13T03:30:59.016 INFO:teuthology.orchestra.run.trial096.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/184 2026-02-13T03:30:59.018 INFO:teuthology.orchestra.run.trial096.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 5/184 2026-02-13T03:30:59.023 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/184 2026-02-13T03:30:59.064 INFO:teuthology.orchestra.run.trial096.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 7/184 2026-02-13T03:30:59.065 INFO:teuthology.orchestra.run.trial132.stdout:(83/173): perl-threads-2.25-460.el9.x86_64.rpm 698 kB/s | 58 kB 00:00 2026-02-13T03:30:59.066 INFO:teuthology.orchestra.run.trial133.stdout:(1/173): ceph-20.3.0-5241.g8f8d3829.el9.x86_64. 128 kB/s | 6.5 kB 00:00 2026-02-13T03:30:59.070 INFO:teuthology.orchestra.run.trial096.stdout: Upgrading : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 8/184 2026-02-13T03:30:59.083 INFO:teuthology.orchestra.run.trial132.stdout:(84/173): openssl-devel-3.5.5-1.el9.x86_64.rpm 24 MB/s | 4.8 MB 00:00 2026-02-13T03:30:59.105 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:30:59.107 INFO:teuthology.orchestra.run.trial096.stdout: Upgrading : NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:30:59.148 INFO:teuthology.orchestra.run.trial132.stdout:(85/173): perl-threads-shared-1.61-460.el9.x86_ 540 kB/s | 45 kB 00:00 2026-02-13T03:30:59.166 INFO:teuthology.orchestra.run.trial133.stdout:(2/173): ceph-fuse-20.3.0-5241.g8f8d3829.el9.x8 9.6 MB/s | 987 kB 00:00 2026-02-13T03:30:59.194 INFO:teuthology.orchestra.run.trial132.stdout:(86/173): openblas-openmp-0.3.29-1.el9.x86_64.r 15 MB/s | 5.3 MB 00:00 2026-02-13T03:30:59.197 INFO:teuthology.orchestra.run.trial132.stdout:(87/173): postgresql-13.23-1.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2026-02-13T03:30:59.198 INFO:teuthology.orchestra.run.trial133.stdout:(3/173): ceph-immutable-object-cache-20.3.0-524 4.4 MB/s | 147 kB 00:00 2026-02-13T03:30:59.210 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:30:59.213 INFO:teuthology.orchestra.run.trial096.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 10/184 2026-02-13T03:30:59.244 INFO:teuthology.orchestra.run.trial096.stdout: Installing : re2-1:20211101-20.el9.x86_64 11/184 2026-02-13T03:30:59.266 INFO:teuthology.orchestra.run.trial096.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 12/184 2026-02-13T03:30:59.277 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 13/184 2026-02-13T03:30:59.277 INFO:teuthology.orchestra.run.trial132.stdout:(88/173): postgresql-private-libs-13.23-1.el9.x 1.6 MB/s | 138 kB 00:00 2026-02-13T03:30:59.280 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-packaging-20.9-5.el9.noarch 14/184 2026-02-13T03:30:59.282 INFO:teuthology.orchestra.run.trial132.stdout:(89/173): postgresql-contrib-13.23-1.el9.x86_64 6.6 MB/s | 903 kB 00:00 2026-02-13T03:30:59.285 INFO:teuthology.orchestra.run.trial096.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 15/184 2026-02-13T03:30:59.291 INFO:teuthology.orchestra.run.trial096.stdout: Installing : lua-5.4.4-4.el9.x86_64 16/184 2026-02-13T03:30:59.294 INFO:teuthology.orchestra.run.trial096.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 17/184 2026-02-13T03:30:59.298 INFO:teuthology.orchestra.run.trial096.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/184 2026-02-13T03:30:59.307 INFO:teuthology.orchestra.run.trial133.stdout:(4/173): ceph-base-20.3.0-5241.g8f8d3829.el9.x8 18 MB/s | 5.2 MB 00:00 2026-02-13T03:30:59.322 INFO:teuthology.orchestra.run.trial096.stdout: Installing : unzip-6.0-59.el9.x86_64 19/184 2026-02-13T03:30:59.334 INFO:teuthology.orchestra.run.trial133.stdout:(5/173): ceph-mds-20.3.0-5241.g8f8d3829.el9.x86 18 MB/s | 2.4 MB 00:00 2026-02-13T03:30:59.335 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/184 2026-02-13T03:30:59.341 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/184 2026-02-13T03:30:59.344 INFO:teuthology.orchestra.run.trial096.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 22/184 2026-02-13T03:30:59.350 INFO:teuthology.orchestra.run.trial096.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 23/184 2026-02-13T03:30:59.352 INFO:teuthology.orchestra.run.trial096.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 24/184 2026-02-13T03:30:59.354 INFO:teuthology.orchestra.run.trial096.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 25/184 2026-02-13T03:30:59.356 INFO:teuthology.orchestra.run.trial133.stdout:(6/173): ceph-mgr-20.3.0-5241.g8f8d3829.el9.x86 19 MB/s | 940 kB 00:00 2026-02-13T03:30:59.363 INFO:teuthology.orchestra.run.trial096.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 26/184 2026-02-13T03:30:59.369 INFO:teuthology.orchestra.run.trial132.stdout:(90/173): protobuf-3.14.0-17.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2026-02-13T03:30:59.389 INFO:teuthology.orchestra.run.trial132.stdout:(91/173): postgresql-server-13.23-1.el9.x86_64. 30 MB/s | 5.8 MB 00:00 2026-02-13T03:30:59.393 INFO:teuthology.orchestra.run.trial133.stdout:(7/173): ceph-osd-20.3.0-5241.g8f8d3829.el9.x86 4.4 MB/s | 166 kB 00:00 2026-02-13T03:30:59.398 INFO:teuthology.orchestra.run.trial096.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 27/184 2026-02-13T03:30:59.403 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 28/184 2026-02-13T03:30:59.405 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 29/184 2026-02-13T03:30:59.405 INFO:teuthology.orchestra.run.trial096.stdout: Installing : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T03:30:59.428 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T03:30:59.435 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 31/184 2026-02-13T03:30:59.452 INFO:teuthology.orchestra.run.trial132.stdout:(92/173): python3-colorama-0.4.6-3.el9.noarch.r 743 kB/s | 61 kB 00:00 2026-02-13T03:30:59.458 INFO:teuthology.orchestra.run.trial096.stdout: Installing : zip-3.0-35.el9.x86_64 32/184 2026-02-13T03:30:59.464 INFO:teuthology.orchestra.run.trial096.stdout: Installing : luarocks-3.9.2-5.el9.noarch 33/184 2026-02-13T03:30:59.467 INFO:teuthology.orchestra.run.trial096.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 34/184 2026-02-13T03:30:59.471 INFO:teuthology.orchestra.run.trial096.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/184 2026-02-13T03:30:59.474 INFO:teuthology.orchestra.run.trial132.stdout:(93/173): python3-devel-3.9.25-2.el9.x86_64.rpm 2.8 MB/s | 244 kB 00:00 2026-02-13T03:30:59.474 INFO:teuthology.orchestra.run.trial096.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 36/184 2026-02-13T03:30:59.502 INFO:teuthology.orchestra.run.trial096.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 37/184 2026-02-13T03:30:59.535 INFO:teuthology.orchestra.run.trial132.stdout:(94/173): python3-jinja2-2.11.3-8.el9.noarch.rp 2.9 MB/s | 249 kB 00:00 2026-02-13T03:30:59.554 INFO:teuthology.orchestra.run.trial096.stdout: Installing : automake-1.16.2-8.el9.noarch 38/184 2026-02-13T03:30:59.557 INFO:teuthology.orchestra.run.trial132.stdout:(95/173): python3-jmespath-1.0.1-1.el9.noarch.r 573 kB/s | 48 kB 00:00 2026-02-13T03:30:59.567 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/184 2026-02-13T03:30:59.573 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/184 2026-02-13T03:30:59.582 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 41/184 2026-02-13T03:30:59.598 INFO:teuthology.orchestra.run.trial133.stdout:(8/173): ceph-mon-20.3.0-5241.g8f8d3829.el9.x86 19 MB/s | 5.0 MB 00:00 2026-02-13T03:30:59.599 INFO:teuthology.orchestra.run.trial096.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 42/184 2026-02-13T03:30:59.603 INFO:teuthology.orchestra.run.trial132.stdout:(96/173): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2026-02-13T03:30:59.605 INFO:teuthology.orchestra.run.trial096.stdout: Upgrading : openssl-libs-1:3.5.5-1.el9.x86_64 43/184 2026-02-13T03:30:59.619 INFO:teuthology.orchestra.run.trial132.stdout:(97/173): python3-libstoragemgmt-1.10.1-1.el9.x 2.1 MB/s | 177 kB 00:00 2026-02-13T03:30:59.640 INFO:teuthology.orchestra.run.trial132.stdout:(98/173): python3-markupsafe-1.1.1-12.el9.x86_6 419 kB/s | 35 kB 00:00 2026-02-13T03:30:59.705 INFO:teuthology.orchestra.run.trial132.stdout:(99/173): python3-numpy-f2py-1.23.5-2.el9.x86_6 5.1 MB/s | 442 kB 00:00 2026-02-13T03:30:59.723 INFO:teuthology.orchestra.run.trial132.stdout:(100/173): python3-packaging-20.9-5.el9.noarch. 926 kB/s | 77 kB 00:00 2026-02-13T03:30:59.758 INFO:teuthology.orchestra.run.trial096.stdout: Upgrading : openssl-fips-provider-1:3.5.5-1.el9.x86_64 44/184 2026-02-13T03:30:59.761 INFO:teuthology.orchestra.run.trial096.stdout: Upgrading : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T03:30:59.789 INFO:teuthology.orchestra.run.trial132.stdout:(101/173): python3-protobuf-3.14.0-17.el9.noarc 3.1 MB/s | 267 kB 00:00 2026-02-13T03:30:59.804 INFO:teuthology.orchestra.run.trial132.stdout:(102/173): python3-numpy-1.23.5-2.el9.x86_64.rp 31 MB/s | 6.1 MB 00:00 2026-02-13T03:30:59.808 INFO:teuthology.orchestra.run.trial132.stdout:(103/173): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.8 MB/s | 159 kB 00:00 2026-02-13T03:30:59.874 INFO:teuthology.orchestra.run.trial132.stdout:(104/173): python3-pyasn1-modules-0.4.8-6.el9.n 3.2 MB/s | 279 kB 00:00 2026-02-13T03:30:59.886 INFO:teuthology.orchestra.run.trial132.stdout:(105/173): python3-requests-oauthlib-1.3.0-12.e 650 kB/s | 54 kB 00:00 2026-02-13T03:30:59.900 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T03:30:59.901 INFO:teuthology.orchestra.run.trial096.stdout: Upgrading : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T03:30:59.950 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T03:30:59.951 INFO:teuthology.orchestra.run.trial096.stdout: Installing : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T03:30:59.957 INFO:teuthology.orchestra.run.trial132.stdout:(106/173): python3-toml-0.10.2-6.el9.noarch.rpm 505 kB/s | 42 kB 00:00 2026-02-13T03:30:59.968 INFO:teuthology.orchestra.run.trial132.stdout:(107/173): python3-wcwidth-0.2.5-8.el9.noarch.r 539 kB/s | 44 kB 00:00 2026-02-13T03:30:59.979 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T03:30:59.981 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 48/184 2026-02-13T03:30:59.989 INFO:teuthology.orchestra.run.trial096.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 49/184 2026-02-13T03:30:59.991 INFO:teuthology.orchestra.run.trial096.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 50/184 2026-02-13T03:31:00.040 INFO:teuthology.orchestra.run.trial132.stdout:(108/173): qatlib-25.08.0-2.el9.x86_64.rpm 2.8 MB/s | 240 kB 00:00 2026-02-13T03:31:00.050 INFO:teuthology.orchestra.run.trial132.stdout:(109/173): qatlib-service-25.08.0-2.el9.x86_64. 455 kB/s | 37 kB 00:00 2026-02-13T03:31:00.051 INFO:teuthology.orchestra.run.trial096.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 51/184 2026-02-13T03:31:00.066 INFO:teuthology.orchestra.run.trial096.stdout: Installing : postgresql-13.23-1.el9.x86_64 52/184 2026-02-13T03:31:00.074 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 53/184 2026-02-13T03:31:00.075 INFO:teuthology.orchestra.run.trial096.stdout: Installing : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T03:31:00.096 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T03:31:00.097 INFO:teuthology.orchestra.run.trial096.stdout: Installing : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T03:31:00.121 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T03:31:00.122 INFO:teuthology.orchestra.run.trial132.stdout:(110/173): qatzip-libs-1.3.1-1.el9.x86_64.rpm 807 kB/s | 66 kB 00:00 2026-02-13T03:31:00.129 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 56/184 2026-02-13T03:31:00.133 INFO:teuthology.orchestra.run.trial132.stdout:(111/173): socat-1.7.4.1-8.el9.x86_64.rpm 3.6 MB/s | 303 kB 00:00 2026-02-13T03:31:00.137 INFO:teuthology.orchestra.run.trial096.stdout: Installing : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 57/184 2026-02-13T03:31:00.149 INFO:teuthology.orchestra.run.trial096.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 58/184 2026-02-13T03:31:00.205 INFO:teuthology.orchestra.run.trial096.stdout: Installing : thrift-0.15.0-4.el9.x86_64 59/184 2026-02-13T03:31:00.215 INFO:teuthology.orchestra.run.trial132.stdout:(112/173): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2026-02-13T03:31:00.219 INFO:teuthology.orchestra.run.trial132.stdout:(113/173): uuid-1.6.2-55.el9.x86_64.rpm 596 kB/s | 58 kB 00:00 2026-02-13T03:31:00.235 INFO:teuthology.orchestra.run.trial096.stdout: Upgrading : openssl-1:3.5.5-1.el9.x86_64 60/184 2026-02-13T03:31:00.241 INFO:teuthology.orchestra.run.trial096.stdout: Upgrading : iproute-6.17.0-2.el9.x86_64 61/184 2026-02-13T03:31:00.244 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/184 2026-02-13T03:31:00.244 INFO:teuthology.orchestra.run.trial133.stdout:(9/173): ceph-common-20.3.0-5241.g8f8d3829.el9. 20 MB/s | 24 MB 00:01 2026-02-13T03:31:00.258 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 63/184 2026-02-13T03:31:00.263 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/184 2026-02-13T03:31:00.266 INFO:teuthology.orchestra.run.trial133.stdout:(10/173): ceph-osd-classic-20.3.0-5241.g8f8d382 18 MB/s | 16 MB 00:00 2026-02-13T03:31:00.268 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 65/184 2026-02-13T03:31:00.279 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/184 2026-02-13T03:31:00.284 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/184 2026-02-13T03:31:00.293 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/184 2026-02-13T03:31:00.297 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/184 2026-02-13T03:31:00.297 INFO:teuthology.orchestra.run.trial132.stdout:(114/173): xmlstarlet-1.6.1-20.el9.x86_64.rpm 779 kB/s | 64 kB 00:00 2026-02-13T03:31:00.302 INFO:teuthology.orchestra.run.trial132.stdout:(115/173): zlib-devel-1.2.11-41.el9.x86_64.rpm 538 kB/s | 45 kB 00:00 2026-02-13T03:31:00.305 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/184 2026-02-13T03:31:00.307 INFO:teuthology.orchestra.run.trial133.stdout:(11/173): ceph-selinux-20.3.0-5241.g8f8d3829.el 624 kB/s | 25 kB 00:00 2026-02-13T03:31:00.326 INFO:teuthology.orchestra.run.trial132.stdout:(116/173): lua-devel-5.4.4-4.el9.x86_64.rpm 783 kB/s | 22 kB 00:00 2026-02-13T03:31:00.345 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/184 2026-02-13T03:31:00.363 INFO:teuthology.orchestra.run.trial132.stdout:(117/173): protobuf-compiler-3.14.0-17.el9.x86_ 14 MB/s | 862 kB 00:00 2026-02-13T03:31:00.424 INFO:teuthology.orchestra.run.trial132.stdout:(118/173): python3-scipy-1.9.3-2.el9.x86_64.rpm 31 MB/s | 19 MB 00:00 2026-02-13T03:31:00.484 INFO:teuthology.orchestra.run.trial132.stdout:(119/173): grpc-data-1.46.7-10.el9.noarch.rpm 323 kB/s | 19 kB 00:00 2026-02-13T03:31:00.525 INFO:teuthology.orchestra.run.trial132.stdout:(120/173): gperftools-libs-2.9.1-3.el9.x86_64.r 1.9 MB/s | 308 kB 00:00 2026-02-13T03:31:00.544 INFO:teuthology.orchestra.run.trial132.stdout:(121/173): abseil-cpp-20211102.0-4.el9.x86_64.r 2.5 MB/s | 551 kB 00:00 2026-02-13T03:31:00.545 INFO:teuthology.orchestra.run.trial132.stdout:(122/173): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.2 MB/s | 25 kB 00:00 2026-02-13T03:31:00.566 INFO:teuthology.orchestra.run.trial132.stdout:(123/173): liboath-2.6.12-1.el9.x86_64.rpm 2.3 MB/s | 49 kB 00:00 2026-02-13T03:31:00.567 INFO:teuthology.orchestra.run.trial132.stdout:(124/173): libunwind-1.6.2-1.el9.x86_64.rpm 3.1 MB/s | 67 kB 00:00 2026-02-13T03:31:00.610 INFO:teuthology.orchestra.run.trial132.stdout:(125/173): parquet-libs-9.0.0-15.el9.x86_64.rpm 19 MB/s | 838 kB 00:00 2026-02-13T03:31:00.610 INFO:teuthology.orchestra.run.trial132.stdout:(126/173): luarocks-3.9.2-5.el9.noarch.rpm 3.3 MB/s | 151 kB 00:00 2026-02-13T03:31:00.621 INFO:teuthology.orchestra.run.trial133.stdout:(12/173): ceph-osd-crimson-20.3.0-5241.g8f8d382 19 MB/s | 19 MB 00:01 2026-02-13T03:31:00.653 INFO:teuthology.orchestra.run.trial132.stdout:(127/173): libarrow-9.0.0-15.el9.x86_64.rpm 26 MB/s | 4.4 MB 00:00 2026-02-13T03:31:00.656 INFO:teuthology.orchestra.run.trial132.stdout:(128/173): python3-autocommand-2.2.2-8.el9.noar 655 kB/s | 29 kB 00:00 2026-02-13T03:31:00.664 INFO:teuthology.orchestra.run.trial133.stdout:(13/173): cephfs-mirror-20.3.0-5241.g8f8d3829.e 5.5 MB/s | 243 kB 00:00 2026-02-13T03:31:00.670 INFO:teuthology.orchestra.run.trial132.stdout:(129/173): python3-asyncssh-2.13.2-5.el9.noarch 8.9 MB/s | 548 kB 00:00 2026-02-13T03:31:00.672 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/184 2026-02-13T03:31:00.681 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/184 2026-02-13T03:31:00.685 INFO:teuthology.orchestra.run.trial132.stdout:(130/173): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.4 MB/s | 43 kB 00:00 2026-02-13T03:31:00.685 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/184 2026-02-13T03:31:00.686 INFO:teuthology.orchestra.run.trial132.stdout:(131/173): python3-backports-tarfile-1.2.0-1.el 1.8 MB/s | 60 kB 00:00 2026-02-13T03:31:00.691 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/184 2026-02-13T03:31:00.692 INFO:teuthology.orchestra.run.trial132.stdout:(132/173): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2026-02-13T03:31:00.695 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/184 2026-02-13T03:31:00.700 INFO:teuthology.orchestra.run.trial096.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/184 2026-02-13T03:31:00.702 INFO:teuthology.orchestra.run.trial096.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 78/184 2026-02-13T03:31:00.704 INFO:teuthology.orchestra.run.trial133.stdout:(14/173): cephfs-shell-20.3.0-5241.g8f8d3829.el 695 kB/s | 27 kB 00:00 2026-02-13T03:31:00.704 INFO:teuthology.orchestra.run.trial096.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 79/184 2026-02-13T03:31:00.706 INFO:teuthology.orchestra.run.trial132.stdout:(133/173): python3-certifi-2023.05.07-4.el9.noa 668 kB/s | 14 kB 00:00 2026-02-13T03:31:00.720 INFO:teuthology.orchestra.run.trial132.stdout:(134/173): python3-cheroot-10.0.1-4.el9.noarch. 5.0 MB/s | 173 kB 00:00 2026-02-13T03:31:00.724 INFO:teuthology.orchestra.run.trial132.stdout:(135/173): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2026-02-13T03:31:00.732 INFO:teuthology.orchestra.run.trial096.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/184 2026-02-13T03:31:00.743 INFO:teuthology.orchestra.run.trial133.stdout:(15/173): libcephfs-devel-20.3.0-5241.g8f8d3829 942 kB/s | 37 kB 00:00 2026-02-13T03:31:00.744 INFO:teuthology.orchestra.run.trial132.stdout:(136/173): python3-google-auth-2.45.0-1.el9.noa 11 MB/s | 254 kB 00:00 2026-02-13T03:31:00.749 INFO:teuthology.orchestra.run.trial132.stdout:(137/173): python3-cmd2-2.4.2-2.el9.noarch.rpm 7.0 MB/s | 303 kB 00:00 2026-02-13T03:31:00.767 INFO:teuthology.orchestra.run.trial132.stdout:(138/173): python3-grpcio-tools-1.46.7-10.el9.x 6.1 MB/s | 144 kB 00:00 2026-02-13T03:31:00.771 INFO:teuthology.orchestra.run.trial132.stdout:(139/173): python3-jaraco-8.2.1-3.el9.noarch.rp 483 kB/s | 11 kB 00:00 2026-02-13T03:31:00.775 INFO:teuthology.orchestra.run.trial096.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 81/184 2026-02-13T03:31:00.777 INFO:teuthology.orchestra.run.trial132.stdout:(140/173): python3-grpcio-1.46.7-10.el9.x86_64. 38 MB/s | 2.0 MB 00:00 2026-02-13T03:31:00.779 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/184 2026-02-13T03:31:00.782 INFO:teuthology.orchestra.run.trial133.stdout:(16/173): libcephfs-proxy2-20.3.0-5241.g8f8d382 626 kB/s | 24 kB 00:00 2026-02-13T03:31:00.783 INFO:teuthology.orchestra.run.trial096.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 83/184 2026-02-13T03:31:00.789 INFO:teuthology.orchestra.run.trial096.stdout: Installing : uuid-1.6.2-55.el9.x86_64 84/184 2026-02-13T03:31:00.799 INFO:teuthology.orchestra.run.trial132.stdout:(141/173): python3-jaraco-classes-3.2.1-5.el9.n 548 kB/s | 18 kB 00:00 2026-02-13T03:31:00.801 INFO:teuthology.orchestra.run.trial132.stdout:(142/173): python3-jaraco-collections-3.0.0-8.e 764 kB/s | 23 kB 00:00 2026-02-13T03:31:00.802 INFO:teuthology.orchestra.run.trial133.stdout:(17/173): ceph-radosgw-20.3.0-5241.g8f8d3829.el 24 MB/s | 13 MB 00:00 2026-02-13T03:31:00.805 INFO:teuthology.orchestra.run.trial132.stdout:(143/173): python3-jaraco-context-6.0.1-3.el9.n 696 kB/s | 20 kB 00:00 2026-02-13T03:31:00.817 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 85/184 2026-02-13T03:31:00.820 INFO:teuthology.orchestra.run.trial133.stdout:(18/173): libcephfs2-20.3.0-5241.g8f8d3829.el9. 24 MB/s | 909 kB 00:00 2026-02-13T03:31:00.823 INFO:teuthology.orchestra.run.trial132.stdout:(144/173): python3-jaraco-functools-3.5.0-2.el9 820 kB/s | 19 kB 00:00 2026-02-13T03:31:00.823 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/184 2026-02-13T03:31:00.827 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 87/184 2026-02-13T03:31:00.832 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 88/184 2026-02-13T03:31:00.836 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 89/184 2026-02-13T03:31:00.840 INFO:teuthology.orchestra.run.trial133.stdout:(19/173): libcephsqlite-20.3.0-5241.g8f8d3829.e 4.1 MB/s | 159 kB 00:00 2026-02-13T03:31:00.840 INFO:teuthology.orchestra.run.trial132.stdout:(145/173): python3-jaraco-text-4.0.0-2.el9.noar 677 kB/s | 26 kB 00:00 2026-02-13T03:31:00.843 INFO:teuthology.orchestra.run.trial133.stdout:(20/173): librados-devel-20.3.0-5241.g8f8d3829. 5.1 MB/s | 123 kB 00:00 2026-02-13T03:31:00.843 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 90/184 2026-02-13T03:31:00.847 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 91/184 2026-02-13T03:31:00.853 INFO:teuthology.orchestra.run.trial132.stdout:(146/173): python3-more-itertools-8.12.0-2.el9. 2.6 MB/s | 79 kB 00:00 2026-02-13T03:31:00.861 INFO:teuthology.orchestra.run.trial132.stdout:(147/173): python3-kubernetes-26.1.0-3.el9.noar 18 MB/s | 1.0 MB 00:00 2026-02-13T03:31:00.865 INFO:teuthology.orchestra.run.trial133.stdout:(21/173): libradosstriper1-20.3.0-5241.g8f8d382 9.6 MB/s | 248 kB 00:00 2026-02-13T03:31:00.872 INFO:teuthology.orchestra.run.trial132.stdout:(148/173): python3-natsort-7.1.1-5.el9.noarch.r 1.8 MB/s | 58 kB 00:00 2026-02-13T03:31:00.875 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 92/184 2026-02-13T03:31:00.882 INFO:teuthology.orchestra.run.trial132.stdout:(149/173): python3-portend-3.1.0-2.el9.noarch.r 575 kB/s | 16 kB 00:00 2026-02-13T03:31:00.886 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 93/184 2026-02-13T03:31:00.892 INFO:teuthology.orchestra.run.trial132.stdout:(150/173): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.8 MB/s | 90 kB 00:00 2026-02-13T03:31:00.892 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/184 2026-02-13T03:31:00.898 INFO:teuthology.orchestra.run.trial132.stdout:(151/173): python3-pyperclip-1.8.2-2.el9.noarch 1.0 MB/s | 28 kB 00:00 2026-02-13T03:31:00.899 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 95/184 2026-02-13T03:31:00.902 INFO:teuthology.orchestra.run.trial133.stdout:(22/173): python3-ceph-argparse-20.3.0-5241.g8f 1.2 MB/s | 45 kB 00:00 2026-02-13T03:31:00.903 INFO:teuthology.orchestra.run.trial132.stdout:(152/173): python3-repoze-lru-0.7-16.el9.noarch 1.4 MB/s | 31 kB 00:00 2026-02-13T03:31:00.915 INFO:teuthology.orchestra.run.trial132.stdout:(153/173): python3-routes-2.5.1-5.el9.noarch.rp 7.9 MB/s | 188 kB 00:00 2026-02-13T03:31:00.920 INFO:teuthology.orchestra.run.trial132.stdout:(154/173): python3-rsa-4.9-2.el9.noarch.rpm 2.7 MB/s | 59 kB 00:00 2026-02-13T03:31:00.926 INFO:teuthology.orchestra.run.trial132.stdout:(155/173): python3-tempora-5.0.0-2.el9.noarch.r 1.5 MB/s | 36 kB 00:00 2026-02-13T03:31:00.934 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T03:31:00.943 INFO:teuthology.orchestra.run.trial132.stdout:(156/173): python3-websocket-client-1.2.3-2.el9 3.9 MB/s | 90 kB 00:00 2026-02-13T03:31:00.943 INFO:teuthology.orchestra.run.trial133.stdout:(23/173): python3-ceph-common-20.3.0-5241.g8f8d 4.5 MB/s | 185 kB 00:00 2026-02-13T03:31:00.945 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 97/184 2026-02-13T03:31:00.946 INFO:teuthology.orchestra.run.trial132.stdout:(157/173): python3-typing-extensions-4.15.0-1.e 2.8 MB/s | 86 kB 00:00 2026-02-13T03:31:00.947 INFO:teuthology.orchestra.run.trial132.stdout:(158/173): python3-xmltodict-0.12.0-15.el9.noar 1.0 MB/s | 22 kB 00:00 2026-02-13T03:31:00.968 INFO:teuthology.orchestra.run.trial132.stdout:(159/173): re2-20211101-20.el9.x86_64.rpm 8.3 MB/s | 191 kB 00:00 2026-02-13T03:31:00.974 INFO:teuthology.orchestra.run.trial132.stdout:(160/173): thrift-0.15.0-4.el9.x86_64.rpm 60 MB/s | 1.6 MB 00:00 2026-02-13T03:31:00.974 INFO:teuthology.orchestra.run.trial132.stdout:(161/173): python3-zc-lockfile-2.0-10.el9.noarc 635 kB/s | 20 kB 00:00 2026-02-13T03:31:00.983 INFO:teuthology.orchestra.run.trial133.stdout:(24/173): python3-cephfs-20.3.0-5241.g8f8d3829. 4.9 MB/s | 204 kB 00:00 2026-02-13T03:31:00.992 INFO:teuthology.orchestra.run.trial132.stdout:(162/173): yaml-cpp-0.6.3-5.el9.x86_64.rpm 5.1 MB/s | 122 kB 00:00 2026-02-13T03:31:01.027 INFO:teuthology.orchestra.run.trial133.stdout:(25/173): python3-rados-20.3.0-5241.g8f8d3829.e 7.3 MB/s | 324 kB 00:00 2026-02-13T03:31:01.070 INFO:teuthology.orchestra.run.trial133.stdout:(26/173): python3-rbd-20.3.0-5241.g8f8d3829.el9 6.9 MB/s | 306 kB 00:00 2026-02-13T03:31:01.115 INFO:teuthology.orchestra.run.trial133.stdout:(27/173): librgw2-20.3.0-5241.g8f8d3829.el9.x86 24 MB/s | 6.5 MB 00:00 2026-02-13T03:31:01.116 INFO:teuthology.orchestra.run.trial133.stdout:(28/173): python3-rgw-20.3.0-5241.g8f8d3829.el9 2.1 MB/s | 100 kB 00:00 2026-02-13T03:31:01.137 INFO:teuthology.orchestra.run.trial133.stdout:(29/173): rbd-fuse-20.3.0-5241.g8f8d3829.el9.x8 3.8 MB/s | 84 kB 00:00 2026-02-13T03:31:01.172 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 98/184 2026-02-13T03:31:01.180 INFO:teuthology.orchestra.run.trial133.stdout:(30/173): rbd-nbd-20.3.0-5241.g8f8d3829.el9.x86 3.9 MB/s | 172 kB 00:00 2026-02-13T03:31:01.196 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 99/184 2026-02-13T03:31:01.200 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 100/184 2026-02-13T03:31:01.222 INFO:teuthology.orchestra.run.trial133.stdout:(31/173): ceph-grafana-dashboards-20.3.0-5241.g 1.3 MB/s | 57 kB 00:00 2026-02-13T03:31:01.239 INFO:teuthology.orchestra.run.trial133.stdout:(32/173): rbd-mirror-20.3.0-5241.g8f8d3829.el9. 23 MB/s | 2.9 MB 00:00 2026-02-13T03:31:01.257 INFO:teuthology.orchestra.run.trial133.stdout:(33/173): ceph-mgr-cephadm-20.3.0-5241.g8f8d382 5.1 MB/s | 183 kB 00:00 2026-02-13T03:31:01.259 INFO:teuthology.orchestra.run.trial096.stdout: Installing : openblas-0.3.29-1.el9.x86_64 101/184 2026-02-13T03:31:01.261 INFO:teuthology.orchestra.run.trial096.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 102/184 2026-02-13T03:31:01.283 INFO:teuthology.orchestra.run.trial096.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 103/184 2026-02-13T03:31:01.616 INFO:teuthology.orchestra.run.trial096.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 104/184 2026-02-13T03:31:01.691 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 105/184 2026-02-13T03:31:01.699 INFO:teuthology.orchestra.run.trial133.stdout:(34/173): ceph-mgr-diskprediction-local-20.3.0- 17 MB/s | 7.4 MB 00:00 2026-02-13T03:31:01.750 INFO:teuthology.orchestra.run.trial133.stdout:(35/173): ceph-mgr-modules-core-20.3.0-5241.g8f 5.7 MB/s | 297 kB 00:00 2026-02-13T03:31:01.778 INFO:teuthology.orchestra.run.trial132.stdout:(163/173): NetworkManager-1.54.3-2.el9.x86_64.r 3.0 MB/s | 2.4 MB 00:00 2026-02-13T03:31:01.796 INFO:teuthology.orchestra.run.trial133.stdout:(36/173): ceph-mgr-rook-20.3.0-5241.g8f8d3829.e 1.1 MB/s | 50 kB 00:00 2026-02-13T03:31:01.842 INFO:teuthology.orchestra.run.trial133.stdout:(37/173): ceph-prometheus-alerts-20.3.0-5241.g8 378 kB/s | 17 kB 00:00 2026-02-13T03:31:01.894 INFO:teuthology.orchestra.run.trial133.stdout:(38/173): ceph-volume-20.3.0-5241.g8f8d3829.el9 5.6 MB/s | 299 kB 00:00 2026-02-13T03:31:01.945 INFO:teuthology.orchestra.run.trial132.stdout:(164/173): NetworkManager-libnm-1.54.3-2.el9.x8 11 MB/s | 1.9 MB 00:00 2026-02-13T03:31:01.956 INFO:teuthology.orchestra.run.trial133.stdout:(39/173): ceph-mgr-dashboard-20.3.0-5241.g8f8d3 21 MB/s | 15 MB 00:00 2026-02-13T03:31:01.959 INFO:teuthology.orchestra.run.trial133.stdout:(40/173): cephadm-20.3.0-5241.g8f8d3829.el9.noa 16 MB/s | 1.0 MB 00:00 2026-02-13T03:31:01.984 INFO:teuthology.orchestra.run.trial133.stdout:(41/173): cephfs-top-20.3.0-5241.g8f8d3829.el9. 645 kB/s | 18 kB 00:00 2026-02-13T03:31:02.040 INFO:teuthology.orchestra.run.trial133.stdout:(42/173): cryptsetup-2.8.1-2.el9.x86_64.rpm 4.2 MB/s | 350 kB 00:00 2026-02-13T03:31:02.061 INFO:teuthology.orchestra.run.trial133.stdout:(43/173): hwloc-libs-2.4.1-6.el9.x86_64.rpm 27 MB/s | 2.1 MB 00:00 2026-02-13T03:31:02.080 INFO:teuthology.orchestra.run.trial133.stdout:(44/173): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.0 MB/s | 40 kB 00:00 2026-02-13T03:31:02.104 INFO:teuthology.orchestra.run.trial132.stdout:(165/173): NetworkManager-team-1.54.3-2.el9.x86 234 kB/s | 37 kB 00:00 2026-02-13T03:31:02.108 INFO:teuthology.orchestra.run.trial133.stdout:(45/173): libconfig-1.7.2-9.el9.x86_64.rpm 2.6 MB/s | 72 kB 00:00 2026-02-13T03:31:02.144 INFO:teuthology.orchestra.run.trial133.stdout:(46/173): libgfortran-11.5.0-14.el9.x86_64.rpm 21 MB/s | 794 kB 00:00 2026-02-13T03:31:02.155 INFO:teuthology.orchestra.run.trial133.stdout:(47/173): libatomic-11.5.0-14.el9.x86_64.rpm 244 kB/s | 23 kB 00:00 2026-02-13T03:31:02.175 INFO:teuthology.orchestra.run.trial133.stdout:(48/173): libquadmath-11.5.0-14.el9.x86_64.rpm 5.9 MB/s | 184 kB 00:00 2026-02-13T03:31:02.185 INFO:teuthology.orchestra.run.trial133.stdout:(49/173): lksctp-tools-1.0.19-2.el9.x86_64.rpm 3.0 MB/s | 94 kB 00:00 2026-02-13T03:31:02.203 INFO:teuthology.orchestra.run.trial133.stdout:(50/173): mailcap-2.1.49-5.el9.noarch.rpm 1.1 MB/s | 33 kB 00:00 2026-02-13T03:31:02.212 INFO:teuthology.orchestra.run.trial133.stdout:(51/173): pciutils-3.7.0-7.el9.x86_64.rpm 3.4 MB/s | 93 kB 00:00 2026-02-13T03:31:02.222 INFO:teuthology.orchestra.run.trial132.stdout:(166/173): librbd1-20.3.0-5241.g8f8d3829.el9.x8 2.3 MB/s | 2.8 MB 00:01 2026-02-13T03:31:02.233 INFO:teuthology.orchestra.run.trial133.stdout:(52/173): python3-cffi-1.14.5-5.el9.x86_64.rpm 8.4 MB/s | 253 kB 00:00 2026-02-13T03:31:02.247 INFO:teuthology.orchestra.run.trial133.stdout:(53/173): python3-cryptography-36.0.1-5.el9.x86 35 MB/s | 1.2 MB 00:00 2026-02-13T03:31:02.263 INFO:teuthology.orchestra.run.trial133.stdout:(54/173): python3-ply-3.11-14.el9.noarch.rpm 3.5 MB/s | 106 kB 00:00 2026-02-13T03:31:02.263 INFO:teuthology.orchestra.run.trial132.stdout:(167/173): NetworkManager-tui-1.54.3-2.el9.x86_ 1.5 MB/s | 248 kB 00:00 2026-02-13T03:31:02.269 INFO:teuthology.orchestra.run.trial132.stdout:(168/173): librados2-20.3.0-5241.g8f8d3829.el9. 2.7 MB/s | 3.5 MB 00:01 2026-02-13T03:31:02.276 INFO:teuthology.orchestra.run.trial133.stdout:(55/173): python3-pycparser-2.20-6.el9.noarch.r 4.6 MB/s | 135 kB 00:00 2026-02-13T03:31:02.290 INFO:teuthology.orchestra.run.trial133.stdout:(56/173): python3-requests-2.25.1-10.el9.noarch 4.5 MB/s | 126 kB 00:00 2026-02-13T03:31:02.305 INFO:teuthology.orchestra.run.trial133.stdout:(57/173): python3-urllib3-1.26.5-7.el9.noarch.r 7.3 MB/s | 218 kB 00:00 2026-02-13T03:31:02.321 INFO:teuthology.orchestra.run.trial133.stdout:(58/173): unzip-6.0-59.el9.x86_64.rpm 5.9 MB/s | 182 kB 00:00 2026-02-13T03:31:02.336 INFO:teuthology.orchestra.run.trial133.stdout:(59/173): zip-3.0-35.el9.x86_64.rpm 8.4 MB/s | 266 kB 00:00 2026-02-13T03:31:02.374 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 106/184 2026-02-13T03:31:02.385 INFO:teuthology.orchestra.run.trial132.stdout:(169/173): iproute-6.17.0-2.el9.x86_64.rpm 5.2 MB/s | 866 kB 00:00 2026-02-13T03:31:02.389 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 107/184 2026-02-13T03:31:02.393 INFO:teuthology.orchestra.run.trial096.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 108/184 2026-02-13T03:31:02.395 INFO:teuthology.orchestra.run.trial096.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 109/184 2026-02-13T03:31:02.401 INFO:teuthology.orchestra.run.trial096.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 110/184 2026-02-13T03:31:02.502 INFO:teuthology.orchestra.run.trial132.stdout:(170/173): iproute-tc-6.17.0-2.el9.x86_64.rpm 1.9 MB/s | 454 kB 00:00 2026-02-13T03:31:02.517 INFO:teuthology.orchestra.run.trial133.stdout:(60/173): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2026-02-13T03:31:02.540 INFO:teuthology.orchestra.run.trial133.stdout:(61/173): bison-3.7.4-5.el9.x86_64.rpm 4.5 MB/s | 943 kB 00:00 2026-02-13T03:31:02.544 INFO:teuthology.orchestra.run.trial133.stdout:(62/173): boost-program-options-1.75.0-13.el9.x 3.8 MB/s | 104 kB 00:00 2026-02-13T03:31:02.574 INFO:teuthology.orchestra.run.trial133.stdout:(63/173): elfutils-libelf-devel-0.194-1.el9.x86 2.3 MB/s | 79 kB 00:00 2026-02-13T03:31:02.579 INFO:teuthology.orchestra.run.trial133.stdout:(64/173): flex-2.6.4-9.el9.x86_64.rpm 8.6 MB/s | 313 kB 00:00 2026-02-13T03:31:02.599 INFO:teuthology.orchestra.run.trial133.stdout:(65/173): flexiblas-3.0.4-8.el9.x86_64.rpm 1.3 MB/s | 33 kB 00:00 2026-02-13T03:31:02.624 INFO:teuthology.orchestra.run.trial133.stdout:(66/173): flexiblas-openblas-openmp-3.0.4-8.el9 727 kB/s | 18 kB 00:00 2026-02-13T03:31:02.649 INFO:teuthology.orchestra.run.trial133.stdout:(67/173): libaio-devel-0.3.111-13.el9.x86_64.rp 450 kB/s | 11 kB 00:00 2026-02-13T03:31:02.663 INFO:teuthology.orchestra.run.trial133.stdout:(68/173): flexiblas-netlib-3.0.4-8.el9.x86_64.r 36 MB/s | 3.0 MB 00:00 2026-02-13T03:31:02.672 INFO:teuthology.orchestra.run.trial132.stdout:(171/173): openssl-libs-3.5.5-1.el9.x86_64.rpm 14 MB/s | 2.3 MB 00:00 2026-02-13T03:31:02.676 INFO:teuthology.orchestra.run.trial133.stdout:(69/173): libnbd-1.20.3-4.el9.x86_64.rpm 6.0 MB/s | 164 kB 00:00 2026-02-13T03:31:02.688 INFO:teuthology.orchestra.run.trial096.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 111/184 2026-02-13T03:31:02.690 INFO:teuthology.orchestra.run.trial096.stdout: Installing : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T03:31:02.708 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T03:31:02.710 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 113/184 2026-02-13T03:31:02.790 INFO:teuthology.orchestra.run.trial133.stdout:(70/173): ceph-test-20.3.0-5241.g8f8d3829.el9.x 32 MB/s | 78 MB 00:02 2026-02-13T03:31:02.790 INFO:teuthology.orchestra.run.trial133.stdout:(71/173): librabbitmq-0.11.0-7.el9.x86_64.rpm 396 kB/s | 45 kB 00:00 2026-02-13T03:31:02.791 INFO:teuthology.orchestra.run.trial133.stdout:(72/173): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2026-02-13T03:31:02.819 INFO:teuthology.orchestra.run.trial133.stdout:(73/173): libstoragemgmt-1.10.1-1.el9.x86_64.rp 8.5 MB/s | 246 kB 00:00 2026-02-13T03:31:02.827 INFO:teuthology.orchestra.run.trial133.stdout:(74/173): libtool-2.4.6-46.el9.x86_64.rpm 16 MB/s | 581 kB 00:00 2026-02-13T03:31:02.844 INFO:teuthology.orchestra.run.trial133.stdout:(75/173): libuuid-devel-2.37.4-21.el9.x86_64.rp 980 kB/s | 25 kB 00:00 2026-02-13T03:31:02.854 INFO:teuthology.orchestra.run.trial133.stdout:(76/173): libxslt-1.1.34-12.el9.x86_64.rpm 8.4 MB/s | 233 kB 00:00 2026-02-13T03:31:02.869 INFO:teuthology.orchestra.run.trial133.stdout:(77/173): libzstd-devel-1.5.5-1.el9.x86_64.rpm 2.0 MB/s | 51 kB 00:00 2026-02-13T03:31:02.884 INFO:teuthology.orchestra.run.trial133.stdout:(78/173): lttng-ust-2.12.0-6.el9.x86_64.rpm 9.5 MB/s | 292 kB 00:00 2026-02-13T03:31:02.897 INFO:teuthology.orchestra.run.trial133.stdout:(79/173): lua-5.4.4-4.el9.x86_64.rpm 6.8 MB/s | 188 kB 00:00 2026-02-13T03:31:02.909 INFO:teuthology.orchestra.run.trial133.stdout:(80/173): openblas-0.3.29-1.el9.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2026-02-13T03:31:02.978 INFO:teuthology.orchestra.run.trial133.stdout:(81/173): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2026-02-13T03:31:02.988 INFO:teuthology.orchestra.run.trial133.stdout:(82/173): openssl-devel-3.5.5-1.el9.x86_64.rpm 61 MB/s | 4.8 MB 00:00 2026-02-13T03:31:02.994 INFO:teuthology.orchestra.run.trial133.stdout:(83/173): openblas-openmp-0.3.29-1.el9.x86_64.r 54 MB/s | 5.3 MB 00:00 2026-02-13T03:31:03.004 INFO:teuthology.orchestra.run.trial133.stdout:(84/173): perl-Thread-Queue-3.14-460.el9.noarch 879 kB/s | 22 kB 00:00 2026-02-13T03:31:03.014 INFO:teuthology.orchestra.run.trial133.stdout:(85/173): perl-threads-2.25-460.el9.x86_64.rpm 2.2 MB/s | 58 kB 00:00 2026-02-13T03:31:03.020 INFO:teuthology.orchestra.run.trial133.stdout:(86/173): perl-threads-shared-1.61-460.el9.x86_ 1.7 MB/s | 45 kB 00:00 2026-02-13T03:31:03.043 INFO:teuthology.orchestra.run.trial133.stdout:(87/173): postgresql-contrib-13.23-1.el9.x86_64 31 MB/s | 903 kB 00:00 2026-02-13T03:31:03.047 INFO:teuthology.orchestra.run.trial133.stdout:(88/173): postgresql-private-libs-13.23-1.el9.x 5.0 MB/s | 138 kB 00:00 2026-02-13T03:31:03.077 INFO:teuthology.orchestra.run.trial133.stdout:(89/173): postgresql-13.23-1.el9.x86_64.rpm 22 MB/s | 1.6 MB 00:00 2026-02-13T03:31:03.079 INFO:teuthology.orchestra.run.trial133.stdout:(90/173): protobuf-3.14.0-17.el9.x86_64.rpm 31 MB/s | 1.0 MB 00:00 2026-02-13T03:31:03.106 INFO:teuthology.orchestra.run.trial133.stdout:(91/173): python3-colorama-0.4.6-3.el9.noarch.r 2.3 MB/s | 61 kB 00:00 2026-02-13T03:31:03.127 INFO:teuthology.orchestra.run.trial133.stdout:(92/173): postgresql-server-13.23-1.el9.x86_64. 69 MB/s | 5.8 MB 00:00 2026-02-13T03:31:03.133 INFO:teuthology.orchestra.run.trial133.stdout:(93/173): python3-devel-3.9.25-2.el9.x86_64.rpm 8.7 MB/s | 244 kB 00:00 2026-02-13T03:31:03.156 INFO:teuthology.orchestra.run.trial133.stdout:(94/173): python3-jinja2-2.11.3-8.el9.noarch.rp 8.6 MB/s | 249 kB 00:00 2026-02-13T03:31:03.163 INFO:teuthology.orchestra.run.trial133.stdout:(95/173): python3-babel-2.9.1-2.el9.noarch.rpm 69 MB/s | 6.0 MB 00:00 2026-02-13T03:31:03.164 INFO:teuthology.orchestra.run.trial133.stdout:(96/173): python3-jmespath-1.0.1-1.el9.noarch.r 1.5 MB/s | 48 kB 00:00 2026-02-13T03:31:03.183 INFO:teuthology.orchestra.run.trial133.stdout:(97/173): python3-libstoragemgmt-1.10.1-1.el9.x 6.2 MB/s | 177 kB 00:00 2026-02-13T03:31:03.189 INFO:teuthology.orchestra.run.trial133.stdout:(98/173): python3-markupsafe-1.1.1-12.el9.x86_6 1.3 MB/s | 35 kB 00:00 2026-02-13T03:31:03.212 INFO:teuthology.orchestra.run.trial133.stdout:(99/173): python3-numpy-f2py-1.23.5-2.el9.x86_6 15 MB/s | 442 kB 00:00 2026-02-13T03:31:03.216 INFO:teuthology.orchestra.run.trial133.stdout:(100/173): python3-packaging-20.9-5.el9.noarch. 2.9 MB/s | 77 kB 00:00 2026-02-13T03:31:03.231 INFO:teuthology.orchestra.run.trial133.stdout:(101/173): python3-numpy-1.23.5-2.el9.x86_64.rp 91 MB/s | 6.1 MB 00:00 2026-02-13T03:31:03.240 INFO:teuthology.orchestra.run.trial133.stdout:(102/173): python3-protobuf-3.14.0-17.el9.noarc 9.3 MB/s | 267 kB 00:00 2026-02-13T03:31:03.242 INFO:teuthology.orchestra.run.trial133.stdout:(103/173): python3-pyasn1-0.4.8-6.el9.noarch.rp 6.0 MB/s | 159 kB 00:00 2026-02-13T03:31:03.260 INFO:teuthology.orchestra.run.trial133.stdout:(104/173): python3-pyasn1-modules-0.4.8-6.el9.n 9.7 MB/s | 279 kB 00:00 2026-02-13T03:31:03.266 INFO:teuthology.orchestra.run.trial133.stdout:(105/173): python3-requests-oauthlib-1.3.0-12.e 2.0 MB/s | 54 kB 00:00 2026-02-13T03:31:03.286 INFO:teuthology.orchestra.run.trial133.stdout:(106/173): python3-toml-0.10.2-6.el9.noarch.rpm 1.6 MB/s | 42 kB 00:00 2026-02-13T03:31:03.292 INFO:teuthology.orchestra.run.trial133.stdout:(107/173): python3-wcwidth-0.2.5-8.el9.noarch.r 1.7 MB/s | 44 kB 00:00 2026-02-13T03:31:03.312 INFO:teuthology.orchestra.run.trial133.stdout:(108/173): qatlib-25.08.0-2.el9.x86_64.rpm 8.8 MB/s | 240 kB 00:00 2026-02-13T03:31:03.317 INFO:teuthology.orchestra.run.trial133.stdout:(109/173): qatlib-service-25.08.0-2.el9.x86_64. 1.4 MB/s | 37 kB 00:00 2026-02-13T03:31:03.338 INFO:teuthology.orchestra.run.trial133.stdout:(110/173): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.5 MB/s | 66 kB 00:00 2026-02-13T03:31:03.343 INFO:teuthology.orchestra.run.trial133.stdout:(111/173): socat-1.7.4.1-8.el9.x86_64.rpm 12 MB/s | 303 kB 00:00 2026-02-13T03:31:03.364 INFO:teuthology.orchestra.run.trial133.stdout:(112/173): uuid-1.6.2-55.el9.x86_64.rpm 2.2 MB/s | 58 kB 00:00 2026-02-13T03:31:03.369 INFO:teuthology.orchestra.run.trial133.stdout:(113/173): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 3.6 MB/s | 96 kB 00:00 2026-02-13T03:31:03.389 INFO:teuthology.orchestra.run.trial133.stdout:(114/173): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.5 MB/s | 64 kB 00:00 2026-02-13T03:31:03.394 INFO:teuthology.orchestra.run.trial133.stdout:(115/173): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.7 MB/s | 45 kB 00:00 2026-02-13T03:31:03.415 INFO:teuthology.orchestra.run.trial133.stdout:(116/173): lua-devel-5.4.4-4.el9.x86_64.rpm 837 kB/s | 22 kB 00:00 2026-02-13T03:31:03.421 INFO:teuthology.orchestra.run.trial132.stdout:(172/173): openssl-fips-provider-3.5.5-1.el9.x8 785 kB/s | 814 kB 00:01 2026-02-13T03:31:03.428 INFO:teuthology.orchestra.run.trial133.stdout:(117/173): protobuf-compiler-3.14.0-17.el9.x86_ 25 MB/s | 862 kB 00:00 2026-02-13T03:31:03.561 INFO:teuthology.orchestra.run.trial133.stdout:(118/173): abseil-cpp-20211102.0-4.el9.x86_64.r 3.7 MB/s | 551 kB 00:00 2026-02-13T03:31:03.574 INFO:teuthology.orchestra.run.trial133.stdout:(119/173): gperftools-libs-2.9.1-3.el9.x86_64.r 2.1 MB/s | 308 kB 00:00 2026-02-13T03:31:03.582 INFO:teuthology.orchestra.run.trial133.stdout:(120/173): grpc-data-1.46.7-10.el9.noarch.rpm 935 kB/s | 19 kB 00:00 2026-02-13T03:31:03.602 INFO:teuthology.orchestra.run.trial133.stdout:(121/173): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.2 MB/s | 25 kB 00:00 2026-02-13T03:31:03.623 INFO:teuthology.orchestra.run.trial133.stdout:(122/173): liboath-2.6.12-1.el9.x86_64.rpm 2.3 MB/s | 49 kB 00:00 2026-02-13T03:31:03.645 INFO:teuthology.orchestra.run.trial133.stdout:(123/173): libunwind-1.6.2-1.el9.x86_64.rpm 3.1 MB/s | 67 kB 00:00 2026-02-13T03:31:03.691 INFO:teuthology.orchestra.run.trial133.stdout:(124/173): python3-scipy-1.9.3-2.el9.x86_64.rpm 43 MB/s | 19 MB 00:00 2026-02-13T03:31:03.692 INFO:teuthology.orchestra.run.trial133.stdout:(125/173): luarocks-3.9.2-5.el9.noarch.rpm 3.1 MB/s | 151 kB 00:00 2026-02-13T03:31:03.697 INFO:teuthology.orchestra.run.trial133.stdout:(126/173): libarrow-9.0.0-15.el9.x86_64.rpm 36 MB/s | 4.4 MB 00:00 2026-02-13T03:31:03.721 INFO:teuthology.orchestra.run.trial133.stdout:(127/173): python3-autocommand-2.2.2-8.el9.noar 1.2 MB/s | 29 kB 00:00 2026-02-13T03:31:03.730 INFO:teuthology.orchestra.run.trial133.stdout:(128/173): python3-asyncssh-2.13.2-5.el9.noarch 14 MB/s | 548 kB 00:00 2026-02-13T03:31:03.744 INFO:teuthology.orchestra.run.trial133.stdout:(129/173): python3-backports-tarfile-1.2.0-1.el 2.6 MB/s | 60 kB 00:00 2026-02-13T03:31:03.752 INFO:teuthology.orchestra.run.trial133.stdout:(130/173): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.0 MB/s | 43 kB 00:00 2026-02-13T03:31:03.756 INFO:teuthology.orchestra.run.trial132.stdout:(173/173): openssl-3.5.5-1.el9.x86_64.rpm 1.0 MB/s | 1.5 MB 00:01 2026-02-13T03:31:03.762 INFO:teuthology.orchestra.run.trial132.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:31:03.762 INFO:teuthology.orchestra.run.trial132.stdout:Total 20 MB/s | 302 MB 00:14 2026-02-13T03:31:03.765 INFO:teuthology.orchestra.run.trial133.stdout:(131/173): python3-cachetools-4.2.4-1.el9.noarc 1.5 MB/s | 32 kB 00:00 2026-02-13T03:31:03.773 INFO:teuthology.orchestra.run.trial133.stdout:(132/173): python3-certifi-2023.05.07-4.el9.noa 678 kB/s | 14 kB 00:00 2026-02-13T03:31:03.788 INFO:teuthology.orchestra.run.trial133.stdout:(133/173): python3-cheroot-10.0.1-4.el9.noarch. 7.3 MB/s | 173 kB 00:00 2026-02-13T03:31:03.796 INFO:teuthology.orchestra.run.trial133.stdout:(134/173): python3-cherrypy-18.6.1-2.el9.noarch 15 MB/s | 358 kB 00:00 2026-02-13T03:31:03.815 INFO:teuthology.orchestra.run.trial133.stdout:(135/173): python3-cmd2-2.4.2-2.el9.noarch.rpm 11 MB/s | 303 kB 00:00 2026-02-13T03:31:03.820 INFO:teuthology.orchestra.run.trial133.stdout:(136/173): python3-google-auth-2.45.0-1.el9.noa 11 MB/s | 254 kB 00:00 2026-02-13T03:31:03.826 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:31:03.829 INFO:teuthology.orchestra.run.trial096.stdout: Installing : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:31:03.830 INFO:teuthology.orchestra.run.trial133.stdout:(137/173): parquet-libs-9.0.0-15.el9.x86_64.rpm 5.9 MB/s | 838 kB 00:00 2026-02-13T03:31:03.844 INFO:teuthology.orchestra.run.trial133.stdout:(138/173): python3-grpcio-1.46.7-10.el9.x86_64. 71 MB/s | 2.0 MB 00:00 2026-02-13T03:31:03.845 INFO:teuthology.orchestra.run.trial133.stdout:(139/173): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2026-02-13T03:31:03.848 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:31:03.851 INFO:teuthology.orchestra.run.trial133.stdout:(140/173): python3-jaraco-8.2.1-3.el9.noarch.rp 510 kB/s | 11 kB 00:00 2026-02-13T03:31:03.862 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/184 2026-02-13T03:31:03.866 INFO:teuthology.orchestra.run.trial133.stdout:(141/173): python3-jaraco-classes-3.2.1-5.el9.n 806 kB/s | 18 kB 00:00 2026-02-13T03:31:03.867 INFO:teuthology.orchestra.run.trial133.stdout:(142/173): python3-jaraco-collections-3.0.0-8.e 1.0 MB/s | 23 kB 00:00 2026-02-13T03:31:03.872 INFO:teuthology.orchestra.run.trial133.stdout:(143/173): python3-jaraco-context-6.0.1-3.el9.n 938 kB/s | 20 kB 00:00 2026-02-13T03:31:03.878 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/184 2026-02-13T03:31:03.887 INFO:teuthology.orchestra.run.trial133.stdout:(144/173): python3-jaraco-functools-3.5.0-2.el9 929 kB/s | 19 kB 00:00 2026-02-13T03:31:03.888 INFO:teuthology.orchestra.run.trial133.stdout:(145/173): python3-jaraco-text-4.0.0-2.el9.noar 1.2 MB/s | 26 kB 00:00 2026-02-13T03:31:03.909 INFO:teuthology.orchestra.run.trial133.stdout:(146/173): python3-more-itertools-8.12.0-2.el9. 3.5 MB/s | 79 kB 00:00 2026-02-13T03:31:03.910 INFO:teuthology.orchestra.run.trial133.stdout:(147/173): python3-natsort-7.1.1-5.el9.noarch.r 2.6 MB/s | 58 kB 00:00 2026-02-13T03:31:03.916 INFO:teuthology.orchestra.run.trial133.stdout:(148/173): python3-kubernetes-26.1.0-3.el9.noar 23 MB/s | 1.0 MB 00:00 2026-02-13T03:31:03.931 INFO:teuthology.orchestra.run.trial133.stdout:(149/173): python3-portend-3.1.0-2.el9.noarch.r 760 kB/s | 16 kB 00:00 2026-02-13T03:31:03.932 INFO:teuthology.orchestra.run.trial133.stdout:(150/173): python3-pyOpenSSL-21.0.0-1.el9.noarc 4.0 MB/s | 90 kB 00:00 2026-02-13T03:31:03.937 INFO:teuthology.orchestra.run.trial133.stdout:(151/173): python3-pyperclip-1.8.2-2.el9.noarch 1.3 MB/s | 28 kB 00:00 2026-02-13T03:31:03.952 INFO:teuthology.orchestra.run.trial133.stdout:(152/173): python3-repoze-lru-0.7-16.el9.noarch 1.4 MB/s | 31 kB 00:00 2026-02-13T03:31:03.954 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/184 2026-02-13T03:31:03.955 INFO:teuthology.orchestra.run.trial133.stdout:(153/173): python3-routes-2.5.1-5.el9.noarch.rp 8.0 MB/s | 188 kB 00:00 2026-02-13T03:31:03.959 INFO:teuthology.orchestra.run.trial133.stdout:(154/173): python3-rsa-4.9-2.el9.noarch.rpm 2.7 MB/s | 59 kB 00:00 2026-02-13T03:31:03.963 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 118/184 2026-02-13T03:31:03.974 INFO:teuthology.orchestra.run.trial133.stdout:(155/173): python3-tempora-5.0.0-2.el9.noarch.r 1.6 MB/s | 36 kB 00:00 2026-02-13T03:31:03.977 INFO:teuthology.orchestra.run.trial133.stdout:(156/173): python3-typing-extensions-4.15.0-1.e 3.8 MB/s | 86 kB 00:00 2026-02-13T03:31:03.980 INFO:teuthology.orchestra.run.trial133.stdout:(157/173): python3-websocket-client-1.2.3-2.el9 4.1 MB/s | 90 kB 00:00 2026-02-13T03:31:03.987 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/184 2026-02-13T03:31:03.995 INFO:teuthology.orchestra.run.trial133.stdout:(158/173): python3-xmltodict-0.12.0-15.el9.noar 1.0 MB/s | 22 kB 00:00 2026-02-13T03:31:03.998 INFO:teuthology.orchestra.run.trial133.stdout:(159/173): python3-zc-lockfile-2.0-10.el9.noarc 949 kB/s | 20 kB 00:00 2026-02-13T03:31:04.003 INFO:teuthology.orchestra.run.trial133.stdout:(160/173): re2-20211101-20.el9.x86_64.rpm 8.2 MB/s | 191 kB 00:00 2026-02-13T03:31:04.017 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 120/184 2026-02-13T03:31:04.019 INFO:teuthology.orchestra.run.trial133.stdout:(161/173): yaml-cpp-0.6.3-5.el9.x86_64.rpm 5.7 MB/s | 122 kB 00:00 2026-02-13T03:31:04.059 INFO:teuthology.orchestra.run.trial133.stdout:(162/173): thrift-0.15.0-4.el9.x86_64.rpm 25 MB/s | 1.6 MB 00:00 2026-02-13T03:31:04.068 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/184 2026-02-13T03:31:04.074 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/184 2026-02-13T03:31:04.078 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/184 2026-02-13T03:31:04.082 INFO:teuthology.orchestra.run.trial096.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 124/184 2026-02-13T03:31:04.085 INFO:teuthology.orchestra.run.trial096.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 125/184 2026-02-13T03:31:04.086 INFO:teuthology.orchestra.run.trial096.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T03:31:04.103 INFO:teuthology.orchestra.run.trial133.stdout:(163/173): NetworkManager-1.54.3-2.el9.x86_64.r 55 MB/s | 2.4 MB 00:00 2026-02-13T03:31:04.103 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T03:31:04.141 INFO:teuthology.orchestra.run.trial133.stdout:(164/173): NetworkManager-libnm-1.54.3-2.el9.x8 51 MB/s | 1.9 MB 00:00 2026-02-13T03:31:04.149 INFO:teuthology.orchestra.run.trial133.stdout:(165/173): librados2-20.3.0-5241.g8f8d3829.el9. 24 MB/s | 3.5 MB 00:00 2026-02-13T03:31:04.159 INFO:teuthology.orchestra.run.trial133.stdout:(166/173): librbd1-20.3.0-5241.g8f8d3829.el9.x8 20 MB/s | 2.8 MB 00:00 2026-02-13T03:31:04.167 INFO:teuthology.orchestra.run.trial133.stdout:(167/173): NetworkManager-team-1.54.3-2.el9.x86 1.4 MB/s | 37 kB 00:00 2026-02-13T03:31:04.178 INFO:teuthology.orchestra.run.trial133.stdout:(168/173): NetworkManager-tui-1.54.3-2.el9.x86_ 8.5 MB/s | 248 kB 00:00 2026-02-13T03:31:04.191 INFO:teuthology.orchestra.run.trial133.stdout:(169/173): iproute-6.17.0-2.el9.x86_64.rpm 26 MB/s | 866 kB 00:00 2026-02-13T03:31:04.196 INFO:teuthology.orchestra.run.trial133.stdout:(170/173): iproute-tc-6.17.0-2.el9.x86_64.rpm 15 MB/s | 454 kB 00:00 2026-02-13T03:31:04.214 INFO:teuthology.orchestra.run.trial133.stdout:(171/173): openssl-3.5.5-1.el9.x86_64.rpm 41 MB/s | 1.5 MB 00:00 2026-02-13T03:31:04.224 INFO:teuthology.orchestra.run.trial133.stdout:(172/173): openssl-fips-provider-3.5.5-1.el9.x8 24 MB/s | 814 kB 00:00 2026-02-13T03:31:04.237 INFO:teuthology.orchestra.run.trial133.stdout:(173/173): openssl-libs-3.5.5-1.el9.x86_64.rpm 57 MB/s | 2.3 MB 00:00 2026-02-13T03:31:04.241 INFO:teuthology.orchestra.run.trial133.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:31:04.241 INFO:teuthology.orchestra.run.trial133.stdout:Total 55 MB/s | 302 MB 00:05 2026-02-13T03:31:04.355 INFO:teuthology.orchestra.run.trial096.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 127/184 2026-02-13T03:31:04.358 INFO:teuthology.orchestra.run.trial096.stdout: Installing : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T03:31:04.402 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T03:31:04.402 INFO:teuthology.orchestra.run.trial096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T03:31:04.402 INFO:teuthology.orchestra.run.trial096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T03:31:04.402 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:31:04.405 INFO:teuthology.orchestra.run.trial096.stdout: Installing : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T03:31:04.561 INFO:teuthology.orchestra.run.trial132.stdout:Running transaction check 2026-02-13T03:31:04.635 INFO:teuthology.orchestra.run.trial132.stdout:Transaction check succeeded. 2026-02-13T03:31:04.635 INFO:teuthology.orchestra.run.trial132.stdout:Running transaction test 2026-02-13T03:31:05.077 INFO:teuthology.orchestra.run.trial133.stdout:Running transaction check 2026-02-13T03:31:05.148 INFO:teuthology.orchestra.run.trial133.stdout:Transaction check succeeded. 2026-02-13T03:31:05.148 INFO:teuthology.orchestra.run.trial133.stdout:Running transaction test 2026-02-13T03:31:05.727 INFO:teuthology.orchestra.run.trial132.stdout:Transaction test succeeded. 2026-02-13T03:31:05.727 INFO:teuthology.orchestra.run.trial132.stdout:Running transaction 2026-02-13T03:31:06.235 INFO:teuthology.orchestra.run.trial133.stdout:Transaction test succeeded. 2026-02-13T03:31:06.235 INFO:teuthology.orchestra.run.trial133.stdout:Running transaction 2026-02-13T03:31:06.892 INFO:teuthology.orchestra.run.trial132.stdout: Preparing : 1/1 2026-02-13T03:31:06.894 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/184 2026-02-13T03:31:06.903 INFO:teuthology.orchestra.run.trial132.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/184 2026-02-13T03:31:06.914 INFO:teuthology.orchestra.run.trial132.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/184 2026-02-13T03:31:06.918 INFO:teuthology.orchestra.run.trial132.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/184 2026-02-13T03:31:06.920 INFO:teuthology.orchestra.run.trial132.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 5/184 2026-02-13T03:31:06.925 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/184 2026-02-13T03:31:06.968 INFO:teuthology.orchestra.run.trial132.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 7/184 2026-02-13T03:31:06.971 INFO:teuthology.orchestra.run.trial132.stdout: Upgrading : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 8/184 2026-02-13T03:31:07.015 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:31:07.017 INFO:teuthology.orchestra.run.trial132.stdout: Upgrading : NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:31:07.121 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:31:07.125 INFO:teuthology.orchestra.run.trial132.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 10/184 2026-02-13T03:31:07.160 INFO:teuthology.orchestra.run.trial132.stdout: Installing : re2-1:20211101-20.el9.x86_64 11/184 2026-02-13T03:31:07.183 INFO:teuthology.orchestra.run.trial132.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 12/184 2026-02-13T03:31:07.194 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 13/184 2026-02-13T03:31:07.197 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-packaging-20.9-5.el9.noarch 14/184 2026-02-13T03:31:07.203 INFO:teuthology.orchestra.run.trial132.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 15/184 2026-02-13T03:31:07.208 INFO:teuthology.orchestra.run.trial132.stdout: Installing : lua-5.4.4-4.el9.x86_64 16/184 2026-02-13T03:31:07.211 INFO:teuthology.orchestra.run.trial132.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 17/184 2026-02-13T03:31:07.217 INFO:teuthology.orchestra.run.trial132.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/184 2026-02-13T03:31:07.240 INFO:teuthology.orchestra.run.trial132.stdout: Installing : unzip-6.0-59.el9.x86_64 19/184 2026-02-13T03:31:07.253 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/184 2026-02-13T03:31:07.258 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/184 2026-02-13T03:31:07.262 INFO:teuthology.orchestra.run.trial132.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 22/184 2026-02-13T03:31:07.268 INFO:teuthology.orchestra.run.trial132.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 23/184 2026-02-13T03:31:07.270 INFO:teuthology.orchestra.run.trial132.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 24/184 2026-02-13T03:31:07.271 INFO:teuthology.orchestra.run.trial132.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 25/184 2026-02-13T03:31:07.281 INFO:teuthology.orchestra.run.trial132.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 26/184 2026-02-13T03:31:07.316 INFO:teuthology.orchestra.run.trial132.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 27/184 2026-02-13T03:31:07.321 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 28/184 2026-02-13T03:31:07.323 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 29/184 2026-02-13T03:31:07.323 INFO:teuthology.orchestra.run.trial132.stdout: Installing : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T03:31:07.346 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T03:31:07.352 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 31/184 2026-02-13T03:31:07.376 INFO:teuthology.orchestra.run.trial132.stdout: Installing : zip-3.0-35.el9.x86_64 32/184 2026-02-13T03:31:07.381 INFO:teuthology.orchestra.run.trial132.stdout: Installing : luarocks-3.9.2-5.el9.noarch 33/184 2026-02-13T03:31:07.383 INFO:teuthology.orchestra.run.trial132.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 34/184 2026-02-13T03:31:07.386 INFO:teuthology.orchestra.run.trial132.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/184 2026-02-13T03:31:07.389 INFO:teuthology.orchestra.run.trial132.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 36/184 2026-02-13T03:31:07.393 INFO:teuthology.orchestra.run.trial133.stdout: Preparing : 1/1 2026-02-13T03:31:07.395 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/184 2026-02-13T03:31:07.403 INFO:teuthology.orchestra.run.trial133.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/184 2026-02-13T03:31:07.416 INFO:teuthology.orchestra.run.trial133.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/184 2026-02-13T03:31:07.417 INFO:teuthology.orchestra.run.trial132.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 37/184 2026-02-13T03:31:07.420 INFO:teuthology.orchestra.run.trial133.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/184 2026-02-13T03:31:07.421 INFO:teuthology.orchestra.run.trial133.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 5/184 2026-02-13T03:31:07.426 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/184 2026-02-13T03:31:07.469 INFO:teuthology.orchestra.run.trial132.stdout: Installing : automake-1.16.2-8.el9.noarch 38/184 2026-02-13T03:31:07.469 INFO:teuthology.orchestra.run.trial133.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 7/184 2026-02-13T03:31:07.472 INFO:teuthology.orchestra.run.trial133.stdout: Upgrading : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 8/184 2026-02-13T03:31:07.481 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/184 2026-02-13T03:31:07.487 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/184 2026-02-13T03:31:07.494 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 41/184 2026-02-13T03:31:07.511 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:31:07.512 INFO:teuthology.orchestra.run.trial132.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 42/184 2026-02-13T03:31:07.514 INFO:teuthology.orchestra.run.trial133.stdout: Upgrading : NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:31:07.520 INFO:teuthology.orchestra.run.trial132.stdout: Upgrading : openssl-libs-1:3.5.5-1.el9.x86_64 43/184 2026-02-13T03:31:07.618 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:31:07.622 INFO:teuthology.orchestra.run.trial133.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 10/184 2026-02-13T03:31:07.656 INFO:teuthology.orchestra.run.trial133.stdout: Installing : re2-1:20211101-20.el9.x86_64 11/184 2026-02-13T03:31:07.670 INFO:teuthology.orchestra.run.trial132.stdout: Upgrading : openssl-fips-provider-1:3.5.5-1.el9.x86_64 44/184 2026-02-13T03:31:07.674 INFO:teuthology.orchestra.run.trial132.stdout: Upgrading : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T03:31:07.680 INFO:teuthology.orchestra.run.trial133.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 12/184 2026-02-13T03:31:07.691 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 13/184 2026-02-13T03:31:07.695 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-packaging-20.9-5.el9.noarch 14/184 2026-02-13T03:31:07.701 INFO:teuthology.orchestra.run.trial133.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 15/184 2026-02-13T03:31:07.706 INFO:teuthology.orchestra.run.trial133.stdout: Installing : lua-5.4.4-4.el9.x86_64 16/184 2026-02-13T03:31:07.709 INFO:teuthology.orchestra.run.trial133.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 17/184 2026-02-13T03:31:07.714 INFO:teuthology.orchestra.run.trial133.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/184 2026-02-13T03:31:07.738 INFO:teuthology.orchestra.run.trial133.stdout: Installing : unzip-6.0-59.el9.x86_64 19/184 2026-02-13T03:31:07.751 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/184 2026-02-13T03:31:07.757 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/184 2026-02-13T03:31:07.761 INFO:teuthology.orchestra.run.trial133.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 22/184 2026-02-13T03:31:07.768 INFO:teuthology.orchestra.run.trial133.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 23/184 2026-02-13T03:31:07.770 INFO:teuthology.orchestra.run.trial133.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 24/184 2026-02-13T03:31:07.771 INFO:teuthology.orchestra.run.trial133.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 25/184 2026-02-13T03:31:07.781 INFO:teuthology.orchestra.run.trial133.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 26/184 2026-02-13T03:31:07.806 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T03:31:07.808 INFO:teuthology.orchestra.run.trial132.stdout: Upgrading : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T03:31:07.817 INFO:teuthology.orchestra.run.trial133.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 27/184 2026-02-13T03:31:07.821 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 28/184 2026-02-13T03:31:07.826 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 29/184 2026-02-13T03:31:07.826 INFO:teuthology.orchestra.run.trial133.stdout: Installing : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T03:31:07.849 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T03:31:07.856 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 31/184 2026-02-13T03:31:07.856 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T03:31:07.857 INFO:teuthology.orchestra.run.trial132.stdout: Installing : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T03:31:07.880 INFO:teuthology.orchestra.run.trial133.stdout: Installing : zip-3.0-35.el9.x86_64 32/184 2026-02-13T03:31:07.884 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T03:31:07.886 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 48/184 2026-02-13T03:31:07.887 INFO:teuthology.orchestra.run.trial133.stdout: Installing : luarocks-3.9.2-5.el9.noarch 33/184 2026-02-13T03:31:07.889 INFO:teuthology.orchestra.run.trial133.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 34/184 2026-02-13T03:31:07.892 INFO:teuthology.orchestra.run.trial133.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/184 2026-02-13T03:31:07.894 INFO:teuthology.orchestra.run.trial132.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 49/184 2026-02-13T03:31:07.895 INFO:teuthology.orchestra.run.trial133.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 36/184 2026-02-13T03:31:07.898 INFO:teuthology.orchestra.run.trial132.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 50/184 2026-02-13T03:31:07.923 INFO:teuthology.orchestra.run.trial133.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 37/184 2026-02-13T03:31:07.961 INFO:teuthology.orchestra.run.trial132.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 51/184 2026-02-13T03:31:07.976 INFO:teuthology.orchestra.run.trial132.stdout: Installing : postgresql-13.23-1.el9.x86_64 52/184 2026-02-13T03:31:07.977 INFO:teuthology.orchestra.run.trial133.stdout: Installing : automake-1.16.2-8.el9.noarch 38/184 2026-02-13T03:31:07.983 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 53/184 2026-02-13T03:31:07.984 INFO:teuthology.orchestra.run.trial132.stdout: Installing : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T03:31:07.991 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/184 2026-02-13T03:31:07.996 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/184 2026-02-13T03:31:08.004 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 41/184 2026-02-13T03:31:08.005 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T03:31:08.006 INFO:teuthology.orchestra.run.trial132.stdout: Installing : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T03:31:08.023 INFO:teuthology.orchestra.run.trial133.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 42/184 2026-02-13T03:31:08.030 INFO:teuthology.orchestra.run.trial133.stdout: Upgrading : openssl-libs-1:3.5.5-1.el9.x86_64 43/184 2026-02-13T03:31:08.032 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T03:31:08.040 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 56/184 2026-02-13T03:31:08.048 INFO:teuthology.orchestra.run.trial132.stdout: Installing : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 57/184 2026-02-13T03:31:08.061 INFO:teuthology.orchestra.run.trial132.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 58/184 2026-02-13T03:31:08.118 INFO:teuthology.orchestra.run.trial132.stdout: Installing : thrift-0.15.0-4.el9.x86_64 59/184 2026-02-13T03:31:08.148 INFO:teuthology.orchestra.run.trial132.stdout: Upgrading : openssl-1:3.5.5-1.el9.x86_64 60/184 2026-02-13T03:31:08.154 INFO:teuthology.orchestra.run.trial132.stdout: Upgrading : iproute-6.17.0-2.el9.x86_64 61/184 2026-02-13T03:31:08.157 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/184 2026-02-13T03:31:08.172 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 63/184 2026-02-13T03:31:08.176 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/184 2026-02-13T03:31:08.181 INFO:teuthology.orchestra.run.trial133.stdout: Upgrading : openssl-fips-provider-1:3.5.5-1.el9.x86_64 44/184 2026-02-13T03:31:08.181 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 65/184 2026-02-13T03:31:08.185 INFO:teuthology.orchestra.run.trial133.stdout: Upgrading : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T03:31:08.193 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/184 2026-02-13T03:31:08.197 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/184 2026-02-13T03:31:08.206 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/184 2026-02-13T03:31:08.211 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/184 2026-02-13T03:31:08.218 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/184 2026-02-13T03:31:08.258 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/184 2026-02-13T03:31:08.318 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T03:31:08.319 INFO:teuthology.orchestra.run.trial133.stdout: Upgrading : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T03:31:08.368 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T03:31:08.369 INFO:teuthology.orchestra.run.trial133.stdout: Installing : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T03:31:08.399 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T03:31:08.401 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 48/184 2026-02-13T03:31:08.409 INFO:teuthology.orchestra.run.trial133.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 49/184 2026-02-13T03:31:08.413 INFO:teuthology.orchestra.run.trial133.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 50/184 2026-02-13T03:31:08.474 INFO:teuthology.orchestra.run.trial133.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 51/184 2026-02-13T03:31:08.488 INFO:teuthology.orchestra.run.trial133.stdout: Installing : postgresql-13.23-1.el9.x86_64 52/184 2026-02-13T03:31:08.495 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 53/184 2026-02-13T03:31:08.496 INFO:teuthology.orchestra.run.trial133.stdout: Installing : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T03:31:08.518 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T03:31:08.519 INFO:teuthology.orchestra.run.trial133.stdout: Installing : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T03:31:08.546 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T03:31:08.553 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 56/184 2026-02-13T03:31:08.561 INFO:teuthology.orchestra.run.trial133.stdout: Installing : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 57/184 2026-02-13T03:31:08.574 INFO:teuthology.orchestra.run.trial133.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 58/184 2026-02-13T03:31:08.586 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/184 2026-02-13T03:31:08.596 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/184 2026-02-13T03:31:08.600 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/184 2026-02-13T03:31:08.605 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/184 2026-02-13T03:31:08.609 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/184 2026-02-13T03:31:08.614 INFO:teuthology.orchestra.run.trial132.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/184 2026-02-13T03:31:08.617 INFO:teuthology.orchestra.run.trial132.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 78/184 2026-02-13T03:31:08.618 INFO:teuthology.orchestra.run.trial132.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 79/184 2026-02-13T03:31:08.632 INFO:teuthology.orchestra.run.trial133.stdout: Installing : thrift-0.15.0-4.el9.x86_64 59/184 2026-02-13T03:31:08.647 INFO:teuthology.orchestra.run.trial132.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/184 2026-02-13T03:31:08.662 INFO:teuthology.orchestra.run.trial133.stdout: Upgrading : openssl-1:3.5.5-1.el9.x86_64 60/184 2026-02-13T03:31:08.669 INFO:teuthology.orchestra.run.trial133.stdout: Upgrading : iproute-6.17.0-2.el9.x86_64 61/184 2026-02-13T03:31:08.672 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/184 2026-02-13T03:31:08.687 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 63/184 2026-02-13T03:31:08.691 INFO:teuthology.orchestra.run.trial132.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 81/184 2026-02-13T03:31:08.691 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/184 2026-02-13T03:31:08.695 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/184 2026-02-13T03:31:08.697 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 65/184 2026-02-13T03:31:08.698 INFO:teuthology.orchestra.run.trial132.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 83/184 2026-02-13T03:31:08.705 INFO:teuthology.orchestra.run.trial132.stdout: Installing : uuid-1.6.2-55.el9.x86_64 84/184 2026-02-13T03:31:08.708 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/184 2026-02-13T03:31:08.713 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/184 2026-02-13T03:31:08.722 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/184 2026-02-13T03:31:08.727 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/184 2026-02-13T03:31:08.733 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 85/184 2026-02-13T03:31:08.735 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/184 2026-02-13T03:31:08.739 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/184 2026-02-13T03:31:08.742 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 87/184 2026-02-13T03:31:08.748 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 88/184 2026-02-13T03:31:08.752 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 89/184 2026-02-13T03:31:08.759 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 90/184 2026-02-13T03:31:08.763 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 91/184 2026-02-13T03:31:08.776 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/184 2026-02-13T03:31:08.790 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 92/184 2026-02-13T03:31:08.800 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 93/184 2026-02-13T03:31:08.806 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/184 2026-02-13T03:31:08.813 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 95/184 2026-02-13T03:31:08.848 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T03:31:08.859 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 97/184 2026-02-13T03:31:09.085 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 98/184 2026-02-13T03:31:09.108 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 99/184 2026-02-13T03:31:09.112 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 100/184 2026-02-13T03:31:09.117 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/184 2026-02-13T03:31:09.118 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T03:31:09.118 INFO:teuthology.orchestra.run.trial096.stdout:skipping the directory /sys 2026-02-13T03:31:09.118 INFO:teuthology.orchestra.run.trial096.stdout:skipping the directory /proc 2026-02-13T03:31:09.118 INFO:teuthology.orchestra.run.trial096.stdout:skipping the directory /mnt 2026-02-13T03:31:09.118 INFO:teuthology.orchestra.run.trial096.stdout:skipping the directory /var/tmp 2026-02-13T03:31:09.118 INFO:teuthology.orchestra.run.trial096.stdout:skipping the directory /home 2026-02-13T03:31:09.118 INFO:teuthology.orchestra.run.trial096.stdout:skipping the directory /root 2026-02-13T03:31:09.119 INFO:teuthology.orchestra.run.trial096.stdout:skipping the directory /tmp 2026-02-13T03:31:09.119 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:31:09.128 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/184 2026-02-13T03:31:09.132 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/184 2026-02-13T03:31:09.138 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/184 2026-02-13T03:31:09.141 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/184 2026-02-13T03:31:09.148 INFO:teuthology.orchestra.run.trial133.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/184 2026-02-13T03:31:09.150 INFO:teuthology.orchestra.run.trial133.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 78/184 2026-02-13T03:31:09.152 INFO:teuthology.orchestra.run.trial133.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 79/184 2026-02-13T03:31:09.172 INFO:teuthology.orchestra.run.trial132.stdout: Installing : openblas-0.3.29-1.el9.x86_64 101/184 2026-02-13T03:31:09.174 INFO:teuthology.orchestra.run.trial132.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 102/184 2026-02-13T03:31:09.181 INFO:teuthology.orchestra.run.trial133.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/184 2026-02-13T03:31:09.196 INFO:teuthology.orchestra.run.trial132.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 103/184 2026-02-13T03:31:09.219 INFO:teuthology.orchestra.run.trial096.stdout: Installing : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T03:31:09.225 INFO:teuthology.orchestra.run.trial133.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 81/184 2026-02-13T03:31:09.229 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/184 2026-02-13T03:31:09.233 INFO:teuthology.orchestra.run.trial133.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 83/184 2026-02-13T03:31:09.239 INFO:teuthology.orchestra.run.trial133.stdout: Installing : uuid-1.6.2-55.el9.x86_64 84/184 2026-02-13T03:31:09.242 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T03:31:09.242 INFO:teuthology.orchestra.run.trial096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:09.242 INFO:teuthology.orchestra.run.trial096.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T03:31:09.242 INFO:teuthology.orchestra.run.trial096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T03:31:09.242 INFO:teuthology.orchestra.run.trial096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T03:31:09.242 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:31:09.268 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 85/184 2026-02-13T03:31:09.274 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/184 2026-02-13T03:31:09.278 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 87/184 2026-02-13T03:31:09.284 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 88/184 2026-02-13T03:31:09.288 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 89/184 2026-02-13T03:31:09.296 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 90/184 2026-02-13T03:31:09.300 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 91/184 2026-02-13T03:31:09.329 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 92/184 2026-02-13T03:31:09.339 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 93/184 2026-02-13T03:31:09.345 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/184 2026-02-13T03:31:09.352 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 95/184 2026-02-13T03:31:09.388 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T03:31:09.399 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 97/184 2026-02-13T03:31:09.457 INFO:teuthology.orchestra.run.trial096.stdout: Installing : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T03:31:09.477 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T03:31:09.478 INFO:teuthology.orchestra.run.trial096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:09.478 INFO:teuthology.orchestra.run.trial096.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T03:31:09.478 INFO:teuthology.orchestra.run.trial096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T03:31:09.478 INFO:teuthology.orchestra.run.trial096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T03:31:09.478 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:31:09.483 INFO:teuthology.orchestra.run.trial096.stdout: Installing : mailcap-2.1.49-5.el9.noarch 132/184 2026-02-13T03:31:09.484 INFO:teuthology.orchestra.run.trial096.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 133/184 2026-02-13T03:31:09.502 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:31:09.503 INFO:teuthology.orchestra.run.trial096.stdout:Creating group 'qat' with GID 992. 2026-02-13T03:31:09.503 INFO:teuthology.orchestra.run.trial096.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T03:31:09.503 INFO:teuthology.orchestra.run.trial096.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T03:31:09.503 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:31:09.511 INFO:teuthology.orchestra.run.trial096.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:31:09.524 INFO:teuthology.orchestra.run.trial132.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 104/184 2026-02-13T03:31:09.535 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:31:09.535 INFO:teuthology.orchestra.run.trial096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T03:31:09.536 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:31:09.570 INFO:teuthology.orchestra.run.trial096.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 135/184 2026-02-13T03:31:09.598 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 105/184 2026-02-13T03:31:09.631 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 98/184 2026-02-13T03:31:09.656 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 99/184 2026-02-13T03:31:09.660 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 100/184 2026-02-13T03:31:09.718 INFO:teuthology.orchestra.run.trial133.stdout: Installing : openblas-0.3.29-1.el9.x86_64 101/184 2026-02-13T03:31:09.720 INFO:teuthology.orchestra.run.trial133.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 102/184 2026-02-13T03:31:09.741 INFO:teuthology.orchestra.run.trial133.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 103/184 2026-02-13T03:31:10.080 INFO:teuthology.orchestra.run.trial133.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 104/184 2026-02-13T03:31:10.156 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 105/184 2026-02-13T03:31:10.201 INFO:teuthology.orchestra.run.trial096.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 136/184 2026-02-13T03:31:10.277 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 106/184 2026-02-13T03:31:10.291 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 107/184 2026-02-13T03:31:10.295 INFO:teuthology.orchestra.run.trial132.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 108/184 2026-02-13T03:31:10.297 INFO:teuthology.orchestra.run.trial132.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 109/184 2026-02-13T03:31:10.303 INFO:teuthology.orchestra.run.trial132.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 110/184 2026-02-13T03:31:10.585 INFO:teuthology.orchestra.run.trial132.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 111/184 2026-02-13T03:31:10.587 INFO:teuthology.orchestra.run.trial132.stdout: Installing : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T03:31:10.605 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T03:31:10.607 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 113/184 2026-02-13T03:31:10.852 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 106/184 2026-02-13T03:31:10.867 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 107/184 2026-02-13T03:31:10.870 INFO:teuthology.orchestra.run.trial133.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 108/184 2026-02-13T03:31:10.873 INFO:teuthology.orchestra.run.trial133.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 109/184 2026-02-13T03:31:10.879 INFO:teuthology.orchestra.run.trial133.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 110/184 2026-02-13T03:31:10.971 INFO:teuthology.orchestra.run.trial096.stdout: Installing : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 137/184 2026-02-13T03:31:11.034 INFO:teuthology.orchestra.run.trial096.stdout: Installing : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 138/184 2026-02-13T03:31:11.036 INFO:teuthology.orchestra.run.trial096.stdout: Installing : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T03:31:11.050 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T03:31:11.050 INFO:teuthology.orchestra.run.trial096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:11.050 INFO:teuthology.orchestra.run.trial096.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T03:31:11.050 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:31:11.060 INFO:teuthology.orchestra.run.trial096.stdout: Installing : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T03:31:11.083 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T03:31:11.083 INFO:teuthology.orchestra.run.trial096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:11.083 INFO:teuthology.orchestra.run.trial096.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T03:31:11.083 INFO:teuthology.orchestra.run.trial096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T03:31:11.083 INFO:teuthology.orchestra.run.trial096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T03:31:11.083 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:31:11.141 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T03:31:11.143 INFO:teuthology.orchestra.run.trial096.stdout: Installing : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T03:31:11.152 INFO:teuthology.orchestra.run.trial096.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 142/184 2026-02-13T03:31:11.159 INFO:teuthology.orchestra.run.trial133.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 111/184 2026-02-13T03:31:11.161 INFO:teuthology.orchestra.run.trial133.stdout: Installing : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T03:31:11.176 INFO:teuthology.orchestra.run.trial096.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 143/184 2026-02-13T03:31:11.177 INFO:teuthology.orchestra.run.trial096.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T03:31:11.180 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T03:31:11.181 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 113/184 2026-02-13T03:31:11.702 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:31:11.704 INFO:teuthology.orchestra.run.trial132.stdout: Installing : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:31:11.725 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:31:11.739 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/184 2026-02-13T03:31:11.756 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/184 2026-02-13T03:31:11.833 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/184 2026-02-13T03:31:11.842 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 118/184 2026-02-13T03:31:11.865 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/184 2026-02-13T03:31:11.895 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 120/184 2026-02-13T03:31:11.946 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/184 2026-02-13T03:31:11.952 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/184 2026-02-13T03:31:11.956 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/184 2026-02-13T03:31:11.960 INFO:teuthology.orchestra.run.trial132.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 124/184 2026-02-13T03:31:11.963 INFO:teuthology.orchestra.run.trial132.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 125/184 2026-02-13T03:31:11.963 INFO:teuthology.orchestra.run.trial132.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T03:31:11.981 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T03:31:12.229 INFO:teuthology.orchestra.run.trial132.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 127/184 2026-02-13T03:31:12.232 INFO:teuthology.orchestra.run.trial132.stdout: Installing : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T03:31:12.270 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T03:31:12.270 INFO:teuthology.orchestra.run.trial132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T03:31:12.271 INFO:teuthology.orchestra.run.trial132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T03:31:12.271 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:31:12.274 INFO:teuthology.orchestra.run.trial132.stdout: Installing : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T03:31:12.276 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:31:12.279 INFO:teuthology.orchestra.run.trial133.stdout: Installing : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:31:12.298 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:31:12.313 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/184 2026-02-13T03:31:12.329 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/184 2026-02-13T03:31:12.407 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/184 2026-02-13T03:31:12.416 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 118/184 2026-02-13T03:31:12.441 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/184 2026-02-13T03:31:12.472 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 120/184 2026-02-13T03:31:12.524 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/184 2026-02-13T03:31:12.530 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/184 2026-02-13T03:31:12.534 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/184 2026-02-13T03:31:12.538 INFO:teuthology.orchestra.run.trial133.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 124/184 2026-02-13T03:31:12.541 INFO:teuthology.orchestra.run.trial133.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 125/184 2026-02-13T03:31:12.541 INFO:teuthology.orchestra.run.trial133.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T03:31:12.559 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T03:31:12.753 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T03:31:12.760 INFO:teuthology.orchestra.run.trial096.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T03:31:12.808 INFO:teuthology.orchestra.run.trial133.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 127/184 2026-02-13T03:31:12.811 INFO:teuthology.orchestra.run.trial133.stdout: Installing : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T03:31:12.854 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T03:31:12.855 INFO:teuthology.orchestra.run.trial133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T03:31:12.855 INFO:teuthology.orchestra.run.trial133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T03:31:12.855 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:31:12.858 INFO:teuthology.orchestra.run.trial133.stdout: Installing : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T03:31:13.222 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T03:31:13.223 INFO:teuthology.orchestra.run.trial096.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T03:31:13.284 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T03:31:13.327 INFO:teuthology.orchestra.run.trial096.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 147/184 2026-02-13T03:31:13.328 INFO:teuthology.orchestra.run.trial096.stdout: Installing : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T03:31:13.349 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T03:31:13.349 INFO:teuthology.orchestra.run.trial096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:13.349 INFO:teuthology.orchestra.run.trial096.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T03:31:13.349 INFO:teuthology.orchestra.run.trial096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T03:31:13.349 INFO:teuthology.orchestra.run.trial096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T03:31:13.349 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:31:13.360 INFO:teuthology.orchestra.run.trial096.stdout: Installing : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T03:31:13.369 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T03:31:13.947 INFO:teuthology.orchestra.run.trial096.stdout: Installing : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 150/184 2026-02-13T03:31:13.949 INFO:teuthology.orchestra.run.trial096.stdout: Installing : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T03:31:13.970 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T03:31:13.971 INFO:teuthology.orchestra.run.trial096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:13.971 INFO:teuthology.orchestra.run.trial096.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T03:31:13.971 INFO:teuthology.orchestra.run.trial096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T03:31:13.971 INFO:teuthology.orchestra.run.trial096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T03:31:13.971 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:31:13.980 INFO:teuthology.orchestra.run.trial096.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T03:31:14.001 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T03:31:14.001 INFO:teuthology.orchestra.run.trial096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:14.001 INFO:teuthology.orchestra.run.trial096.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T03:31:14.001 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:31:14.014 INFO:teuthology.orchestra.run.trial096.stdout: Installing : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T03:31:14.034 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T03:31:14.035 INFO:teuthology.orchestra.run.trial096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:14.035 INFO:teuthology.orchestra.run.trial096.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-13T03:31:14.035 INFO:teuthology.orchestra.run.trial096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T03:31:14.035 INFO:teuthology.orchestra.run.trial096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T03:31:14.035 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:31:14.160 INFO:teuthology.orchestra.run.trial096.stdout: Installing : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T03:31:14.182 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T03:31:14.182 INFO:teuthology.orchestra.run.trial096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:14.182 INFO:teuthology.orchestra.run.trial096.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T03:31:14.182 INFO:teuthology.orchestra.run.trial096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T03:31:14.183 INFO:teuthology.orchestra.run.trial096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T03:31:14.183 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:31:17.032 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T03:31:17.032 INFO:teuthology.orchestra.run.trial132.stdout:skipping the directory /sys 2026-02-13T03:31:17.033 INFO:teuthology.orchestra.run.trial132.stdout:skipping the directory /proc 2026-02-13T03:31:17.033 INFO:teuthology.orchestra.run.trial132.stdout:skipping the directory /mnt 2026-02-13T03:31:17.033 INFO:teuthology.orchestra.run.trial132.stdout:skipping the directory /var/tmp 2026-02-13T03:31:17.033 INFO:teuthology.orchestra.run.trial132.stdout:skipping the directory /home 2026-02-13T03:31:17.033 INFO:teuthology.orchestra.run.trial132.stdout:skipping the directory /root 2026-02-13T03:31:17.033 INFO:teuthology.orchestra.run.trial132.stdout:skipping the directory /tmp 2026-02-13T03:31:17.033 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:31:17.134 INFO:teuthology.orchestra.run.trial132.stdout: Installing : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T03:31:17.158 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T03:31:17.158 INFO:teuthology.orchestra.run.trial132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:17.158 INFO:teuthology.orchestra.run.trial132.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T03:31:17.158 INFO:teuthology.orchestra.run.trial132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T03:31:17.158 INFO:teuthology.orchestra.run.trial132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T03:31:17.158 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:31:17.372 INFO:teuthology.orchestra.run.trial132.stdout: Installing : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T03:31:17.394 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T03:31:17.394 INFO:teuthology.orchestra.run.trial132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:17.394 INFO:teuthology.orchestra.run.trial132.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T03:31:17.394 INFO:teuthology.orchestra.run.trial132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T03:31:17.395 INFO:teuthology.orchestra.run.trial132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T03:31:17.395 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:31:17.401 INFO:teuthology.orchestra.run.trial132.stdout: Installing : mailcap-2.1.49-5.el9.noarch 132/184 2026-02-13T03:31:17.403 INFO:teuthology.orchestra.run.trial132.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 133/184 2026-02-13T03:31:17.423 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:31:17.423 INFO:teuthology.orchestra.run.trial132.stdout:Creating group 'qat' with GID 992. 2026-02-13T03:31:17.423 INFO:teuthology.orchestra.run.trial132.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T03:31:17.423 INFO:teuthology.orchestra.run.trial132.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T03:31:17.423 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:31:17.431 INFO:teuthology.orchestra.run.trial132.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:31:17.456 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:31:17.456 INFO:teuthology.orchestra.run.trial132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T03:31:17.456 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:31:17.492 INFO:teuthology.orchestra.run.trial132.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 135/184 2026-02-13T03:31:17.504 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T03:31:17.504 INFO:teuthology.orchestra.run.trial133.stdout:skipping the directory /sys 2026-02-13T03:31:17.504 INFO:teuthology.orchestra.run.trial133.stdout:skipping the directory /proc 2026-02-13T03:31:17.504 INFO:teuthology.orchestra.run.trial133.stdout:skipping the directory /mnt 2026-02-13T03:31:17.504 INFO:teuthology.orchestra.run.trial133.stdout:skipping the directory /var/tmp 2026-02-13T03:31:17.504 INFO:teuthology.orchestra.run.trial133.stdout:skipping the directory /home 2026-02-13T03:31:17.504 INFO:teuthology.orchestra.run.trial133.stdout:skipping the directory /root 2026-02-13T03:31:17.504 INFO:teuthology.orchestra.run.trial133.stdout:skipping the directory /tmp 2026-02-13T03:31:17.504 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:31:17.607 INFO:teuthology.orchestra.run.trial133.stdout: Installing : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T03:31:17.631 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T03:31:17.631 INFO:teuthology.orchestra.run.trial133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:17.631 INFO:teuthology.orchestra.run.trial133.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T03:31:17.631 INFO:teuthology.orchestra.run.trial133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T03:31:17.631 INFO:teuthology.orchestra.run.trial133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T03:31:17.631 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:31:17.680 INFO:teuthology.orchestra.run.trial096.stdout: Installing : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 155/184 2026-02-13T03:31:17.694 INFO:teuthology.orchestra.run.trial096.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 156/184 2026-02-13T03:31:17.697 INFO:teuthology.orchestra.run.trial096.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 157/184 2026-02-13T03:31:17.772 INFO:teuthology.orchestra.run.trial096.stdout: Installing : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 158/184 2026-02-13T03:31:17.792 INFO:teuthology.orchestra.run.trial096.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 159/184 2026-02-13T03:31:17.796 INFO:teuthology.orchestra.run.trial096.stdout: Upgrading : iproute-tc-6.17.0-2.el9.x86_64 160/184 2026-02-13T03:31:17.797 INFO:teuthology.orchestra.run.trial096.stdout: Installing : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 161/184 2026-02-13T03:31:17.845 INFO:teuthology.orchestra.run.trial133.stdout: Installing : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T03:31:17.867 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T03:31:17.867 INFO:teuthology.orchestra.run.trial133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:17.867 INFO:teuthology.orchestra.run.trial133.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T03:31:17.867 INFO:teuthology.orchestra.run.trial133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T03:31:17.867 INFO:teuthology.orchestra.run.trial133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T03:31:17.867 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:31:17.873 INFO:teuthology.orchestra.run.trial133.stdout: Installing : mailcap-2.1.49-5.el9.noarch 132/184 2026-02-13T03:31:17.874 INFO:teuthology.orchestra.run.trial133.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 133/184 2026-02-13T03:31:17.893 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:31:17.893 INFO:teuthology.orchestra.run.trial133.stdout:Creating group 'qat' with GID 992. 2026-02-13T03:31:17.893 INFO:teuthology.orchestra.run.trial133.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T03:31:17.893 INFO:teuthology.orchestra.run.trial133.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T03:31:17.893 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:31:17.901 INFO:teuthology.orchestra.run.trial133.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:31:17.925 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:31:17.926 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:31:17.926 INFO:teuthology.orchestra.run.trial133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T03:31:17.926 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:31:17.929 INFO:teuthology.orchestra.run.trial096.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:31:17.945 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:31:17.950 INFO:teuthology.orchestra.run.trial096.stdout: Installing : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 163/184 2026-02-13T03:31:17.959 INFO:teuthology.orchestra.run.trial096.stdout: Installing : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 164/184 2026-02-13T03:31:17.963 INFO:teuthology.orchestra.run.trial133.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 135/184 2026-02-13T03:31:18.001 INFO:teuthology.orchestra.run.trial096.stdout: Installing : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T03:31:18.113 INFO:teuthology.orchestra.run.trial132.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 136/184 2026-02-13T03:31:18.444 INFO:teuthology.orchestra.run.trial096.stdout: Installing : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 166/184 2026-02-13T03:31:18.468 INFO:teuthology.orchestra.run.trial096.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 167/184 2026-02-13T03:31:18.469 INFO:teuthology.orchestra.run.trial096.stdout: Installing : libtool-2.4.6-46.el9.x86_64 168/184 2026-02-13T03:31:18.472 INFO:teuthology.orchestra.run.trial096.stdout: Upgrading : NetworkManager-team-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T03:31:18.474 INFO:teuthology.orchestra.run.trial096.stdout: Upgrading : NetworkManager-tui-1:1.54.3-2.el9.x86_64 170/184 2026-02-13T03:31:18.483 INFO:teuthology.orchestra.run.trial096.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 171/184 2026-02-13T03:31:18.510 INFO:teuthology.orchestra.run.trial096.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/184 2026-02-13T03:31:18.513 INFO:teuthology.orchestra.run.trial096.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/184 2026-02-13T03:31:18.515 INFO:teuthology.orchestra.run.trial096.stdout: Cleanup : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T03:31:18.518 INFO:teuthology.orchestra.run.trial096.stdout: Cleanup : openssl-1:3.5.1-6.el9.x86_64 175/184 2026-02-13T03:31:18.518 INFO:teuthology.orchestra.run.trial096.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T03:31:18.532 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T03:31:18.532 INFO:teuthology.orchestra.run.trial096.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T03:31:18.544 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T03:31:18.545 INFO:teuthology.orchestra.run.trial096.stdout: Cleanup : openssl-fips-provider-1:3.5.1-6.el9.x86_64 178/184 2026-02-13T03:31:18.547 INFO:teuthology.orchestra.run.trial096.stdout: Cleanup : iproute-tc-6.17.0-1.el9.x86_64 179/184 2026-02-13T03:31:18.549 INFO:teuthology.orchestra.run.trial096.stdout: Cleanup : NetworkManager-team-1:1.54.1-1.el9.x86_64 180/184 2026-02-13T03:31:18.554 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:31:18.554 INFO:teuthology.orchestra.run.trial096.stdout: Cleanup : NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:31:18.584 INFO:teuthology.orchestra.run.trial133.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 136/184 2026-02-13T03:31:18.646 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:31:18.648 INFO:teuthology.orchestra.run.trial096.stdout: Cleanup : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 182/184 2026-02-13T03:31:18.651 INFO:teuthology.orchestra.run.trial096.stdout: Cleanup : iproute-6.17.0-1.el9.x86_64 183/184 2026-02-13T03:31:18.653 INFO:teuthology.orchestra.run.trial096.stdout: Cleanup : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:31:18.658 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: iproute-6.17.0-2.el9.x86_64 184/184 2026-02-13T03:31:18.665 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T03:31:18.689 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T03:31:18.871 INFO:teuthology.orchestra.run.trial132.stdout: Installing : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 137/184 2026-02-13T03:31:18.934 INFO:teuthology.orchestra.run.trial132.stdout: Installing : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 138/184 2026-02-13T03:31:18.936 INFO:teuthology.orchestra.run.trial132.stdout: Installing : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T03:31:18.950 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T03:31:18.950 INFO:teuthology.orchestra.run.trial132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:18.950 INFO:teuthology.orchestra.run.trial132.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T03:31:18.950 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:31:18.960 INFO:teuthology.orchestra.run.trial132.stdout: Installing : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T03:31:18.983 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T03:31:18.983 INFO:teuthology.orchestra.run.trial132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:18.983 INFO:teuthology.orchestra.run.trial132.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T03:31:18.983 INFO:teuthology.orchestra.run.trial132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T03:31:18.983 INFO:teuthology.orchestra.run.trial132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T03:31:18.983 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:31:19.043 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T03:31:19.045 INFO:teuthology.orchestra.run.trial132.stdout: Installing : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T03:31:19.054 INFO:teuthology.orchestra.run.trial132.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 142/184 2026-02-13T03:31:19.078 INFO:teuthology.orchestra.run.trial132.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 143/184 2026-02-13T03:31:19.079 INFO:teuthology.orchestra.run.trial132.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T03:31:19.341 INFO:teuthology.orchestra.run.trial133.stdout: Installing : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 137/184 2026-02-13T03:31:19.405 INFO:teuthology.orchestra.run.trial133.stdout: Installing : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 138/184 2026-02-13T03:31:19.408 INFO:teuthology.orchestra.run.trial133.stdout: Installing : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T03:31:19.422 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T03:31:19.422 INFO:teuthology.orchestra.run.trial133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:19.422 INFO:teuthology.orchestra.run.trial133.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T03:31:19.422 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:31:19.434 INFO:teuthology.orchestra.run.trial133.stdout: Installing : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T03:31:19.458 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T03:31:19.459 INFO:teuthology.orchestra.run.trial133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:19.459 INFO:teuthology.orchestra.run.trial133.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T03:31:19.459 INFO:teuthology.orchestra.run.trial133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T03:31:19.459 INFO:teuthology.orchestra.run.trial133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T03:31:19.459 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:31:19.521 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T03:31:19.523 INFO:teuthology.orchestra.run.trial133.stdout: Installing : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T03:31:19.532 INFO:teuthology.orchestra.run.trial133.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 142/184 2026-02-13T03:31:19.556 INFO:teuthology.orchestra.run.trial133.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 143/184 2026-02-13T03:31:19.557 INFO:teuthology.orchestra.run.trial133.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T03:31:19.638 INFO:teuthology.orchestra.run.trial096.stdout: Running scriptlet: openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 1/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 3/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 4/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 5/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 6/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 7/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 8/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 9/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 10/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 11/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 12/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 13/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 14/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 15/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 16/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 17/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 18/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 19/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 20/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 21/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 22/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 23/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 24/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 25/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 26/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 27/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 28/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 29/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 30/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 31/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 32/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 33/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 34/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 35/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 36/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 37/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 38/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 39/184 2026-02-13T03:31:19.639 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 40/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 41/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 42/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 43/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 44/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 45/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 46/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 47/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 48/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 49/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 50/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 51/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 52/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 53/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 54/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-ply-3.11-14.el9.noarch 55/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 56/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 57/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 58/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : unzip-6.0-59.el9.x86_64 59/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : zip-3.0-35.el9.x86_64 60/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 63/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 64/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 70/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/184 2026-02-13T03:31:19.643 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 74/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 75/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 76/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 77/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 78/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 79/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : lua-5.4.4-4.el9.x86_64 80/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 81/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 82/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 83/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 84/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 85/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 86/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : postgresql-13.23-1.el9.x86_64 87/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 88/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 89/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 90/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 91/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 92/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 93/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 94/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 95/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 97/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 98/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 99/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 100/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 101/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 102/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 103/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 104/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 105/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 106/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 107/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 108/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 109/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 110/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 111/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 112/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 113/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 114/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 115/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 116/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 117/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 118/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 119/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 120/184 2026-02-13T03:31:19.644 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 121/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 122/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 123/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 124/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 126/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 127/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 128/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 129/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 130/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 131/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 132/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 133/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 134/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 135/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 136/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 137/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 138/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 139/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 140/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 141/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 142/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 143/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 144/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 145/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 146/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 147/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 148/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 156/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 158/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : re2-1:20211101-20.el9.x86_64 160/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 161/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 162/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 163/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/184 2026-02-13T03:31:19.645 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : NetworkManager-1:1.54.3-2.el9.x86_64 167/184 2026-02-13T03:31:19.646 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : NetworkManager-1:1.54.1-1.el9.x86_64 168/184 2026-02-13T03:31:19.646 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T03:31:19.646 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 170/184 2026-02-13T03:31:19.646 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : NetworkManager-team-1:1.54.3-2.el9.x86_64 171/184 2026-02-13T03:31:19.646 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : NetworkManager-team-1:1.54.1-1.el9.x86_64 172/184 2026-02-13T03:31:19.646 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : NetworkManager-tui-1:1.54.3-2.el9.x86_64 173/184 2026-02-13T03:31:19.646 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T03:31:19.646 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : iproute-6.17.0-2.el9.x86_64 175/184 2026-02-13T03:31:19.646 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : iproute-6.17.0-1.el9.x86_64 176/184 2026-02-13T03:31:19.646 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : iproute-tc-6.17.0-2.el9.x86_64 177/184 2026-02-13T03:31:19.646 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : iproute-tc-6.17.0-1.el9.x86_64 178/184 2026-02-13T03:31:19.646 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : openssl-1:3.5.5-1.el9.x86_64 179/184 2026-02-13T03:31:19.646 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : openssl-1:3.5.1-6.el9.x86_64 180/184 2026-02-13T03:31:19.646 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : openssl-fips-provider-1:3.5.5-1.el9.x86_64 181/184 2026-02-13T03:31:19.646 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : openssl-fips-provider-1:3.5.1-6.el9.x86_64 182/184 2026-02-13T03:31:19.646 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : openssl-libs-1:3.5.5-1.el9.x86_64 183/184 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout: Verifying : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout:Upgraded: 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout: NetworkManager-1:1.54.3-2.el9.x86_64 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout: NetworkManager-libnm-1:1.54.3-2.el9.x86_64 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout: NetworkManager-team-1:1.54.3-2.el9.x86_64 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout: NetworkManager-tui-1:1.54.3-2.el9.x86_64 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout: iproute-6.17.0-2.el9.x86_64 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout: iproute-tc-6.17.0-2.el9.x86_64 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout: openssl-1:3.5.5-1.el9.x86_64 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout: openssl-fips-provider-1:3.5.5-1.el9.x86_64 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout: openssl-libs-1:3.5.5-1.el9.x86_64 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout:Installed: 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout: automake-1.16.2-8.el9.noarch 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout: bison-3.7.4-5.el9.x86_64 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout: ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout: ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout: ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:19.722 INFO:teuthology.orchestra.run.trial096.stdout: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: flex-2.6.4-9.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T03:31:19.723 INFO:teuthology.orchestra.run.trial096.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: postgresql-13.23-1.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T03:31:19.724 INFO:teuthology.orchestra.run.trial096.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T03:31:19.725 INFO:teuthology.orchestra.run.trial096.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T03:31:19.726 INFO:teuthology.orchestra.run.trial096.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T03:31:19.726 INFO:teuthology.orchestra.run.trial096.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T03:31:19.726 INFO:teuthology.orchestra.run.trial096.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T03:31:19.726 INFO:teuthology.orchestra.run.trial096.stdout: rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.726 INFO:teuthology.orchestra.run.trial096.stdout: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.726 INFO:teuthology.orchestra.run.trial096.stdout: rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:19.726 INFO:teuthology.orchestra.run.trial096.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T03:31:19.726 INFO:teuthology.orchestra.run.trial096.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T03:31:19.726 INFO:teuthology.orchestra.run.trial096.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T03:31:19.726 INFO:teuthology.orchestra.run.trial096.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T03:31:19.726 INFO:teuthology.orchestra.run.trial096.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-13T03:31:19.726 INFO:teuthology.orchestra.run.trial096.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-13T03:31:19.726 INFO:teuthology.orchestra.run.trial096.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T03:31:19.726 INFO:teuthology.orchestra.run.trial096.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-13T03:31:19.726 INFO:teuthology.orchestra.run.trial096.stdout: zip-3.0-35.el9.x86_64 2026-02-13T03:31:19.726 INFO:teuthology.orchestra.run.trial096.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-13T03:31:19.726 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:31:19.726 INFO:teuthology.orchestra.run.trial096.stdout:Complete! 2026-02-13T03:31:19.817 DEBUG:teuthology.parallel:result is None 2026-02-13T03:31:20.642 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T03:31:20.649 INFO:teuthology.orchestra.run.trial132.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T03:31:21.102 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T03:31:21.103 INFO:teuthology.orchestra.run.trial132.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T03:31:21.134 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T03:31:21.142 INFO:teuthology.orchestra.run.trial133.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T03:31:21.164 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T03:31:21.206 INFO:teuthology.orchestra.run.trial132.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 147/184 2026-02-13T03:31:21.207 INFO:teuthology.orchestra.run.trial132.stdout: Installing : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T03:31:21.229 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T03:31:21.229 INFO:teuthology.orchestra.run.trial132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:21.229 INFO:teuthology.orchestra.run.trial132.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T03:31:21.229 INFO:teuthology.orchestra.run.trial132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T03:31:21.229 INFO:teuthology.orchestra.run.trial132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T03:31:21.229 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:31:21.240 INFO:teuthology.orchestra.run.trial132.stdout: Installing : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T03:31:21.251 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T03:31:21.599 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T03:31:21.600 INFO:teuthology.orchestra.run.trial133.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T03:31:21.663 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T03:31:21.705 INFO:teuthology.orchestra.run.trial133.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 147/184 2026-02-13T03:31:21.706 INFO:teuthology.orchestra.run.trial133.stdout: Installing : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T03:31:21.728 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T03:31:21.728 INFO:teuthology.orchestra.run.trial133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:21.728 INFO:teuthology.orchestra.run.trial133.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T03:31:21.728 INFO:teuthology.orchestra.run.trial133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T03:31:21.728 INFO:teuthology.orchestra.run.trial133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T03:31:21.728 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:31:21.740 INFO:teuthology.orchestra.run.trial133.stdout: Installing : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T03:31:21.749 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T03:31:21.821 INFO:teuthology.orchestra.run.trial132.stdout: Installing : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 150/184 2026-02-13T03:31:21.823 INFO:teuthology.orchestra.run.trial132.stdout: Installing : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T03:31:21.844 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T03:31:21.844 INFO:teuthology.orchestra.run.trial132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:21.844 INFO:teuthology.orchestra.run.trial132.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T03:31:21.844 INFO:teuthology.orchestra.run.trial132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T03:31:21.845 INFO:teuthology.orchestra.run.trial132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T03:31:21.845 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:31:21.854 INFO:teuthology.orchestra.run.trial132.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T03:31:21.874 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T03:31:21.874 INFO:teuthology.orchestra.run.trial132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:21.874 INFO:teuthology.orchestra.run.trial132.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T03:31:21.874 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:31:21.888 INFO:teuthology.orchestra.run.trial132.stdout: Installing : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T03:31:21.910 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T03:31:21.910 INFO:teuthology.orchestra.run.trial132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:21.910 INFO:teuthology.orchestra.run.trial132.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-13T03:31:21.910 INFO:teuthology.orchestra.run.trial132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T03:31:21.910 INFO:teuthology.orchestra.run.trial132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T03:31:21.910 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:31:22.034 INFO:teuthology.orchestra.run.trial132.stdout: Installing : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T03:31:22.056 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T03:31:22.056 INFO:teuthology.orchestra.run.trial132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:22.056 INFO:teuthology.orchestra.run.trial132.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T03:31:22.056 INFO:teuthology.orchestra.run.trial132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T03:31:22.056 INFO:teuthology.orchestra.run.trial132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T03:31:22.056 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:31:22.321 INFO:teuthology.orchestra.run.trial133.stdout: Installing : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 150/184 2026-02-13T03:31:22.322 INFO:teuthology.orchestra.run.trial133.stdout: Installing : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T03:31:22.345 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T03:31:22.345 INFO:teuthology.orchestra.run.trial133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:22.345 INFO:teuthology.orchestra.run.trial133.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T03:31:22.345 INFO:teuthology.orchestra.run.trial133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T03:31:22.345 INFO:teuthology.orchestra.run.trial133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T03:31:22.345 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:31:22.354 INFO:teuthology.orchestra.run.trial133.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T03:31:22.375 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T03:31:22.375 INFO:teuthology.orchestra.run.trial133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:22.375 INFO:teuthology.orchestra.run.trial133.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T03:31:22.375 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:31:22.388 INFO:teuthology.orchestra.run.trial133.stdout: Installing : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T03:31:22.409 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T03:31:22.410 INFO:teuthology.orchestra.run.trial133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:22.410 INFO:teuthology.orchestra.run.trial133.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-13T03:31:22.410 INFO:teuthology.orchestra.run.trial133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T03:31:22.410 INFO:teuthology.orchestra.run.trial133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T03:31:22.410 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:31:22.534 INFO:teuthology.orchestra.run.trial133.stdout: Installing : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T03:31:22.555 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T03:31:22.555 INFO:teuthology.orchestra.run.trial133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:31:22.556 INFO:teuthology.orchestra.run.trial133.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T03:31:22.556 INFO:teuthology.orchestra.run.trial133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T03:31:22.556 INFO:teuthology.orchestra.run.trial133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T03:31:22.556 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:31:25.488 INFO:teuthology.orchestra.run.trial132.stdout: Installing : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 155/184 2026-02-13T03:31:25.501 INFO:teuthology.orchestra.run.trial132.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 156/184 2026-02-13T03:31:25.505 INFO:teuthology.orchestra.run.trial132.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 157/184 2026-02-13T03:31:25.578 INFO:teuthology.orchestra.run.trial132.stdout: Installing : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 158/184 2026-02-13T03:31:25.598 INFO:teuthology.orchestra.run.trial132.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 159/184 2026-02-13T03:31:25.602 INFO:teuthology.orchestra.run.trial132.stdout: Upgrading : iproute-tc-6.17.0-2.el9.x86_64 160/184 2026-02-13T03:31:25.603 INFO:teuthology.orchestra.run.trial132.stdout: Installing : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 161/184 2026-02-13T03:31:25.724 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:31:25.728 INFO:teuthology.orchestra.run.trial132.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:31:25.745 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:31:25.750 INFO:teuthology.orchestra.run.trial132.stdout: Installing : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 163/184 2026-02-13T03:31:25.760 INFO:teuthology.orchestra.run.trial132.stdout: Installing : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 164/184 2026-02-13T03:31:25.802 INFO:teuthology.orchestra.run.trial132.stdout: Installing : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T03:31:25.999 INFO:teuthology.orchestra.run.trial133.stdout: Installing : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 155/184 2026-02-13T03:31:26.013 INFO:teuthology.orchestra.run.trial133.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 156/184 2026-02-13T03:31:26.016 INFO:teuthology.orchestra.run.trial133.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 157/184 2026-02-13T03:31:26.091 INFO:teuthology.orchestra.run.trial133.stdout: Installing : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 158/184 2026-02-13T03:31:26.109 INFO:teuthology.orchestra.run.trial133.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 159/184 2026-02-13T03:31:26.114 INFO:teuthology.orchestra.run.trial133.stdout: Upgrading : iproute-tc-6.17.0-2.el9.x86_64 160/184 2026-02-13T03:31:26.115 INFO:teuthology.orchestra.run.trial133.stdout: Installing : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 161/184 2026-02-13T03:31:26.237 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:31:26.241 INFO:teuthology.orchestra.run.trial133.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:31:26.254 INFO:teuthology.orchestra.run.trial132.stdout: Installing : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 166/184 2026-02-13T03:31:26.257 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:31:26.262 INFO:teuthology.orchestra.run.trial133.stdout: Installing : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 163/184 2026-02-13T03:31:26.271 INFO:teuthology.orchestra.run.trial133.stdout: Installing : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 164/184 2026-02-13T03:31:26.278 INFO:teuthology.orchestra.run.trial132.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 167/184 2026-02-13T03:31:26.280 INFO:teuthology.orchestra.run.trial132.stdout: Installing : libtool-2.4.6-46.el9.x86_64 168/184 2026-02-13T03:31:26.283 INFO:teuthology.orchestra.run.trial132.stdout: Upgrading : NetworkManager-team-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T03:31:26.285 INFO:teuthology.orchestra.run.trial132.stdout: Upgrading : NetworkManager-tui-1:1.54.3-2.el9.x86_64 170/184 2026-02-13T03:31:26.294 INFO:teuthology.orchestra.run.trial132.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 171/184 2026-02-13T03:31:26.313 INFO:teuthology.orchestra.run.trial133.stdout: Installing : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T03:31:26.321 INFO:teuthology.orchestra.run.trial132.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/184 2026-02-13T03:31:26.324 INFO:teuthology.orchestra.run.trial132.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/184 2026-02-13T03:31:26.326 INFO:teuthology.orchestra.run.trial132.stdout: Cleanup : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T03:31:26.329 INFO:teuthology.orchestra.run.trial132.stdout: Cleanup : openssl-1:3.5.1-6.el9.x86_64 175/184 2026-02-13T03:31:26.329 INFO:teuthology.orchestra.run.trial132.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T03:31:26.344 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T03:31:26.344 INFO:teuthology.orchestra.run.trial132.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T03:31:26.357 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T03:31:26.359 INFO:teuthology.orchestra.run.trial132.stdout: Cleanup : openssl-fips-provider-1:3.5.1-6.el9.x86_64 178/184 2026-02-13T03:31:26.361 INFO:teuthology.orchestra.run.trial132.stdout: Cleanup : iproute-tc-6.17.0-1.el9.x86_64 179/184 2026-02-13T03:31:26.362 INFO:teuthology.orchestra.run.trial132.stdout: Cleanup : NetworkManager-team-1:1.54.1-1.el9.x86_64 180/184 2026-02-13T03:31:26.368 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:31:26.369 INFO:teuthology.orchestra.run.trial132.stdout: Cleanup : NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:31:26.466 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:31:26.468 INFO:teuthology.orchestra.run.trial132.stdout: Cleanup : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 182/184 2026-02-13T03:31:26.471 INFO:teuthology.orchestra.run.trial132.stdout: Cleanup : iproute-6.17.0-1.el9.x86_64 183/184 2026-02-13T03:31:26.473 INFO:teuthology.orchestra.run.trial132.stdout: Cleanup : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:31:26.479 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: iproute-6.17.0-2.el9.x86_64 184/184 2026-02-13T03:31:26.486 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T03:31:26.511 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T03:31:26.762 INFO:teuthology.orchestra.run.trial133.stdout: Installing : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 166/184 2026-02-13T03:31:26.785 INFO:teuthology.orchestra.run.trial133.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 167/184 2026-02-13T03:31:26.787 INFO:teuthology.orchestra.run.trial133.stdout: Installing : libtool-2.4.6-46.el9.x86_64 168/184 2026-02-13T03:31:26.790 INFO:teuthology.orchestra.run.trial133.stdout: Upgrading : NetworkManager-team-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T03:31:26.792 INFO:teuthology.orchestra.run.trial133.stdout: Upgrading : NetworkManager-tui-1:1.54.3-2.el9.x86_64 170/184 2026-02-13T03:31:26.801 INFO:teuthology.orchestra.run.trial133.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 171/184 2026-02-13T03:31:26.828 INFO:teuthology.orchestra.run.trial133.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/184 2026-02-13T03:31:26.830 INFO:teuthology.orchestra.run.trial133.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/184 2026-02-13T03:31:26.832 INFO:teuthology.orchestra.run.trial133.stdout: Cleanup : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T03:31:26.836 INFO:teuthology.orchestra.run.trial133.stdout: Cleanup : openssl-1:3.5.1-6.el9.x86_64 175/184 2026-02-13T03:31:26.836 INFO:teuthology.orchestra.run.trial133.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T03:31:26.850 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T03:31:26.850 INFO:teuthology.orchestra.run.trial133.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T03:31:26.864 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T03:31:26.865 INFO:teuthology.orchestra.run.trial133.stdout: Cleanup : openssl-fips-provider-1:3.5.1-6.el9.x86_64 178/184 2026-02-13T03:31:26.867 INFO:teuthology.orchestra.run.trial133.stdout: Cleanup : iproute-tc-6.17.0-1.el9.x86_64 179/184 2026-02-13T03:31:26.868 INFO:teuthology.orchestra.run.trial133.stdout: Cleanup : NetworkManager-team-1:1.54.1-1.el9.x86_64 180/184 2026-02-13T03:31:26.875 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:31:26.875 INFO:teuthology.orchestra.run.trial133.stdout: Cleanup : NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:31:26.967 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:31:26.969 INFO:teuthology.orchestra.run.trial133.stdout: Cleanup : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 182/184 2026-02-13T03:31:26.972 INFO:teuthology.orchestra.run.trial133.stdout: Cleanup : iproute-6.17.0-1.el9.x86_64 183/184 2026-02-13T03:31:26.974 INFO:teuthology.orchestra.run.trial133.stdout: Cleanup : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:31:26.980 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: iproute-6.17.0-2.el9.x86_64 184/184 2026-02-13T03:31:26.987 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T03:31:27.013 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T03:31:27.436 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:31:27.436 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 1/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 3/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 4/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 5/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 6/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 7/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 8/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 9/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 10/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 11/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 12/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 13/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 14/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 15/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 16/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 17/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 18/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 19/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 20/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 21/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 22/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 23/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 24/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 25/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 26/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 27/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 28/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 29/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 30/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 31/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 32/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 33/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 34/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 35/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 36/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 37/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 38/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 39/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 40/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 41/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 42/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 43/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 44/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 45/184 2026-02-13T03:31:27.437 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 46/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 47/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 48/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 49/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 50/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 51/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 52/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 53/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 54/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-ply-3.11-14.el9.noarch 55/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 56/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 57/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 58/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : unzip-6.0-59.el9.x86_64 59/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : zip-3.0-35.el9.x86_64 60/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 63/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 64/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 70/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 74/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 75/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 76/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 77/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 78/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 79/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : lua-5.4.4-4.el9.x86_64 80/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 81/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 82/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 83/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 84/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 85/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 86/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : postgresql-13.23-1.el9.x86_64 87/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 88/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 89/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 90/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 91/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 92/184 2026-02-13T03:31:27.438 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 93/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 94/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 95/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 97/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 98/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 99/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 100/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 101/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 102/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 103/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 104/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 105/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 106/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 107/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 108/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 109/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 110/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 111/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 112/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 113/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 114/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 115/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 116/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 117/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 118/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 119/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 120/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 121/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 122/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 123/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 124/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 126/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 127/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 128/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 129/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 130/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 131/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 132/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 133/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 134/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 135/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 136/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 137/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 138/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 139/184 2026-02-13T03:31:27.439 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 140/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 141/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 142/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 143/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 144/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 145/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 146/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 147/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 148/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 156/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 158/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : re2-1:20211101-20.el9.x86_64 160/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 161/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 162/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 163/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : NetworkManager-1:1.54.3-2.el9.x86_64 167/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : NetworkManager-1:1.54.1-1.el9.x86_64 168/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 170/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : NetworkManager-team-1:1.54.3-2.el9.x86_64 171/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : NetworkManager-team-1:1.54.1-1.el9.x86_64 172/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : NetworkManager-tui-1:1.54.3-2.el9.x86_64 173/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : iproute-6.17.0-2.el9.x86_64 175/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : iproute-6.17.0-1.el9.x86_64 176/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : iproute-tc-6.17.0-2.el9.x86_64 177/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : iproute-tc-6.17.0-1.el9.x86_64 178/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : openssl-1:3.5.5-1.el9.x86_64 179/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : openssl-1:3.5.1-6.el9.x86_64 180/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : openssl-fips-provider-1:3.5.5-1.el9.x86_64 181/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : openssl-fips-provider-1:3.5.1-6.el9.x86_64 182/184 2026-02-13T03:31:27.440 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : openssl-libs-1:3.5.5-1.el9.x86_64 183/184 2026-02-13T03:31:27.518 INFO:teuthology.orchestra.run.trial132.stdout: Verifying : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:31:27.518 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:31:27.518 INFO:teuthology.orchestra.run.trial132.stdout:Upgraded: 2026-02-13T03:31:27.518 INFO:teuthology.orchestra.run.trial132.stdout: NetworkManager-1:1.54.3-2.el9.x86_64 2026-02-13T03:31:27.518 INFO:teuthology.orchestra.run.trial132.stdout: NetworkManager-libnm-1:1.54.3-2.el9.x86_64 2026-02-13T03:31:27.518 INFO:teuthology.orchestra.run.trial132.stdout: NetworkManager-team-1:1.54.3-2.el9.x86_64 2026-02-13T03:31:27.518 INFO:teuthology.orchestra.run.trial132.stdout: NetworkManager-tui-1:1.54.3-2.el9.x86_64 2026-02-13T03:31:27.518 INFO:teuthology.orchestra.run.trial132.stdout: iproute-6.17.0-2.el9.x86_64 2026-02-13T03:31:27.518 INFO:teuthology.orchestra.run.trial132.stdout: iproute-tc-6.17.0-2.el9.x86_64 2026-02-13T03:31:27.518 INFO:teuthology.orchestra.run.trial132.stdout: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.518 INFO:teuthology.orchestra.run.trial132.stdout: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.518 INFO:teuthology.orchestra.run.trial132.stdout: openssl-1:3.5.5-1.el9.x86_64 2026-02-13T03:31:27.518 INFO:teuthology.orchestra.run.trial132.stdout: openssl-fips-provider-1:3.5.5-1.el9.x86_64 2026-02-13T03:31:27.518 INFO:teuthology.orchestra.run.trial132.stdout: openssl-libs-1:3.5.5-1.el9.x86_64 2026-02-13T03:31:27.518 INFO:teuthology.orchestra.run.trial132.stdout:Installed: 2026-02-13T03:31:27.518 INFO:teuthology.orchestra.run.trial132.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T03:31:27.518 INFO:teuthology.orchestra.run.trial132.stdout: automake-1.16.2-8.el9.noarch 2026-02-13T03:31:27.518 INFO:teuthology.orchestra.run.trial132.stdout: bison-3.7.4-5.el9.x86_64 2026-02-13T03:31:27.518 INFO:teuthology.orchestra.run.trial132.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T03:31:27.518 INFO:teuthology.orchestra.run.trial132.stdout: ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.518 INFO:teuthology.orchestra.run.trial132.stdout: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.518 INFO:teuthology.orchestra.run.trial132.stdout: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.518 INFO:teuthology.orchestra.run.trial132.stdout: ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.518 INFO:teuthology.orchestra.run.trial132.stdout: ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: flex-2.6.4-9.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T03:31:27.519 INFO:teuthology.orchestra.run.trial132.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: postgresql-13.23-1.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-13T03:31:27.520 INFO:teuthology.orchestra.run.trial132.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T03:31:27.521 INFO:teuthology.orchestra.run.trial132.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T03:31:27.522 INFO:teuthology.orchestra.run.trial132.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T03:31:27.522 INFO:teuthology.orchestra.run.trial132.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T03:31:27.522 INFO:teuthology.orchestra.run.trial132.stdout: rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.522 INFO:teuthology.orchestra.run.trial132.stdout: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.522 INFO:teuthology.orchestra.run.trial132.stdout: rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:27.522 INFO:teuthology.orchestra.run.trial132.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T03:31:27.522 INFO:teuthology.orchestra.run.trial132.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T03:31:27.522 INFO:teuthology.orchestra.run.trial132.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T03:31:27.522 INFO:teuthology.orchestra.run.trial132.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T03:31:27.522 INFO:teuthology.orchestra.run.trial132.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-13T03:31:27.522 INFO:teuthology.orchestra.run.trial132.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-13T03:31:27.522 INFO:teuthology.orchestra.run.trial132.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T03:31:27.522 INFO:teuthology.orchestra.run.trial132.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-13T03:31:27.522 INFO:teuthology.orchestra.run.trial132.stdout: zip-3.0-35.el9.x86_64 2026-02-13T03:31:27.522 INFO:teuthology.orchestra.run.trial132.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-13T03:31:27.522 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:31:27.522 INFO:teuthology.orchestra.run.trial132.stdout:Complete! 2026-02-13T03:31:27.620 DEBUG:teuthology.parallel:result is None 2026-02-13T03:31:27.961 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:31:27.961 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 1/184 2026-02-13T03:31:27.961 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2/184 2026-02-13T03:31:27.961 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 3/184 2026-02-13T03:31:27.961 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 4/184 2026-02-13T03:31:27.961 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 5/184 2026-02-13T03:31:27.961 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 6/184 2026-02-13T03:31:27.961 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 7/184 2026-02-13T03:31:27.961 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 8/184 2026-02-13T03:31:27.961 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 9/184 2026-02-13T03:31:27.961 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 10/184 2026-02-13T03:31:27.961 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 11/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 12/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 13/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 14/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 15/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 16/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 17/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 18/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 19/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 20/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 21/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 22/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 23/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 24/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 25/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 26/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 27/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 28/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 29/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 30/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 31/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 32/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 33/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 34/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 35/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 36/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 37/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 38/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 39/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 40/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 41/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 42/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 43/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 44/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 45/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 46/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 47/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 48/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 49/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 50/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 51/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 52/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 53/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 54/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-ply-3.11-14.el9.noarch 55/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 56/184 2026-02-13T03:31:27.962 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 57/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 58/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : unzip-6.0-59.el9.x86_64 59/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : zip-3.0-35.el9.x86_64 60/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 63/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 64/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 70/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 74/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 75/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 76/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 77/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 78/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 79/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : lua-5.4.4-4.el9.x86_64 80/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 81/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 82/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 83/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 84/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 85/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 86/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : postgresql-13.23-1.el9.x86_64 87/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 88/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 89/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 90/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 91/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 92/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 93/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 94/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 95/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 97/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 98/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 99/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 100/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 101/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 102/184 2026-02-13T03:31:27.963 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 103/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 104/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 105/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 106/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 107/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 108/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 109/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 110/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 111/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 112/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 113/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 114/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 115/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 116/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 117/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 118/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 119/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 120/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 121/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 122/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 123/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 124/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 126/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 127/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 128/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 129/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 130/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 131/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 132/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 133/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 134/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 135/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 136/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 137/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 138/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 139/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 140/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 141/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 142/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 143/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 144/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 145/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 146/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 147/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 148/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/184 2026-02-13T03:31:27.964 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 156/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 158/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : re2-1:20211101-20.el9.x86_64 160/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 161/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 162/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 163/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : NetworkManager-1:1.54.3-2.el9.x86_64 167/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : NetworkManager-1:1.54.1-1.el9.x86_64 168/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 170/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : NetworkManager-team-1:1.54.3-2.el9.x86_64 171/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : NetworkManager-team-1:1.54.1-1.el9.x86_64 172/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : NetworkManager-tui-1:1.54.3-2.el9.x86_64 173/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : iproute-6.17.0-2.el9.x86_64 175/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : iproute-6.17.0-1.el9.x86_64 176/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : iproute-tc-6.17.0-2.el9.x86_64 177/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : iproute-tc-6.17.0-1.el9.x86_64 178/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : openssl-1:3.5.5-1.el9.x86_64 179/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : openssl-1:3.5.1-6.el9.x86_64 180/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : openssl-fips-provider-1:3.5.5-1.el9.x86_64 181/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : openssl-fips-provider-1:3.5.1-6.el9.x86_64 182/184 2026-02-13T03:31:27.965 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : openssl-libs-1:3.5.5-1.el9.x86_64 183/184 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: Verifying : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout:Upgraded: 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: NetworkManager-1:1.54.3-2.el9.x86_64 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: NetworkManager-libnm-1:1.54.3-2.el9.x86_64 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: NetworkManager-team-1:1.54.3-2.el9.x86_64 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: NetworkManager-tui-1:1.54.3-2.el9.x86_64 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: iproute-6.17.0-2.el9.x86_64 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: iproute-tc-6.17.0-2.el9.x86_64 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: openssl-1:3.5.5-1.el9.x86_64 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: openssl-fips-provider-1:3.5.5-1.el9.x86_64 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: openssl-libs-1:3.5.5-1.el9.x86_64 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout:Installed: 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: automake-1.16.2-8.el9.noarch 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: bison-3.7.4-5.el9.x86_64 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:28.041 INFO:teuthology.orchestra.run.trial133.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: flex-2.6.4-9.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T03:31:28.042 INFO:teuthology.orchestra.run.trial133.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: postgresql-13.23-1.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T03:31:28.043 INFO:teuthology.orchestra.run.trial133.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:31:28.044 INFO:teuthology.orchestra.run.trial133.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T03:31:28.045 INFO:teuthology.orchestra.run.trial133.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T03:31:28.045 INFO:teuthology.orchestra.run.trial133.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T03:31:28.045 INFO:teuthology.orchestra.run.trial133.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T03:31:28.045 INFO:teuthology.orchestra.run.trial133.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-13T03:31:28.045 INFO:teuthology.orchestra.run.trial133.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-13T03:31:28.045 INFO:teuthology.orchestra.run.trial133.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T03:31:28.045 INFO:teuthology.orchestra.run.trial133.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-13T03:31:28.045 INFO:teuthology.orchestra.run.trial133.stdout: zip-3.0-35.el9.x86_64 2026-02-13T03:31:28.045 INFO:teuthology.orchestra.run.trial133.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-13T03:31:28.045 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:31:28.045 INFO:teuthology.orchestra.run.trial133.stdout:Complete! 2026-02-13T03:31:28.137 DEBUG:teuthology.parallel:result is None 2026-02-13T03:31:28.137 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:31:28.253 DEBUG:teuthology.orchestra.run.trial096:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T03:31:28.275 INFO:teuthology.orchestra.run.trial096.stdout:20.3.0-5241.g8f8d3829.el9 2026-02-13T03:31:28.275 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241.g8f8d3829.el9 2026-02-13T03:31:28.275 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241.g8f8d3829 is installed. 2026-02-13T03:31:28.276 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:31:28.406 DEBUG:teuthology.orchestra.run.trial132:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T03:31:28.427 INFO:teuthology.orchestra.run.trial132.stdout:20.3.0-5241.g8f8d3829.el9 2026-02-13T03:31:28.427 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241.g8f8d3829.el9 2026-02-13T03:31:28.427 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241.g8f8d3829 is installed. 2026-02-13T03:31:28.428 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:31:28.541 DEBUG:teuthology.orchestra.run.trial133:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T03:31:28.560 INFO:teuthology.orchestra.run.trial133.stdout:20.3.0-5241.g8f8d3829.el9 2026-02-13T03:31:28.561 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241.g8f8d3829.el9 2026-02-13T03:31:28.561 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241.g8f8d3829 is installed. 2026-02-13T03:31:28.562 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-13T03:31:28.562 DEBUG:teuthology.orchestra.run.trial096:> set -ex 2026-02-13T03:31:28.562 DEBUG:teuthology.orchestra.run.trial096:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T03:31:28.589 DEBUG:teuthology.orchestra.run.trial132:> set -ex 2026-02-13T03:31:28.589 DEBUG:teuthology.orchestra.run.trial132:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T03:31:28.614 DEBUG:teuthology.orchestra.run.trial133:> set -ex 2026-02-13T03:31:28.615 DEBUG:teuthology.orchestra.run.trial133:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T03:31:28.641 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-13T03:31:28.641 DEBUG:teuthology.orchestra.run.trial096:> set -ex 2026-02-13T03:31:28.641 DEBUG:teuthology.orchestra.run.trial096:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T03:31:28.664 DEBUG:teuthology.orchestra.run.trial096:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T03:31:28.727 DEBUG:teuthology.orchestra.run.trial132:> set -ex 2026-02-13T03:31:28.728 DEBUG:teuthology.orchestra.run.trial132:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T03:31:28.751 DEBUG:teuthology.orchestra.run.trial132:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T03:31:28.816 DEBUG:teuthology.orchestra.run.trial133:> set -ex 2026-02-13T03:31:28.816 DEBUG:teuthology.orchestra.run.trial133:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T03:31:28.841 DEBUG:teuthology.orchestra.run.trial133:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T03:31:28.904 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-13T03:31:28.904 DEBUG:teuthology.orchestra.run.trial096:> set -ex 2026-02-13T03:31:28.904 DEBUG:teuthology.orchestra.run.trial096:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T03:31:28.928 DEBUG:teuthology.orchestra.run.trial096:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T03:31:28.992 DEBUG:teuthology.orchestra.run.trial132:> set -ex 2026-02-13T03:31:28.992 DEBUG:teuthology.orchestra.run.trial132:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T03:31:29.016 DEBUG:teuthology.orchestra.run.trial132:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T03:31:29.080 DEBUG:teuthology.orchestra.run.trial133:> set -ex 2026-02-13T03:31:29.080 DEBUG:teuthology.orchestra.run.trial133:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T03:31:29.105 DEBUG:teuthology.orchestra.run.trial133:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T03:31:29.169 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-13T03:31:29.169 DEBUG:teuthology.orchestra.run.trial096:> set -ex 2026-02-13T03:31:29.169 DEBUG:teuthology.orchestra.run.trial096:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T03:31:29.195 DEBUG:teuthology.orchestra.run.trial096:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T03:31:29.258 DEBUG:teuthology.orchestra.run.trial132:> set -ex 2026-02-13T03:31:29.258 DEBUG:teuthology.orchestra.run.trial132:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T03:31:29.282 DEBUG:teuthology.orchestra.run.trial132:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T03:31:29.347 DEBUG:teuthology.orchestra.run.trial133:> set -ex 2026-02-13T03:31:29.347 DEBUG:teuthology.orchestra.run.trial133:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T03:31:29.370 DEBUG:teuthology.orchestra.run.trial133:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T03:31:29.435 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-13T03:31:29.520 INFO:tasks.cephadm:Config: {'distro-suffix': 'rockylinux-10', 'roleless': False, 'skip_dashboard': True, 'cephfs': {'ec_profile': ['disabled'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds use global snaprealm seq for subvol': False, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client dirsize rbytes': False, 'client_fscrypt_dummy_encryption': True}, 'mds': {'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.2}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'BLUESTORE_SLOW_OP_ALERT', 'slow operation indications in BlueStore', 'experiencing slow operations in BlueStore', 'MGR_MODULE_ERROR', 'OSD_DOWN', 'osd.* is down', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'osds down', 'osd.* is down', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'subvols': {'create': 2}} 2026-02-13T03:31:29.520 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 2026-02-13T03:31:29.523 INFO:tasks.cephadm:Cluster fsid is 7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:31:29.524 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-13T03:31:29.524 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.96', 'mon.b': '10.20.193.132', 'mon.c': '10.20.193.133'} 2026-02-13T03:31:29.524 INFO:tasks.cephadm:First mon is mon.a on trial096 2026-02-13T03:31:29.524 INFO:tasks.cephadm:First mgr is x 2026-02-13T03:31:29.524 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-13T03:31:29.524 DEBUG:teuthology.orchestra.run.trial096:> sudo hostname $(hostname -s) 2026-02-13T03:31:29.549 DEBUG:teuthology.orchestra.run.trial132:> sudo hostname $(hostname -s) 2026-02-13T03:31:29.573 DEBUG:teuthology.orchestra.run.trial133:> sudo hostname $(hostname -s) 2026-02-13T03:31:29.596 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-13T03:31:29.596 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:31:29.711 INFO:tasks.cephadm:builder_project result: [{'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/', 'ref': 'wip-pdonnell-testing-20260210.171210', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-10 22:03:44.386901', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['source', 'x86_64'], 'extra': {'version': '20.3.0-5241-g8f8d3829', 'package_manager_version': '20.3.0-5241.g8f8d3829', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/2911/', 'root_build_cause': '', 'node_name': '10.20.192.26+soko16', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-13T03:31:29.824 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-pdonnell-testing-20260210.171210, sha1 8f8d38294e4db8750b4b1649f62ce37caa63080f from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:31:29.825 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm 2026-02-13T03:31:29.825 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm 2026-02-13T03:31:29.825 DEBUG:teuthology.orchestra.run.trial096:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T03:31:30.142 INFO:teuthology.orchestra.run.trial096.stdout:-rw-r--r--. 1 ubuntu ubuntu 1073479 Feb 13 03:31 /home/ubuntu/cephtest/cephadm 2026-02-13T03:31:30.142 DEBUG:teuthology.orchestra.run.trial132:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T03:31:30.444 INFO:teuthology.orchestra.run.trial132.stdout:-rw-r--r--. 1 ubuntu ubuntu 1073479 Feb 13 03:31 /home/ubuntu/cephtest/cephadm 2026-02-13T03:31:30.444 DEBUG:teuthology.orchestra.run.trial133:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T03:31:30.741 INFO:teuthology.orchestra.run.trial133.stdout:-rw-r--r--. 1 ubuntu ubuntu 1073479 Feb 13 03:31 /home/ubuntu/cephtest/cephadm 2026-02-13T03:31:30.742 DEBUG:teuthology.orchestra.run.trial096:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T03:31:30.759 DEBUG:teuthology.orchestra.run.trial132:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T03:31:30.777 DEBUG:teuthology.orchestra.run.trial133:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T03:31:30.803 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 on all hosts... 2026-02-13T03:31:30.803 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 pull 2026-02-13T03:31:30.805 DEBUG:teuthology.orchestra.run.trial132:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 pull 2026-02-13T03:31:30.818 DEBUG:teuthology.orchestra.run.trial133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 pull 2026-02-13T03:31:30.956 INFO:teuthology.orchestra.run.trial096.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T03:31:30.975 INFO:teuthology.orchestra.run.trial132.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T03:31:30.994 INFO:teuthology.orchestra.run.trial133.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T03:31:42.968 INFO:teuthology.orchestra.run.trial132.stdout:{ 2026-02-13T03:31:42.968 INFO:teuthology.orchestra.run.trial132.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev)", 2026-02-13T03:31:42.968 INFO:teuthology.orchestra.run.trial132.stdout: "image_id": "b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da", 2026-02-13T03:31:42.969 INFO:teuthology.orchestra.run.trial132.stdout: "repo_digests": [ 2026-02-13T03:31:42.969 INFO:teuthology.orchestra.run.trial132.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9" 2026-02-13T03:31:42.969 INFO:teuthology.orchestra.run.trial132.stdout: ] 2026-02-13T03:31:42.969 INFO:teuthology.orchestra.run.trial132.stdout:} 2026-02-13T03:31:43.127 INFO:teuthology.orchestra.run.trial096.stdout:{ 2026-02-13T03:31:43.127 INFO:teuthology.orchestra.run.trial096.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev)", 2026-02-13T03:31:43.127 INFO:teuthology.orchestra.run.trial096.stdout: "image_id": "b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da", 2026-02-13T03:31:43.127 INFO:teuthology.orchestra.run.trial096.stdout: "repo_digests": [ 2026-02-13T03:31:43.127 INFO:teuthology.orchestra.run.trial096.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9" 2026-02-13T03:31:43.127 INFO:teuthology.orchestra.run.trial096.stdout: ] 2026-02-13T03:31:43.127 INFO:teuthology.orchestra.run.trial096.stdout:} 2026-02-13T03:31:43.161 INFO:teuthology.orchestra.run.trial133.stdout:{ 2026-02-13T03:31:43.161 INFO:teuthology.orchestra.run.trial133.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev)", 2026-02-13T03:31:43.161 INFO:teuthology.orchestra.run.trial133.stdout: "image_id": "b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da", 2026-02-13T03:31:43.162 INFO:teuthology.orchestra.run.trial133.stdout: "repo_digests": [ 2026-02-13T03:31:43.162 INFO:teuthology.orchestra.run.trial133.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9" 2026-02-13T03:31:43.162 INFO:teuthology.orchestra.run.trial133.stdout: ] 2026-02-13T03:31:43.162 INFO:teuthology.orchestra.run.trial133.stdout:} 2026-02-13T03:31:43.177 DEBUG:teuthology.orchestra.run.trial096:> sudo mkdir -p /etc/ceph 2026-02-13T03:31:43.230 DEBUG:teuthology.orchestra.run.trial132:> sudo mkdir -p /etc/ceph 2026-02-13T03:31:43.258 DEBUG:teuthology.orchestra.run.trial133:> sudo mkdir -p /etc/ceph 2026-02-13T03:31:43.284 DEBUG:teuthology.orchestra.run.trial096:> sudo chmod 777 /etc/ceph 2026-02-13T03:31:43.309 DEBUG:teuthology.orchestra.run.trial132:> sudo chmod 777 /etc/ceph 2026-02-13T03:31:43.334 DEBUG:teuthology.orchestra.run.trial133:> sudo chmod 777 /etc/ceph 2026-02-13T03:31:43.358 INFO:tasks.cephadm:Writing seed config... 2026-02-13T03:31:43.361 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2026-02-13T03:31:43.361 INFO:tasks.cephadm: override: [client] client_fscrypt_dummy_encryption = True 2026-02-13T03:31:43.361 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2026-02-13T03:31:43.362 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.2 2026-02-13T03:31:43.362 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2026-02-13T03:31:43.362 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-13T03:31:43.362 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-13T03:31:43.362 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-13T03:31:43.362 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-13T03:31:43.362 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-13T03:31:43.362 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2026-02-13T03:31:43.362 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2026-02-13T03:31:43.362 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2026-02-13T03:31:43.362 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2026-02-13T03:31:43.362 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2026-02-13T03:31:43.363 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2026-02-13T03:31:43.363 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-13T03:31:43.363 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-13T03:31:43.363 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2026-02-13T03:31:43.363 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2026-02-13T03:31:43.363 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2026-02-13T03:31:43.363 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2026-02-13T03:31:43.363 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2026-02-13T03:31:43.363 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2026-02-13T03:31:43.363 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-02-13T03:31:43.363 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2026-02-13T03:31:43.364 DEBUG:teuthology.orchestra.run.trial096:> set -ex 2026-02-13T03:31:43.365 DEBUG:teuthology.orchestra.run.trial096:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-13T03:31:43.381 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 7c123de8-088c-11f1-84f7-d404e6e7d460 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd mclock skip benchmark = true osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client_fscrypt_dummy_encryption = True [mds] mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.2 2026-02-13T03:31:43.382 DEBUG:teuthology.orchestra.run.trial096:mon.a> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mon.a.service 2026-02-13T03:31:43.424 DEBUG:teuthology.orchestra.run.trial096:mgr.x> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mgr.x.service 2026-02-13T03:31:43.467 INFO:tasks.cephadm:Bootstrapping... 2026-02-13T03:31:43.468 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 -v bootstrap --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.96 --skip-dashboard --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-13T03:31:43.605 INFO:teuthology.orchestra.run.trial096.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:31:43.605 INFO:teuthology.orchestra.run.trial096.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', '-v', 'bootstrap', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.96', '--skip-dashboard', '--skip-admin-label'] 2026-02-13T03:31:43.606 INFO:teuthology.orchestra.run.trial096.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-13T03:31:43.606 INFO:teuthology.orchestra.run.trial096.stdout:Verifying podman|docker is present... 2026-02-13T03:31:43.622 INFO:teuthology.orchestra.run.trial096.stdout:/bin/podman: stdout 5.6.0 2026-02-13T03:31:43.622 INFO:teuthology.orchestra.run.trial096.stdout:Verifying lvm2 is present... 2026-02-13T03:31:43.622 INFO:teuthology.orchestra.run.trial096.stdout:Verifying time synchronization is in place... 2026-02-13T03:31:43.628 INFO:teuthology.orchestra.run.trial096.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-13T03:31:43.628 INFO:teuthology.orchestra.run.trial096.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-13T03:31:43.633 INFO:teuthology.orchestra.run.trial096.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-13T03:31:43.633 INFO:teuthology.orchestra.run.trial096.stdout:systemctl: stdout inactive 2026-02-13T03:31:43.640 INFO:teuthology.orchestra.run.trial096.stdout:systemctl: stdout enabled 2026-02-13T03:31:43.645 INFO:teuthology.orchestra.run.trial096.stdout:systemctl: stdout active 2026-02-13T03:31:43.645 INFO:teuthology.orchestra.run.trial096.stdout:Unit chronyd.service is enabled and running 2026-02-13T03:31:43.646 INFO:teuthology.orchestra.run.trial096.stdout:Repeating the final host check... 2026-02-13T03:31:43.660 INFO:teuthology.orchestra.run.trial096.stdout:/bin/podman: stdout 5.6.0 2026-02-13T03:31:43.661 INFO:teuthology.orchestra.run.trial096.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-13T03:31:43.661 INFO:teuthology.orchestra.run.trial096.stdout:systemctl is present 2026-02-13T03:31:43.661 INFO:teuthology.orchestra.run.trial096.stdout:lvcreate is present 2026-02-13T03:31:43.665 INFO:teuthology.orchestra.run.trial096.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-13T03:31:43.665 INFO:teuthology.orchestra.run.trial096.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-13T03:31:43.670 INFO:teuthology.orchestra.run.trial096.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-13T03:31:43.670 INFO:teuthology.orchestra.run.trial096.stdout:systemctl: stdout inactive 2026-02-13T03:31:43.676 INFO:teuthology.orchestra.run.trial096.stdout:systemctl: stdout enabled 2026-02-13T03:31:43.682 INFO:teuthology.orchestra.run.trial096.stdout:systemctl: stdout active 2026-02-13T03:31:43.682 INFO:teuthology.orchestra.run.trial096.stdout:Unit chronyd.service is enabled and running 2026-02-13T03:31:43.682 INFO:teuthology.orchestra.run.trial096.stdout:Host looks OK 2026-02-13T03:31:43.682 INFO:teuthology.orchestra.run.trial096.stdout:Cluster fsid: 7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:31:43.682 INFO:teuthology.orchestra.run.trial096.stdout:Acquiring lock 140021817685952 on /run/cephadm/7c123de8-088c-11f1-84f7-d404e6e7d460.lock 2026-02-13T03:31:43.682 INFO:teuthology.orchestra.run.trial096.stdout:Lock 140021817685952 acquired on /run/cephadm/7c123de8-088c-11f1-84f7-d404e6e7d460.lock 2026-02-13T03:31:43.682 INFO:teuthology.orchestra.run.trial096.stdout:Verifying IP 10.20.193.96 port 3300 ... 2026-02-13T03:31:43.683 INFO:teuthology.orchestra.run.trial096.stdout:Verifying IP 10.20.193.96 port 6789 ... 2026-02-13T03:31:43.683 INFO:teuthology.orchestra.run.trial096.stdout:Base mon IP(s) is [10.20.193.96:3300, 10.20.193.96:6789], mon addrv is [v2:10.20.193.96:3300,v1:10.20.193.96:6789] 2026-02-13T03:31:43.685 INFO:teuthology.orchestra.run.trial096.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.96 metric 102 2026-02-13T03:31:43.686 INFO:teuthology.orchestra.run.trial096.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.96 metric 102 2026-02-13T03:31:43.686 INFO:teuthology.orchestra.run.trial096.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-13T03:31:43.688 INFO:teuthology.orchestra.run.trial096.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-13T03:31:43.688 INFO:teuthology.orchestra.run.trial096.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0 proto kernel metric 256 pref medium 2026-02-13T03:31:43.688 INFO:teuthology.orchestra.run.trial096.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-13T03:31:43.691 INFO:teuthology.orchestra.run.trial096.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-13T03:31:43.691 INFO:teuthology.orchestra.run.trial096.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-13T03:31:43.691 INFO:teuthology.orchestra.run.trial096.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-13T03:31:43.691 INFO:teuthology.orchestra.run.trial096.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-13T03:31:43.692 INFO:teuthology.orchestra.run.trial096.stdout:/sbin/ip: stdout inet6 fe80::36f2:14d0:602:a79c/64 scope link noprefixroute 2026-02-13T03:31:43.692 INFO:teuthology.orchestra.run.trial096.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-13T03:31:43.692 INFO:teuthology.orchestra.run.trial096.stdout:/sbin/ip: stdout 3: enp1s0f0: mtu 1500 state UP qlen 1000 2026-02-13T03:31:43.692 INFO:teuthology.orchestra.run.trial096.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:5f62/64 scope link 2026-02-13T03:31:43.692 INFO:teuthology.orchestra.run.trial096.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-13T03:31:43.692 INFO:teuthology.orchestra.run.trial096.stdout:Mon IP `10.20.193.96` is in CIDR network `10.20.192.0/20` 2026-02-13T03:31:43.692 INFO:teuthology.orchestra.run.trial096.stdout:Mon IP `10.20.193.96` is in CIDR network `10.20.192.0/20` 2026-02-13T03:31:43.692 INFO:teuthology.orchestra.run.trial096.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-13T03:31:43.692 INFO:teuthology.orchestra.run.trial096.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-13T03:31:43.693 INFO:teuthology.orchestra.run.trial096.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T03:31:43.952 INFO:teuthology.orchestra.run.trial096.stdout:/bin/podman: stdout b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da 2026-02-13T03:31:43.952 INFO:teuthology.orchestra.run.trial096.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T03:31:43.953 INFO:teuthology.orchestra.run.trial096.stdout:/bin/podman: stderr Getting image source signatures 2026-02-13T03:31:43.953 INFO:teuthology.orchestra.run.trial096.stdout:/bin/podman: stderr Copying blob sha256:9b7325f35ad40fc8a795fce82955bc486ff370c187eaa160f4df65d0fb22f2a2 2026-02-13T03:31:43.953 INFO:teuthology.orchestra.run.trial096.stdout:/bin/podman: stderr Copying blob sha256:0c53e9fad0324c188a40a9b1e0ca4eb777da2812507ec104055fa6ec400d9a27 2026-02-13T03:31:43.953 INFO:teuthology.orchestra.run.trial096.stdout:/bin/podman: stderr Copying config sha256:b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da 2026-02-13T03:31:43.953 INFO:teuthology.orchestra.run.trial096.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-13T03:31:44.089 INFO:teuthology.orchestra.run.trial096.stdout:ceph: stdout ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev) 2026-02-13T03:31:44.090 INFO:teuthology.orchestra.run.trial096.stdout:Ceph version: ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev) 2026-02-13T03:31:44.090 INFO:teuthology.orchestra.run.trial096.stdout:Extracting ceph user uid/gid from container image... 2026-02-13T03:31:44.202 INFO:teuthology.orchestra.run.trial096.stdout:stat: stdout 167 167 2026-02-13T03:31:44.202 INFO:teuthology.orchestra.run.trial096.stdout:Creating initial keys... 2026-02-13T03:31:44.366 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph-authtool: stdout AQAgm45pyEuLExAA6qO4RddmpD7Xq4GjtsoS3w== 2026-02-13T03:31:44.486 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph-authtool: stdout AQAgm45pjBb3GxAAv4DcVW/0D6F7uQ3R5oy8Jg== 2026-02-13T03:31:44.603 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph-authtool: stdout AQAgm45puirfIhAAasPGPR/zW319zAwB7Hpcpg== 2026-02-13T03:31:44.603 INFO:teuthology.orchestra.run.trial096.stdout:Creating initial monmap... 2026-02-13T03:31:44.733 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-13T03:31:44.733 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = tentacle 2026-02-13T03:31:44.734 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:31:44.734 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-13T03:31:44.734 INFO:teuthology.orchestra.run.trial096.stdout:monmaptool for a [v2:10.20.193.96:3300,v1:10.20.193.96:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-13T03:31:44.734 INFO:teuthology.orchestra.run.trial096.stdout:setting min_mon_release = tentacle 2026-02-13T03:31:44.734 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/monmaptool: set fsid to 7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:31:44.734 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-13T03:31:44.734 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:31:44.734 INFO:teuthology.orchestra.run.trial096.stdout:Creating mon... 2026-02-13T03:31:44.866 INFO:teuthology.orchestra.run.trial096.stdout:create mon.a on 2026-02-13T03:31:45.021 INFO:teuthology.orchestra.run.trial096.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-13T03:31:45.117 INFO:teuthology.orchestra.run.trial096.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-13T03:31:45.225 INFO:teuthology.orchestra.run.trial096.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-7c123de8-088c-11f1-84f7-d404e6e7d460.target → /etc/systemd/system/ceph-7c123de8-088c-11f1-84f7-d404e6e7d460.target. 2026-02-13T03:31:45.225 INFO:teuthology.orchestra.run.trial096.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-7c123de8-088c-11f1-84f7-d404e6e7d460.target → /etc/systemd/system/ceph-7c123de8-088c-11f1-84f7-d404e6e7d460.target. 2026-02-13T03:31:45.347 INFO:teuthology.orchestra.run.trial096.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mon.a 2026-02-13T03:31:45.347 INFO:teuthology.orchestra.run.trial096.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mon.a.service: Unit ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mon.a.service not loaded. 2026-02-13T03:31:45.467 INFO:teuthology.orchestra.run.trial096.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7c123de8-088c-11f1-84f7-d404e6e7d460.target.wants/ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@.service. 2026-02-13T03:31:45.608 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:45 trial096 podman[24206]: 2026-02-13 03:31:45.580203698 +0000 UTC m=+0.016527380 container create c6e9fe3071bd198cf41a8b4e790505775aa9b6f00c5b53e73a7c5237ffd2b695 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mon-a, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, version=10, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default) 2026-02-13T03:31:45.626 INFO:teuthology.orchestra.run.trial096.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T03:31:45.626 INFO:teuthology.orchestra.run.trial096.stdout:systemctl: stdout disabled 2026-02-13T03:31:45.633 INFO:teuthology.orchestra.run.trial096.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T03:31:45.633 INFO:teuthology.orchestra.run.trial096.stdout:systemctl: stdout inactive 2026-02-13T03:31:45.633 INFO:teuthology.orchestra.run.trial096.stdout:firewalld.service is not enabled 2026-02-13T03:31:45.633 INFO:teuthology.orchestra.run.trial096.stdout:Not possible to enable service . firewalld.service is not available 2026-02-13T03:31:45.634 INFO:teuthology.orchestra.run.trial096.stdout:Waiting for mon to start... 2026-02-13T03:31:45.634 INFO:teuthology.orchestra.run.trial096.stdout:Waiting for mon... 2026-02-13T03:31:45.800 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout cluster: 2026-02-13T03:31:45.801 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout id: 7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:31:45.801 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-13T03:31:45.801 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout 2026-02-13T03:31:45.801 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout services: 2026-02-13T03:31:45.801 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.13951s) [leader: a] 2026-02-13T03:31:45.801 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-13T03:31:45.801 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-13T03:31:45.801 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout 2026-02-13T03:31:45.801 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout data: 2026-02-13T03:31:45.801 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-13T03:31:45.802 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-13T03:31:45.802 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-13T03:31:45.802 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout pgs: 2026-02-13T03:31:45.802 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout 2026-02-13T03:31:45.802 INFO:teuthology.orchestra.run.trial096.stdout:mon is available 2026-02-13T03:31:45.802 INFO:teuthology.orchestra.run.trial096.stdout:Assimilating anything we can from ceph.conf... 2026-02-13T03:31:45.914 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:45 trial096 podman[24206]: 2026-02-13 03:31:45.612968135 +0000 UTC m=+0.049291757 container init c6e9fe3071bd198cf41a8b4e790505775aa9b6f00c5b53e73a7c5237ffd2b695 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mon-a, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, ceph=True, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, version=10, name=rockylinux, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T03:31:45.914 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:45 trial096 podman[24206]: 2026-02-13 03:31:45.615302312 +0000 UTC m=+0.051625924 container start c6e9fe3071bd198cf41a8b4e790505775aa9b6f00c5b53e73a7c5237ffd2b695 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mon-a, version=10, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , ceph=True, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, license=BSD-3-Clause) 2026-02-13T03:31:45.914 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:45 trial096 bash[24206]: c6e9fe3071bd198cf41a8b4e790505775aa9b6f00c5b53e73a7c5237ffd2b695 2026-02-13T03:31:45.914 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:45 trial096 podman[24206]: 2026-02-13 03:31:45.573569973 +0000 UTC m=+0.009893585 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 2026-02-13T03:31:45.914 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:45 trial096 systemd[1]: Started Ceph mon.a for 7c123de8-088c-11f1-84f7-d404e6e7d460. 2026-02-13T03:31:45.914 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:45 trial096 ceph-mon[24236]: mkfs 7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:31:45.914 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:45 trial096 ceph-mon[24236]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-13T03:31:45.964 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout 2026-02-13T03:31:45.964 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout [global] 2026-02-13T03:31:45.964 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout fsid = 7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:31:45.964 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-13T03:31:45.964 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.96:3300,v1:10.20.193.96:6789] 2026-02-13T03:31:45.965 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-13T03:31:45.965 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-13T03:31:45.965 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-13T03:31:45.965 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-13T03:31:45.965 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout 2026-02-13T03:31:45.965 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-13T03:31:45.965 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-13T03:31:45.965 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout 2026-02-13T03:31:45.965 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout [osd] 2026-02-13T03:31:45.965 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-13T03:31:45.965 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-13T03:31:45.965 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-13T03:31:45.966 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-13T03:31:45.966 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-13T03:31:45.966 INFO:teuthology.orchestra.run.trial096.stdout:Generating new minimal ceph.conf... 2026-02-13T03:31:46.117 INFO:teuthology.orchestra.run.trial096.stdout:Restarting the monitor... 2026-02-13T03:31:46.169 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 systemd[1]: Stopping Ceph mon.a for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:31:46.450 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mon-a[24232]: 2026-02-13T03:31:46.199+0000 7fa1722556c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:31:46.450 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mon-a[24232]: 2026-02-13T03:31:46.199+0000 7fa1722556c0 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-13T03:31:46.631 INFO:teuthology.orchestra.run.trial096.stdout:Setting public_network to 10.20.192.0/20 in global config section 2026-02-13T03:31:46.749 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 podman[24514]: 2026-02-13 03:31:46.453184578 +0000 UTC m=+0.265838726 container died c6e9fe3071bd198cf41a8b4e790505775aa9b6f00c5b53e73a7c5237ffd2b695 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mon-a, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , version=10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True) 2026-02-13T03:31:46.749 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 podman[24514]: 2026-02-13 03:31:46.460759554 +0000 UTC m=+0.273413712 container remove c6e9fe3071bd198cf41a8b4e790505775aa9b6f00c5b53e73a7c5237ffd2b695 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mon-a, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, license=BSD-3-Clause, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T03:31:46.749 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 bash[24514]: ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mon-a 2026-02-13T03:31:46.749 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 systemd[1]: ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-13T03:31:46.749 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 systemd[1]: Stopped Ceph mon.a for 7c123de8-088c-11f1-84f7-d404e6e7d460. 2026-02-13T03:31:46.749 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 systemd[1]: Starting Ceph mon.a for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:31:46.749 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 podman[24642]: 2026-02-13 03:31:46.598803423 +0000 UTC m=+0.014672770 container create 9996a18c022013b1fba8f5497475d1664c642c751311ebd623d71637fb93bd77 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mon-a, version=10, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T03:31:46.749 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 podman[24642]: 2026-02-13 03:31:46.626655351 +0000 UTC m=+0.042524698 container init 9996a18c022013b1fba8f5497475d1664c642c751311ebd623d71637fb93bd77 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mon-a, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, OSD_FLAVOR=default, org.opencontainers.image.version=10, ceph=True, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image) 2026-02-13T03:31:46.749 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 podman[24642]: 2026-02-13 03:31:46.629008592 +0000 UTC m=+0.044877929 container start 9996a18c022013b1fba8f5497475d1664c642c751311ebd623d71637fb93bd77 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mon-a, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, io.buildah.version=1.33.7, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , version=10) 2026-02-13T03:31:46.749 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 bash[24642]: 9996a18c022013b1fba8f5497475d1664c642c751311ebd623d71637fb93bd77 2026-02-13T03:31:46.749 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 podman[24642]: 2026-02-13 03:31:46.59296967 +0000 UTC m=+0.008839027 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 2026-02-13T03:31:46.749 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 systemd[1]: Started Ceph mon.a for 7c123de8-088c-11f1-84f7-d404e6e7d460. 2026-02-13T03:31:46.749 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: set uid:gid to 167:167 (ceph:ceph) 2026-02-13T03:31:46.749 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev - RelWithDebInfo), process ceph-mon, pid 2 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: pidfile_write: ignore empty --pid-file 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: load: jerasure load: lrc 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: RocksDB version: 7.9.2 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Git sha 0 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Compile date 2026-02-10 21:31:46 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: DB SUMMARY 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: DB Session ID: 41LSXUFKAHU4JAO7M0CV 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: CURRENT file: CURRENT 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: IDENTITY file: IDENTITY 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 83871 ; 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.error_if_exists: 0 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.create_if_missing: 0 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.paranoid_checks: 1 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.env: 0x56159b81a2c0 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.fs: PosixFileSystem 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.info_log: 0x56159da3cd60 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_file_opening_threads: 16 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.statistics: (nil) 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.use_fsync: 0 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_log_file_size: 0 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.keep_log_file_num: 1000 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.recycle_log_file_num: 0 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.allow_fallocate: 1 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.allow_mmap_reads: 0 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.allow_mmap_writes: 0 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.use_direct_reads: 0 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.create_missing_column_families: 0 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.db_log_dir: 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.wal_dir: 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.advise_random_on_open: 1 2026-02-13T03:31:46.750 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.db_write_buffer_size: 0 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.write_buffer_manager: 0x56159da33b80 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.rate_limiter: (nil) 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.wal_recovery_mode: 2 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.enable_thread_tracking: 0 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.enable_pipelined_write: 0 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.unordered_write: 0 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.row_cache: None 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.wal_filter: None 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.allow_ingest_behind: 0 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.two_write_queues: 0 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.manual_wal_flush: 0 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.wal_compression: 0 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.atomic_flush: 0 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-13T03:31:46.751 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.log_readahead_size: 0 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.best_efforts_recovery: 0 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.allow_data_in_errors: 0 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.db_host_id: __hostname__ 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_background_jobs: 2 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_background_compactions: -1 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_subcompactions: 1 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_total_wal_size: 0 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_open_files: -1 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.bytes_per_sync: 0 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.compaction_readahead_size: 0 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_background_flushes: -1 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Compression algorithms supported: 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: kZSTD supported: 0 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: kXpressCompression supported: 0 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: kBZip2Compression supported: 0 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: kLZ4Compression supported: 1 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: kZlibCompression supported: 1 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: kLZ4HCCompression supported: 1 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: kSnappyCompression supported: 1 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.merge_operator: 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.compaction_filter: None 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.compaction_filter_factory: None 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.sst_partitioner_factory: None 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56159dbbc360) 2026-02-13T03:31:46.752 INFO:journalctl@ceph.mon.a.trial096.stdout: cache_index_and_filter_blocks: 1 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: pin_top_level_index_and_filter: 1 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: index_type: 0 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: data_block_index_type: 0 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: index_shortening: 1 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: checksum: 4 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: no_block_cache: 0 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: block_cache: 0x56159da35690 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: block_cache_name: BinnedLRUCache 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: block_cache_options: 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: capacity : 536870912 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: num_shard_bits : 4 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: strict_capacity_limit : 0 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: high_pri_pool_ratio: 0.000 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: block_cache_compressed: (nil) 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: persistent_cache: (nil) 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: block_size: 4096 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: block_size_deviation: 10 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: block_restart_interval: 16 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: index_block_restart_interval: 1 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: metadata_block_size: 4096 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: partition_filters: 0 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: use_delta_encoding: 1 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: filter_policy: bloomfilter 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: whole_key_filtering: 1 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: verify_compression: 0 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: read_amp_bytes_per_bit: 0 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: format_version: 5 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: enable_index_compression: 1 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: block_align: 0 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: max_auto_readahead_size: 262144 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: prepopulate_block_cache: 0 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: initial_auto_readahead_size: 8192 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout: num_file_reads_for_auto_readahead: 2 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.write_buffer_size: 33554432 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_write_buffer_number: 2 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.compression: NoCompression 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.bottommost_compression: Disabled 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.prefix_extractor: nullptr 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.num_levels: 7 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-13T03:31:46.753 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.compression_opts.level: 32767 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.compression_opts.strategy: 0 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.compression_opts.enabled: false 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.target_file_size_base: 67108864 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.arena_block_size: 1048576 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.disable_auto_compactions: 0 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-13T03:31:46.754 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.inplace_update_support: 0 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.bloom_locality: 0 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.max_successive_merges: 0 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.paranoid_file_checks: 0 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.force_consistency_checks: 1 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.report_bg_io_stats: 0 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.ttl: 2592000 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.enable_blob_files: false 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.min_blob_size: 0 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.blob_file_size: 268435456 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.blob_file_starting_level: 0 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1d950a59-7319-4378-a2ed-63535840ac81 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770953506643703, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770953506644385, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 80328, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 257, "table_properties": {"data_size": 78505, "index_size": 208, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 11515, "raw_average_key_size": 50, "raw_value_size": 72060, "raw_average_value_size": 316, "num_data_blocks": 9, "num_entries": 228, "num_filter_entries": 228, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1770953506, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1d950a59-7319-4378-a2ed-63535840ac81", "db_session_id": "41LSXUFKAHU4JAO7M0CV", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770953506644472, "job": 1, "event": "recovery_finished"} 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56159da58e00 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: DB pointer 0x56159e85e000 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout: ** DB Stats ** 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-13T03:31:46.755 INFO:journalctl@ceph.mon.a.trial096.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: ** Compaction Stats [default] ** 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: L0 2/0 80.31 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 152.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: Sum 2/0 80.31 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 152.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 152.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: ** Compaction Stats [default] ** 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 152.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: Cumulative compaction: 0.00 GB write, 26.71 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: Interval compaction: 0.00 GB write, 26.71 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: Block cache BinnedLRUCache@0x56159da35690#2 capacity: 512.00 MB usage: 1.16 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.39 KB,7.45058e-05%) Misc(1,0.00 KB,0%) 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: starting mon.a rank 0 at public addrs [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] at bind addrs [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: mon.a@-1(???) e1 preinit fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: mon.a@-1(???).mds e1 new map 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: mon.a@-1(???).mds e1 print_map 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: e1 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: btime 2026-02-13T03:31:45:641938+0000 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: legacy client fscid: -1 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout: No filesystems configured 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T03:31:46.756 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-13T03:31:46.757 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-13T03:31:46.757 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: monmap epoch 1 2026-02-13T03:31:46.757 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:31:46.757 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: last_changed 2026-02-13T03:31:44.703334+0000 2026-02-13T03:31:46.757 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: created 2026-02-13T03:31:44.703334+0000 2026-02-13T03:31:46.757 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: min_mon_release 20 (tentacle) 2026-02-13T03:31:46.757 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: election_strategy: 1 2026-02-13T03:31:46.757 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: 0: [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] mon.a 2026-02-13T03:31:46.757 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: fsmap 2026-02-13T03:31:46.757 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: osdmap e1: 0 total, 0 up, 0 in 2026-02-13T03:31:46.757 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:46 trial096 ceph-mon[24671]: mgrmap e1: no daemons active 2026-02-13T03:31:46.799 INFO:teuthology.orchestra.run.trial096.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-13T03:31:46.800 INFO:teuthology.orchestra.run.trial096.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-13T03:31:46.800 INFO:teuthology.orchestra.run.trial096.stdout:Creating mgr... 2026-02-13T03:31:46.800 INFO:teuthology.orchestra.run.trial096.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-13T03:31:46.801 INFO:teuthology.orchestra.run.trial096.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-13T03:31:46.923 INFO:teuthology.orchestra.run.trial096.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mgr.x 2026-02-13T03:31:46.923 INFO:teuthology.orchestra.run.trial096.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mgr.x.service: Unit ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mgr.x.service not loaded. 2026-02-13T03:31:47.027 INFO:teuthology.orchestra.run.trial096.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7c123de8-088c-11f1-84f7-d404e6e7d460.target.wants/ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mgr.x.service → /etc/systemd/system/ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@.service. 2026-02-13T03:31:47.165 INFO:teuthology.orchestra.run.trial096.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T03:31:47.165 INFO:teuthology.orchestra.run.trial096.stdout:systemctl: stdout disabled 2026-02-13T03:31:47.171 INFO:teuthology.orchestra.run.trial096.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T03:31:47.171 INFO:teuthology.orchestra.run.trial096.stdout:systemctl: stdout inactive 2026-02-13T03:31:47.171 INFO:teuthology.orchestra.run.trial096.stdout:firewalld.service is not enabled 2026-02-13T03:31:47.171 INFO:teuthology.orchestra.run.trial096.stdout:Not possible to enable service . firewalld.service is not available 2026-02-13T03:31:47.178 INFO:teuthology.orchestra.run.trial096.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T03:31:47.178 INFO:teuthology.orchestra.run.trial096.stdout:systemctl: stdout disabled 2026-02-13T03:31:47.184 INFO:teuthology.orchestra.run.trial096.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T03:31:47.184 INFO:teuthology.orchestra.run.trial096.stdout:systemctl: stdout inactive 2026-02-13T03:31:47.184 INFO:teuthology.orchestra.run.trial096.stdout:firewalld.service is not enabled 2026-02-13T03:31:47.184 INFO:teuthology.orchestra.run.trial096.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-13T03:31:47.184 INFO:teuthology.orchestra.run.trial096.stdout:Waiting for mgr to start... 2026-02-13T03:31:47.185 INFO:teuthology.orchestra.run.trial096.stdout:Waiting for mgr... 2026-02-13T03:31:47.363 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout 2026-02-13T03:31:47.363 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout { 2026-02-13T03:31:47.363 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "fsid": "7c123de8-088c-11f1-84f7-d404e6e7d460", 2026-02-13T03:31:47.363 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "health": { 2026-02-13T03:31:47.363 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-13T03:31:47.363 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-13T03:31:47.363 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-13T03:31:47.363 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:31:47.363 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-13T03:31:47.364 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-13T03:31:47.364 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout 0 2026-02-13T03:31:47.364 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout ], 2026-02-13T03:31:47.364 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-13T03:31:47.364 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "a" 2026-02-13T03:31:47.364 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout ], 2026-02-13T03:31:47.364 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-13T03:31:47.364 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-13T03:31:47.364 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T03:31:47.364 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-13T03:31:47.364 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-13T03:31:47.364 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:31:47.364 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-13T03:31:47.364 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T03:31:47.364 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-13T03:31:47.364 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-13T03:31:47.364 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-13T03:31:47.364 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-13T03:31:47.364 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-13T03:31:47.365 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-13T03:31:47.365 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:31:47.365 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-13T03:31:47.365 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-13T03:31:47.365 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-13T03:31:47.365 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-13T03:31:47.365 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-13T03:31:47.365 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-13T03:31:47.365 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-13T03:31:47.365 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-13T03:31:47.365 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-13T03:31:47.365 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:31:47.365 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-13T03:31:47.365 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T03:31:47.365 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "btime": "2026-02-13T03:31:45:641938+0000", 2026-02-13T03:31:47.365 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-13T03:31:47.365 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-13T03:31:47.365 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:31:47.365 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-13T03:31:47.366 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-13T03:31:47.366 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-13T03:31:47.366 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-13T03:31:47.366 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-13T03:31:47.366 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-13T03:31:47.366 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout ], 2026-02-13T03:31:47.366 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T03:31:47.366 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:31:47.366 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-13T03:31:47.366 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T03:31:47.366 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "modified": "2026-02-13T03:31:45.642532+0000", 2026-02-13T03:31:47.366 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T03:31:47.366 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:31:47.366 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-13T03:31:47.366 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout } 2026-02-13T03:31:47.366 INFO:teuthology.orchestra.run.trial096.stdout:mgr not available, waiting (1/15)... 2026-02-13T03:31:47.553 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:47 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:47.554+0000 7fcaa9bf4fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T03:31:47.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:47 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3970291007' entity='client.admin' 2026-02-13T03:31:47.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:47 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2420861710' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T03:31:47.920 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:47 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:47.591+0000 7fcaa9bf4fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T03:31:47.920 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:47 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:47.593+0000 7fcaa9bf4fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T03:31:47.920 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:47 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:47.597+0000 7fcaa9bf4fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T03:31:47.920 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:47 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:47.599+0000 7fcaa9bf4fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T03:31:47.920 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:47 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:47.600+0000 7fcaa9bf4fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T03:31:47.920 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:47 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:47.603+0000 7fcaa9bf4fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T03:31:47.920 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:47 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:47.604+0000 7fcaa9bf4fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T03:31:47.920 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:47 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:47.606+0000 7fcaa9bf4fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T03:31:47.920 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:47 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:47.609+0000 7fcaa9bf4fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T03:31:47.920 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:47 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:47.780+0000 7fcaa9bf4fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T03:31:47.920 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:47 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:47.780+0000 7fcaa9bf4fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T03:31:47.920 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:47 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:47.782+0000 7fcaa9bf4fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T03:31:47.920 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:47 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:47.785+0000 7fcaa9bf4fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T03:31:47.920 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:47 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:47.786+0000 7fcaa9bf4fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T03:31:47.921 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:47 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:47.786+0000 7fcaa9bf4fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T03:31:47.921 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:47 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:47.787+0000 7fcaa9bf4fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T03:31:48.419 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:47 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:47.927+0000 7fcaa9bf4fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T03:31:48.420 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:47 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:47.956+0000 7fcaa9bf4fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T03:31:48.420 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:47 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:47.960+0000 7fcaa9bf4fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T03:31:48.420 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:47 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:47.961+0000 7fcaa9bf4fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T03:31:48.420 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:47 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:47.961+0000 7fcaa9bf4fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T03:31:49.169 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:48 trial096 ceph-mon[24671]: Activating manager daemon x 2026-02-13T03:31:49.169 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:48 trial096 ceph-mon[24671]: mgrmap e2: x(active, starting, since 0.00278934s) 2026-02-13T03:31:49.169 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:48 trial096 ceph-mon[24671]: from='mgr.14100 10.20.193.96:0/3917485518' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T03:31:49.169 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:48 trial096 ceph-mon[24671]: from='mgr.14100 10.20.193.96:0/3917485518' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T03:31:49.169 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:48 trial096 ceph-mon[24671]: from='mgr.14100 10.20.193.96:0/3917485518' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T03:31:49.169 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:48 trial096 ceph-mon[24671]: from='mgr.14100 10.20.193.96:0/3917485518' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:31:49.169 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:48 trial096 ceph-mon[24671]: from='mgr.14100 10.20.193.96:0/3917485518' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T03:31:49.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:48 trial096 ceph-mon[24671]: Manager daemon x is now available 2026-02-13T03:31:49.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:48 trial096 ceph-mon[24671]: from='mgr.14100 10.20.193.96:0/3917485518' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T03:31:49.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:48 trial096 ceph-mon[24671]: from='mgr.14100 10.20.193.96:0/3917485518' entity='mgr.x' 2026-02-13T03:31:49.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:48 trial096 ceph-mon[24671]: from='mgr.14100 10.20.193.96:0/3917485518' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T03:31:49.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:48 trial096 ceph-mon[24671]: from='mgr.14100 10.20.193.96:0/3917485518' entity='mgr.x' 2026-02-13T03:31:49.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:48 trial096 ceph-mon[24671]: from='mgr.14100 10.20.193.96:0/3917485518' entity='mgr.x' 2026-02-13T03:31:49.635 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout 2026-02-13T03:31:49.635 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout { 2026-02-13T03:31:49.635 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "fsid": "7c123de8-088c-11f1-84f7-d404e6e7d460", 2026-02-13T03:31:49.635 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "health": { 2026-02-13T03:31:49.635 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-13T03:31:49.635 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-13T03:31:49.635 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-13T03:31:49.636 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:31:49.636 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-13T03:31:49.636 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-13T03:31:49.636 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout 0 2026-02-13T03:31:49.636 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout ], 2026-02-13T03:31:49.636 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-13T03:31:49.636 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "a" 2026-02-13T03:31:49.636 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout ], 2026-02-13T03:31:49.636 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2026-02-13T03:31:49.636 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-13T03:31:49.636 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T03:31:49.636 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-13T03:31:49.636 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-13T03:31:49.636 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:31:49.636 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-13T03:31:49.636 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T03:31:49.636 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-13T03:31:49.636 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-13T03:31:49.636 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-13T03:31:49.636 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-13T03:31:49.636 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-13T03:31:49.636 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "btime": "2026-02-13T03:31:45:641938+0000", 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout ], 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T03:31:49.637 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:31:49.638 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-13T03:31:49.638 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T03:31:49.638 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "modified": "2026-02-13T03:31:45.642532+0000", 2026-02-13T03:31:49.638 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T03:31:49.638 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:31:49.638 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-13T03:31:49.638 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout } 2026-02-13T03:31:49.638 INFO:teuthology.orchestra.run.trial096.stdout:mgr is available 2026-02-13T03:31:49.868 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout 2026-02-13T03:31:49.868 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout [global] 2026-02-13T03:31:49.868 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout fsid = 7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:31:49.868 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-13T03:31:49.868 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.96:3300,v1:10.20.193.96:6789] 2026-02-13T03:31:49.868 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-13T03:31:49.868 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-13T03:31:49.868 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-13T03:31:49.868 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-13T03:31:49.868 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout 2026-02-13T03:31:49.868 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-13T03:31:49.868 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-13T03:31:49.868 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout 2026-02-13T03:31:49.868 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout [osd] 2026-02-13T03:31:49.868 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-13T03:31:49.869 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-13T03:31:49.869 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-13T03:31:49.869 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-13T03:31:49.869 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-13T03:31:49.869 INFO:teuthology.orchestra.run.trial096.stdout:Enabling cephadm module... 2026-02-13T03:31:50.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:49 trial096 ceph-mon[24671]: mgrmap e3: x(active, since 1.00507s) 2026-02-13T03:31:50.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:49 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/137752766' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T03:31:50.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:49 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/4225929059' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-13T03:31:51.242 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:50 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: ignoring --setuser ceph since I am not root 2026-02-13T03:31:51.242 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:50 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: ignoring --setgroup ceph since I am not root 2026-02-13T03:31:51.242 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.008+0000 7f9fc3d44fc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T03:31:51.242 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.049+0000 7f9fc3d44fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T03:31:51.242 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:50 trial096 ceph-mon[24671]: mgrmap e4: x(active, since 2s) 2026-02-13T03:31:51.242 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:50 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1954323080' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-13T03:31:51.265 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout { 2026-02-13T03:31:51.265 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-13T03:31:51.265 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-13T03:31:51.265 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-13T03:31:51.265 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-13T03:31:51.265 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout } 2026-02-13T03:31:51.265 INFO:teuthology.orchestra.run.trial096.stdout:Waiting for the mgr to restart... 2026-02-13T03:31:51.265 INFO:teuthology.orchestra.run.trial096.stdout:Waiting for mgr epoch 5... 2026-02-13T03:31:51.596 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.307+0000 7f9fc3d44fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T03:31:51.596 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.316+0000 7f9fc3d44fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T03:31:51.596 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.322+0000 7f9fc3d44fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T03:31:51.596 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.329+0000 7f9fc3d44fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T03:31:51.596 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.335+0000 7f9fc3d44fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T03:31:51.596 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.347+0000 7f9fc3d44fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T03:31:51.596 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.372+0000 7f9fc3d44fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T03:31:51.596 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.375+0000 7f9fc3d44fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T03:31:51.596 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.377+0000 7f9fc3d44fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T03:31:51.596 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.384+0000 7f9fc3d44fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T03:31:51.596 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.420+0000 7f9fc3d44fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T03:31:51.596 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.422+0000 7f9fc3d44fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T03:31:51.596 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.425+0000 7f9fc3d44fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T03:31:51.596 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.427+0000 7f9fc3d44fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T03:31:51.596 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.428+0000 7f9fc3d44fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T03:31:51.596 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.431+0000 7f9fc3d44fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T03:31:51.596 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.432+0000 7f9fc3d44fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T03:31:51.596 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.435+0000 7f9fc3d44fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T03:31:51.596 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.437+0000 7f9fc3d44fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T03:31:51.597 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.597+0000 7f9fc3d44fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T03:31:51.597 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.597+0000 7f9fc3d44fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T03:31:51.919 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.600+0000 7f9fc3d44fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T03:31:51.919 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.602+0000 7f9fc3d44fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T03:31:51.919 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.604+0000 7f9fc3d44fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T03:31:51.919 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.604+0000 7f9fc3d44fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T03:31:51.919 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.604+0000 7f9fc3d44fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T03:31:51.920 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.747+0000 7f9fc3d44fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T03:31:51.920 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.775+0000 7f9fc3d44fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T03:31:51.920 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.779+0000 7f9fc3d44fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T03:31:51.920 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.780+0000 7f9fc3d44fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T03:31:51.920 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:51 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:31:51.780+0000 7f9fc3d44fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T03:31:52.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:51 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1954323080' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-13T03:31:52.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:51 trial096 ceph-mon[24671]: mgrmap e5: x(active, since 3s) 2026-02-13T03:31:52.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:51 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/379753615' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-13T03:31:52.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:51 trial096 ceph-mon[24671]: Active manager daemon x restarted 2026-02-13T03:31:52.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:51 trial096 ceph-mon[24671]: Activating manager daemon x 2026-02-13T03:31:52.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:51 trial096 ceph-mon[24671]: osdmap e2: 0 total, 0 up, 0 in 2026-02-13T03:31:52.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:51 trial096 ceph-mon[24671]: mgrmap e6: x(active, starting, since 0.00269472s) 2026-02-13T03:31:52.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:51 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:31:52.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:51 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T03:31:52.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:51 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T03:31:52.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:51 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T03:31:52.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:51 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T03:31:52.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:51 trial096 ceph-mon[24671]: Manager daemon x is now available 2026-02-13T03:31:52.811 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout { 2026-02-13T03:31:52.812 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-13T03:31:52.812 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-13T03:31:52.812 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout } 2026-02-13T03:31:52.812 INFO:teuthology.orchestra.run.trial096.stdout:mgr epoch 5 is available 2026-02-13T03:31:52.812 INFO:teuthology.orchestra.run.trial096.stdout:Verifying orchestrator module is enabled... 2026-02-13T03:31:53.786 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:31:53.786 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:31:53.786 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:31:53.786 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:31:53.786 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:31:53.786 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:31:53.786 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:31:53.787 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:31:53.787 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:31:53.787 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:31:53.787 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T03:31:53.787 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T03:31:53.787 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:53 trial096 ceph-mon[24671]: mgrmap e7: x(active, since 1.00324s) 2026-02-13T03:31:53.787 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:31:53.787 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:53 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1843554416' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-13T03:31:53.811 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2026-02-13T03:31:53.811 INFO:teuthology.orchestra.run.trial096.stdout:Setting orchestrator backend to cephadm... 2026-02-13T03:31:54.280 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-13T03:31:54.280 INFO:teuthology.orchestra.run.trial096.stdout:Generating ssh key... 2026-02-13T03:31:54.556 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:54 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: Generating public/private ed25519 key pair. 2026-02-13T03:31:54.557 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:54 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: Your identification has been saved in /tmp/tmpj3bpnd95/key 2026-02-13T03:31:54.557 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:54 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: Your public key has been saved in /tmp/tmpj3bpnd95/key.pub 2026-02-13T03:31:54.557 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:54 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: The key fingerprint is: 2026-02-13T03:31:54.557 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:54 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: SHA256:8XW+n0wAHxPakzRwLVB9MXrM0X+dSR/pCz3kwqoK31o ceph-7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:31:54.557 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:54 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: The key's randomart image is: 2026-02-13T03:31:54.557 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:54 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: +--[ED25519 256]--+ 2026-02-13T03:31:54.557 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:54 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: | o+*o++| 2026-02-13T03:31:54.557 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:54 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: | =.BB=| 2026-02-13T03:31:54.557 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:54 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: | . ooBO+O| 2026-02-13T03:31:54.558 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:54 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: | o .o*=B=| 2026-02-13T03:31:54.558 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:54 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: | S . .o+ +| 2026-02-13T03:31:54.558 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:54 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: | . .o | 2026-02-13T03:31:54.558 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:54 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: | . E. .. | 2026-02-13T03:31:54.558 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:54 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: | o o. o..| 2026-02-13T03:31:54.558 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:54 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: | +o. o.| 2026-02-13T03:31:54.558 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:31:54 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: +----[SHA256]-----+ 2026-02-13T03:31:54.738 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEJF/w873odh/g8jmHyM0RrJGwGKDbVEu4Wwhbh9w0cH ceph-7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:31:54.738 INFO:teuthology.orchestra.run.trial096.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-13T03:31:54.738 INFO:teuthology.orchestra.run.trial096.stdout:Adding key to root@localhost authorized_keys... 2026-02-13T03:31:54.739 INFO:teuthology.orchestra.run.trial096.stdout:Adding host trial096... 2026-02-13T03:31:54.836 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:54 trial096 ceph-mon[24671]: Optimize plan auto_2026-02-13_03:31:51, mode upmap, max misplaced 0.050000 2026-02-13T03:31:54.836 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:54 trial096 ceph-mon[24671]: No pools available 2026-02-13T03:31:54.837 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:54 trial096 ceph-mon[24671]: Found migration_current of "None". Setting to last migration. 2026-02-13T03:31:54.837 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:54 trial096 ceph-mon[24671]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-13T03:31:54.837 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:54 trial096 ceph-mon[24671]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-13T03:31:54.837 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:54 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1843554416' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-13T03:31:54.837 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:54 trial096 ceph-mon[24671]: mgrmap e8: x(active, since 2s) 2026-02-13T03:31:54.837 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:54 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:31:54.837 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:54 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:31:54.837 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:54 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:31:54.837 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:54 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:31:56.169 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:55 trial096 ceph-mon[24671]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:31:56.169 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:55 trial096 ceph-mon[24671]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:31:56.169 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:55 trial096 ceph-mon[24671]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:31:56.169 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:55 trial096 ceph-mon[24671]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:31:56.169 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:55 trial096 ceph-mon[24671]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial096", "addr": "10.20.193.96", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:31:56.737 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout Added host 'trial096' with addr '10.20.193.96' 2026-02-13T03:31:56.738 INFO:teuthology.orchestra.run.trial096.stdout:Deploying unmanaged mon service... 2026-02-13T03:31:56.977 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-13T03:31:56.977 INFO:teuthology.orchestra.run.trial096.stdout:Deploying unmanaged mgr service... 2026-02-13T03:31:57.216 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-13T03:31:57.456 INFO:teuthology.orchestra.run.trial096.stdout:Saving cluster configuration to /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/config directory 2026-02-13T03:31:57.731 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:57 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:31:57.731 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:57 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:31:57.731 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:57 trial096 ceph-mon[24671]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:31:57.731 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:57 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:31:57.731 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:57 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:31:57.731 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:57 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:31:57.731 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:57 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/9525866' entity='client.admin' 2026-02-13T03:31:57.731 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:57 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:31:57.742 INFO:teuthology.orchestra.run.trial096.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-13T03:31:57.743 INFO:teuthology.orchestra.run.trial096.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-13T03:31:57.743 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:31:57.743 INFO:teuthology.orchestra.run.trial096.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-13T03:31:57.743 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:31:57.743 INFO:teuthology.orchestra.run.trial096.stdout:Or, if you are only running a single cluster on this host: 2026-02-13T03:31:57.743 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:31:57.743 INFO:teuthology.orchestra.run.trial096.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-13T03:31:57.743 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:31:57.743 INFO:teuthology.orchestra.run.trial096.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-13T03:31:57.743 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:31:57.743 INFO:teuthology.orchestra.run.trial096.stdout: ceph telemetry on 2026-02-13T03:31:57.743 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:31:57.743 INFO:teuthology.orchestra.run.trial096.stdout:For more information see: 2026-02-13T03:31:57.743 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:31:57.743 INFO:teuthology.orchestra.run.trial096.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-13T03:31:57.743 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:31:57.743 INFO:teuthology.orchestra.run.trial096.stdout:Bootstrap complete. 2026-02-13T03:31:57.750 INFO:teuthology.orchestra.run.trial096.stdout:systemctl: stdout static 2026-02-13T03:31:57.756 INFO:teuthology.orchestra.run.trial096.stdout:Non-zero exit code 3 from systemctl is-active logrotate 2026-02-13T03:31:57.756 INFO:teuthology.orchestra.run.trial096.stdout:systemctl: stdout inactive 2026-02-13T03:31:57.756 INFO:teuthology.orchestra.run.trial096.stdout:Enabling the logrotate.timer service to perform daily log rotation. 2026-02-13T03:31:57.903 INFO:tasks.cephadm:Fetching config... 2026-02-13T03:31:57.903 DEBUG:teuthology.orchestra.run.trial096:> set -ex 2026-02-13T03:31:57.903 DEBUG:teuthology.orchestra.run.trial096:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-13T03:31:57.918 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-13T03:31:57.918 DEBUG:teuthology.orchestra.run.trial096:> set -ex 2026-02-13T03:31:57.918 DEBUG:teuthology.orchestra.run.trial096:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-13T03:31:57.976 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-13T03:31:57.976 DEBUG:teuthology.orchestra.run.trial096:> set -ex 2026-02-13T03:31:57.976 DEBUG:teuthology.orchestra.run.trial096:> sudo dd if=/var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-13T03:31:58.039 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-13T03:31:58.039 DEBUG:teuthology.orchestra.run.trial096:> set -ex 2026-02-13T03:31:58.039 DEBUG:teuthology.orchestra.run.trial096:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-13T03:31:58.096 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-13T03:31:58.096 DEBUG:teuthology.orchestra.run.trial096:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEJF/w873odh/g8jmHyM0RrJGwGKDbVEu4Wwhbh9w0cH ceph-7c123de8-088c-11f1-84f7-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T03:31:58.171 INFO:teuthology.orchestra.run.trial096.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEJF/w873odh/g8jmHyM0RrJGwGKDbVEu4Wwhbh9w0cH ceph-7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:31:58.181 DEBUG:teuthology.orchestra.run.trial132:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEJF/w873odh/g8jmHyM0RrJGwGKDbVEu4Wwhbh9w0cH ceph-7c123de8-088c-11f1-84f7-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T03:31:58.215 INFO:teuthology.orchestra.run.trial132.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEJF/w873odh/g8jmHyM0RrJGwGKDbVEu4Wwhbh9w0cH ceph-7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:31:58.224 DEBUG:teuthology.orchestra.run.trial133:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEJF/w873odh/g8jmHyM0RrJGwGKDbVEu4Wwhbh9w0cH ceph-7c123de8-088c-11f1-84f7-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T03:31:58.258 INFO:teuthology.orchestra.run.trial133.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEJF/w873odh/g8jmHyM0RrJGwGKDbVEu4Wwhbh9w0cH ceph-7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:31:58.267 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-13T03:31:58.379 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:31:58.646 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-13T03:31:58.646 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-13T03:31:58.760 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:31:58.876 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:58 trial096 ceph-mon[24671]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:31:58.876 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:58 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1337767400' entity='client.admin' 2026-02-13T03:31:58.876 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:58 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:31:58.876 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:58 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/4293466587' entity='client.admin' 2026-02-13T03:31:59.031 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial132 2026-02-13T03:31:59.031 DEBUG:teuthology.orchestra.run.trial132:> set -ex 2026-02-13T03:31:59.031 DEBUG:teuthology.orchestra.run.trial132:> dd of=/etc/ceph/ceph.conf 2026-02-13T03:31:59.048 DEBUG:teuthology.orchestra.run.trial132:> set -ex 2026-02-13T03:31:59.048 DEBUG:teuthology.orchestra.run.trial132:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T03:31:59.104 INFO:tasks.cephadm:Adding host trial132 to orchestrator... 2026-02-13T03:31:59.104 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph orch host add trial132 2026-02-13T03:31:59.224 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:31:59.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:59 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:31:59.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:59 trial096 ceph-mon[24671]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:31:59.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:59 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:31:59.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:59 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:31:59.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:59 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:31:59.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:59 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:31:59.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:59 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:31:59.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:59 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial096", "name": "osd_memory_target"} : dispatch 2026-02-13T03:31:59.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:59 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:31:59.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:31:59 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:01.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:00 trial096 ceph-mon[24671]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial132", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:32:01.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:00 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:01.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:00 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:01.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:00 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:01.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:00 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:01.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:00 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:01.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:00 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:01.171 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:00 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:01.275 INFO:teuthology.orchestra.run.trial096.stdout:Added host 'trial132' with addr '10.20.193.132' 2026-02-13T03:32:01.320 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-13T03:32:01.436 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:01.649 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:32:01.650 INFO:teuthology.orchestra.run.trial096.stdout:[{"addr": "10.20.193.96", "hostname": "trial096", "labels": [], "status": ""}, {"addr": "10.20.193.132", "hostname": "trial132", "labels": [], "status": ""}] 2026-02-13T03:32:01.691 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial133 2026-02-13T03:32:01.691 DEBUG:teuthology.orchestra.run.trial133:> set -ex 2026-02-13T03:32:01.691 DEBUG:teuthology.orchestra.run.trial133:> dd of=/etc/ceph/ceph.conf 2026-02-13T03:32:01.709 DEBUG:teuthology.orchestra.run.trial133:> set -ex 2026-02-13T03:32:01.710 DEBUG:teuthology.orchestra.run.trial133:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T03:32:01.765 INFO:tasks.cephadm:Adding host trial133 to orchestrator... 2026-02-13T03:32:01.766 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph orch host add trial133 2026-02-13T03:32:01.883 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:02.670 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:02 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:02.670 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:02 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:02.670 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:02 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:02.670 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:02 trial096 ceph-mon[24671]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:32:02.670 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:02 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:03.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:03 trial096 ceph-mon[24671]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial133", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:32:03.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:03 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:03.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:03 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:03.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:03 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:03.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:03 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:03.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:03 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:03.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:03 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial132", "name": "osd_memory_target"} : dispatch 2026-02-13T03:32:03.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:03 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:03.921 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:03 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:04.045 INFO:teuthology.orchestra.run.trial096.stdout:Added host 'trial133' with addr '10.20.193.133' 2026-02-13T03:32:04.089 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-13T03:32:04.206 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:04.420 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:32:04.421 INFO:teuthology.orchestra.run.trial096.stdout:[{"addr": "10.20.193.96", "hostname": "trial096", "labels": [], "status": ""}, {"addr": "10.20.193.132", "hostname": "trial132", "labels": [], "status": ""}, {"addr": "10.20.193.133", "hostname": "trial133", "labels": [], "status": ""}] 2026-02-13T03:32:04.474 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-13T03:32:04.474 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd crush tunables default 2026-02-13T03:32:04.591 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:05.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:05 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:05.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:05 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:05.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:05 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:05.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:05 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:05.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:05 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:05.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:05 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:05.421 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:05 trial096 ceph-mon[24671]: from='client.14158 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:32:05.421 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:05 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:05.421 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:05 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2064881194' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-13T03:32:05.647 INFO:teuthology.orchestra.run.trial096.stderr:adjusted tunables profile to default 2026-02-13T03:32:05.694 INFO:tasks.cephadm:Adding mon.a on trial096 2026-02-13T03:32:05.694 INFO:tasks.cephadm:Adding mon.b on trial132 2026-02-13T03:32:05.694 INFO:tasks.cephadm:Adding mon.c on trial133 2026-02-13T03:32:05.695 DEBUG:teuthology.orchestra.run.trial133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph orch apply mon '3;trial096:10.20.193.96=a;trial132:10.20.193.132=b;trial133:10.20.193.133=c' 2026-02-13T03:32:05.812 INFO:teuthology.orchestra.run.trial133.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T03:32:05.812 INFO:teuthology.orchestra.run.trial133.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T03:32:06.036 INFO:teuthology.orchestra.run.trial133.stdout:Scheduled mon update... 2026-02-13T03:32:06.077 DEBUG:teuthology.orchestra.run.trial132:mon.b> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mon.b.service 2026-02-13T03:32:06.080 DEBUG:teuthology.orchestra.run.trial133:mon.c> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mon.c.service 2026-02-13T03:32:06.082 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T03:32:06.082 DEBUG:teuthology.orchestra.run.trial133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T03:32:06.252 INFO:teuthology.orchestra.run.trial133.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T03:32:06.253 INFO:teuthology.orchestra.run.trial133.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T03:32:06.578 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:32:06.578 INFO:teuthology.orchestra.run.trial133.stdout:{"epoch":1,"fsid":"7c123de8-088c-11f1-84f7-d404e6e7d460","modified":"2026-02-13T03:31:44.703334Z","created":"2026-02-13T03:31:44.703334Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:3300","nonce":0},{"type":"v1","addr":"10.20.193.96:6789","nonce":0}]},"addr":"10.20.193.96:6789/0","public_addr":"10.20.193.96:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T03:31:44:703344+0000","crush_location":[]}],"quorum":[0]} 2026-02-13T03:32:06.578 INFO:teuthology.orchestra.run.trial133.stderr:dumped monmap epoch 1 2026-02-13T03:32:06.669 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:06.670 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:06 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2064881194' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-13T03:32:06.670 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:06 trial096 ceph-mon[24671]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T03:32:06.670 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:06.670 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:06.670 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:06.670 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:06.670 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:06.670 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial133", "name": "osd_memory_target"} : dispatch 2026-02-13T03:32:06.671 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:06.671 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:07.619 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T03:32:07.619 DEBUG:teuthology.orchestra.run.trial133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T03:32:07.669 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:07 trial096 ceph-mon[24671]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;trial096:10.20.193.96=a;trial132:10.20.193.132=b;trial133:10.20.193.133=c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:32:07.670 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:07 trial096 ceph-mon[24671]: from='client.? 10.20.193.133:0/669998166' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T03:32:07.670 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:07 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:07.670 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:07 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:07.670 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:07 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:07.670 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:07 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:32:07.670 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:07 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:07.820 INFO:teuthology.orchestra.run.trial133.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.c/config 2026-02-13T03:32:08.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:08 trial133 ceph-mon[26943]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-13T03:32:13.053 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:32:13.054 INFO:teuthology.orchestra.run.trial133.stdout:{"epoch":2,"fsid":"7c123de8-088c-11f1-84f7-d404e6e7d460","modified":"2026-02-13T03:32:08.049670Z","created":"2026-02-13T03:31:44.703334Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:3300","nonce":0},{"type":"v1","addr":"10.20.193.96:6789","nonce":0}]},"addr":"10.20.193.96:6789/0","public_addr":"10.20.193.96:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T03:31:44:703344+0000","crush_location":[]},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:3300","nonce":0},{"type":"v1","addr":"10.20.193.133:6789","nonce":0}]},"addr":"10.20.193.133:6789/0","public_addr":"10.20.193.133:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T03:32:08:049668+0000","crush_location":[]}],"quorum":[0,1]} 2026-02-13T03:32:13.054 INFO:teuthology.orchestra.run.trial133.stderr:dumped monmap epoch 2 2026-02-13T03:32:13.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:32:13.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: mon.a calling monitor election 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: from='client.? 10.20.193.133:0/2642249290' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: mon.c calling monitor election 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: monmap epoch 2 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: last_changed 2026-02-13T03:32:08.049670+0000 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: created 2026-02-13T03:31:44.703334+0000 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: min_mon_release 20 (tentacle) 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: election_strategy: 1 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: 0: [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] mon.a 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: 1: [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] mon.c 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: fsmap 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: mgrmap e8: x(active, since 21s) 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: overall HEALTH_OK 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:32:13.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: mon.a calling monitor election 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: from='client.? 10.20.193.133:0/2642249290' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: mon.c calling monitor election 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: monmap epoch 2 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: last_changed 2026-02-13T03:32:08.049670+0000 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: created 2026-02-13T03:31:44.703334+0000 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: min_mon_release 20 (tentacle) 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: election_strategy: 1 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: 0: [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] mon.a 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: 1: [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] mon.c 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: fsmap 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: mgrmap e8: x(active, since 21s) 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: overall HEALTH_OK 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:32:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:14.121 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T03:32:14.121 DEBUG:teuthology.orchestra.run.trial133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T03:32:14.251 INFO:teuthology.orchestra.run.trial133.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.c/config 2026-02-13T03:32:14.360 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:14 trial133 ceph-mon[26943]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:14.361 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:14 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:14.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:14 trial096 ceph-mon[24671]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:14.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:14 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:14.744 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:32:14.745 INFO:teuthology.orchestra.run.trial133.stdout:{"epoch":2,"fsid":"7c123de8-088c-11f1-84f7-d404e6e7d460","modified":"2026-02-13T03:32:08.049670Z","created":"2026-02-13T03:31:44.703334Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:3300","nonce":0},{"type":"v1","addr":"10.20.193.96:6789","nonce":0}]},"addr":"10.20.193.96:6789/0","public_addr":"10.20.193.96:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T03:31:44:703344+0000","crush_location":[]},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:3300","nonce":0},{"type":"v1","addr":"10.20.193.133:6789","nonce":0}]},"addr":"10.20.193.133:6789/0","public_addr":"10.20.193.133:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T03:32:08:049668+0000","crush_location":[]}],"quorum":[0,1]} 2026-02-13T03:32:14.745 INFO:teuthology.orchestra.run.trial133.stderr:dumped monmap epoch 2 2026-02-13T03:32:14.808 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:14 trial132 ceph-mon[26888]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-13T03:32:14.808 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:14 trial132 bash[26859]: 5d5a934445caea8ac76c7ea3c1fbc1d94dbca7c22c5e277c27eb2c27b0b75c0c 2026-02-13T03:32:15.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:14 trial132 systemd[1]: Started Ceph mon.b for 7c123de8-088c-11f1-84f7-d404e6e7d460. 2026-02-13T03:32:15.827 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T03:32:15.827 DEBUG:teuthology.orchestra.run.trial133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T03:32:15.948 INFO:teuthology.orchestra.run.trial133.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.c/config 2026-02-13T03:32:20.166 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: mon.c calling monitor election 2026-02-13T03:32:20.167 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:20.167 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:32:20.167 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:20.167 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: mon.a calling monitor election 2026-02-13T03:32:20.167 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:20.167 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: mon.b calling monitor election 2026-02-13T03:32:20.167 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:20.167 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:20.167 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:20.167 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:20.167 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:20.167 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:20.167 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:20.167 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-13T03:32:20.167 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: monmap epoch 3 2026-02-13T03:32:20.167 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:32:20.167 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: last_changed 2026-02-13T03:32:14.758278+0000 2026-02-13T03:32:20.167 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: created 2026-02-13T03:31:44.703334+0000 2026-02-13T03:32:20.167 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: min_mon_release 20 (tentacle) 2026-02-13T03:32:20.167 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: election_strategy: 1 2026-02-13T03:32:20.168 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: 0: [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] mon.a 2026-02-13T03:32:20.168 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: 1: [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] mon.c 2026-02-13T03:32:20.168 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: 2: [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] mon.b 2026-02-13T03:32:20.168 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: fsmap 2026-02-13T03:32:20.168 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T03:32:20.168 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: mgrmap e8: x(active, since 27s) 2026-02-13T03:32:20.168 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: overall HEALTH_OK 2026-02-13T03:32:20.168 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:20.168 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:20.168 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:20.168 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:19 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:20.168 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: mon.c calling monitor election 2026-02-13T03:32:20.168 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:20.168 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:32:20.168 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:20.168 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: mon.a calling monitor election 2026-02-13T03:32:20.168 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:20.168 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: mon.b calling monitor election 2026-02-13T03:32:20.168 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:20.169 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:20.169 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:20.169 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:20.169 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:20.169 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:20.169 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:20.169 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-13T03:32:20.169 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: monmap epoch 3 2026-02-13T03:32:20.169 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:32:20.169 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: last_changed 2026-02-13T03:32:14.758278+0000 2026-02-13T03:32:20.169 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: created 2026-02-13T03:31:44.703334+0000 2026-02-13T03:32:20.169 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: min_mon_release 20 (tentacle) 2026-02-13T03:32:20.169 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: election_strategy: 1 2026-02-13T03:32:20.169 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: 0: [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] mon.a 2026-02-13T03:32:20.169 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: 1: [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] mon.c 2026-02-13T03:32:20.169 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: 2: [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] mon.b 2026-02-13T03:32:20.169 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: fsmap 2026-02-13T03:32:20.169 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T03:32:20.169 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: mgrmap e8: x(active, since 27s) 2026-02-13T03:32:20.169 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: overall HEALTH_OK 2026-02-13T03:32:20.169 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:20.169 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:20.169 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:20.169 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:19 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:20.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: mon.c calling monitor election 2026-02-13T03:32:20.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:20.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:32:20.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:20.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: mon.a calling monitor election 2026-02-13T03:32:20.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:20.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: mon.b calling monitor election 2026-02-13T03:32:20.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:20.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:20.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:20.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:20.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:20.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:20.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:20.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-13T03:32:20.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: monmap epoch 3 2026-02-13T03:32:20.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:32:20.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: last_changed 2026-02-13T03:32:14.758278+0000 2026-02-13T03:32:20.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: created 2026-02-13T03:31:44.703334+0000 2026-02-13T03:32:20.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: min_mon_release 20 (tentacle) 2026-02-13T03:32:20.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: election_strategy: 1 2026-02-13T03:32:20.171 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: 0: [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] mon.a 2026-02-13T03:32:20.171 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: 1: [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] mon.c 2026-02-13T03:32:20.171 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: 2: [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] mon.b 2026-02-13T03:32:20.171 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: fsmap 2026-02-13T03:32:20.171 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T03:32:20.171 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: mgrmap e8: x(active, since 27s) 2026-02-13T03:32:20.171 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: overall HEALTH_OK 2026-02-13T03:32:20.171 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:20.171 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:20.171 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:20.171 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:19 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:20.609 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:32:20.610 INFO:teuthology.orchestra.run.trial133.stdout:{"epoch":3,"fsid":"7c123de8-088c-11f1-84f7-d404e6e7d460","modified":"2026-02-13T03:32:14.758278Z","created":"2026-02-13T03:31:44.703334Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:3300","nonce":0},{"type":"v1","addr":"10.20.193.96:6789","nonce":0}]},"addr":"10.20.193.96:6789/0","public_addr":"10.20.193.96:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T03:31:44:703344+0000","crush_location":[]},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:3300","nonce":0},{"type":"v1","addr":"10.20.193.133:6789","nonce":0}]},"addr":"10.20.193.133:6789/0","public_addr":"10.20.193.133:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T03:32:08:049668+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:3300","nonce":0},{"type":"v1","addr":"10.20.193.132:6789","nonce":0}]},"addr":"10.20.193.132:6789/0","public_addr":"10.20.193.132:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T03:32:14:758276+0000","crush_location":[]}],"quorum":[0,1,2]} 2026-02-13T03:32:20.610 INFO:teuthology.orchestra.run.trial133.stderr:dumped monmap epoch 3 2026-02-13T03:32:20.650 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-13T03:32:20.650 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-13T03:32:20.769 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:20.928 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:20 trial096 ceph-mon[24671]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:20.928 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:20 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:20.928 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:20 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:20.928 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:20 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:20.928 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:20 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:20.928 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:20 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:20.928 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:20 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:20.929 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:20 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:20.929 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:20 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:20.929 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:20 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:20.929 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:20 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:20.929 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:20 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:20.929 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:20 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:20.929 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:20 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:20.929 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:20 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:20.929 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:20 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:32:20.929 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:20 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:32:20.929 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:20 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:20.930 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:20 trial096 ceph-mon[24671]: from='client.? 10.20.193.133:0/236761548' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T03:32:20.930 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:20 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:20.993 INFO:teuthology.orchestra.run.trial096.stdout:# minimal ceph.conf for 7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:32:20.993 INFO:teuthology.orchestra.run.trial096.stdout:[global] 2026-02-13T03:32:20.994 INFO:teuthology.orchestra.run.trial096.stdout: fsid = 7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:32:20.994 INFO:teuthology.orchestra.run.trial096.stdout: mon_host = [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] 2026-02-13T03:32:21.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:20 trial133 ceph-mon[26943]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:21.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:20 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:21.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:20 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:21.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:20 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:21.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:20 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:21.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:20 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:21.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:20 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:21.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:20 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:21.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:20 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:21.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:20 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:21.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:20 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:21.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:20 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:21.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:20 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:21.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:20 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:21.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:20 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:21.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:20 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:32:21.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:20 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:32:21.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:20 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:21.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:20 trial133 ceph-mon[26943]: from='client.? 10.20.193.133:0/236761548' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T03:32:21.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:20 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:21.036 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-13T03:32:21.036 DEBUG:teuthology.orchestra.run.trial096:> set -ex 2026-02-13T03:32:21.036 DEBUG:teuthology.orchestra.run.trial096:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T03:32:21.063 DEBUG:teuthology.orchestra.run.trial096:> set -ex 2026-02-13T03:32:21.063 DEBUG:teuthology.orchestra.run.trial096:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T03:32:21.128 DEBUG:teuthology.orchestra.run.trial132:> set -ex 2026-02-13T03:32:21.128 DEBUG:teuthology.orchestra.run.trial132:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T03:32:21.150 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:20 trial132 ceph-mon[26888]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:21.151 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:20 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:21.151 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:20 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:21.151 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:20 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:21.151 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:20 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:21.151 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:20 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:21.151 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:20 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:21.151 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:20 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:21.151 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:20 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:21.151 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:20 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:21.152 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:20 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:21.152 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:20 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:21.152 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:20 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:21.152 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:20 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:21.152 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:20 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:21.152 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:20 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:32:21.152 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:20 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:32:21.152 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:20 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:21.152 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:20 trial132 ceph-mon[26888]: from='client.? 10.20.193.133:0/236761548' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T03:32:21.152 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:20 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:21.155 DEBUG:teuthology.orchestra.run.trial132:> set -ex 2026-02-13T03:32:21.155 DEBUG:teuthology.orchestra.run.trial132:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T03:32:21.220 DEBUG:teuthology.orchestra.run.trial133:> set -ex 2026-02-13T03:32:21.220 DEBUG:teuthology.orchestra.run.trial133:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T03:32:21.249 DEBUG:teuthology.orchestra.run.trial133:> set -ex 2026-02-13T03:32:21.249 DEBUG:teuthology.orchestra.run.trial133:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T03:32:21.313 INFO:tasks.cephadm:Adding mgr.x on trial096 2026-02-13T03:32:21.313 INFO:tasks.cephadm:Adding mgr.y on trial132 2026-02-13T03:32:21.313 INFO:tasks.cephadm:Adding mgr.z on trial133 2026-02-13T03:32:21.313 DEBUG:teuthology.orchestra.run.trial133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph orch apply mgr '3;trial096=x;trial132=y;trial133=z' 2026-02-13T03:32:21.466 INFO:teuthology.orchestra.run.trial133.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.c/config 2026-02-13T03:32:21.704 INFO:teuthology.orchestra.run.trial133.stdout:Scheduled mgr update... 2026-02-13T03:32:21.747 DEBUG:teuthology.orchestra.run.trial132:mgr.y> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mgr.y.service 2026-02-13T03:32:21.750 DEBUG:teuthology.orchestra.run.trial133:mgr.z> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mgr.z.service 2026-02-13T03:32:21.753 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2026-02-13T03:32:21.753 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set client client_mount_timeout 600 2026-02-13T03:32:21.756 INFO:tasks.cephadm:setting config [client] debug_client = 20 2026-02-13T03:32:21.756 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set client debug_client 20 2026-02-13T03:32:21.798 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2026-02-13T03:32:21.798 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set client debug_ms 1 2026-02-13T03:32:21.841 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2026-02-13T03:32:21.841 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set client rados_mon_op_timeout 900 2026-02-13T03:32:21.870 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:21.871 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2026-02-13T03:32:21.872 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set client rados_osd_op_timeout 900 2026-02-13T03:32:21.912 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:21.913 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2026-02-13T03:32:21.914 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set mds debug_mds 20 2026-02-13T03:32:21.956 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2026-02-13T03:32:21.956 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set mds debug_mds_balancer 20 2026-02-13T03:32:21.962 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:21.962 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2026-02-13T03:32:21.963 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set mds debug_ms 2 2026-02-13T03:32:21.991 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:21.992 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2026-02-13T03:32:21.992 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set mds mds_bal_fragment_size_max 10000 2026-02-13T03:32:22.026 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:22.026 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:22.026 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:32:22.026 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:32:22.026 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:22.026 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:21 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3483168723' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:22.026 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:22.026 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:22.026 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:32:22.026 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:32:22.026 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:22.026 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:22.026 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:22.026 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:22.026 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:22.026 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:22.026 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:22.026 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:22.026 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:32:22.026 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T03:32:22.026 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:32:22.026 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:22.027 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2026-02-13T03:32:22.027 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set mds mds_bal_merge_size 5 2026-02-13T03:32:22.039 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:22.040 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2026-02-13T03:32:22.040 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set mds mds_bal_split_bits 3 2026-02-13T03:32:22.083 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2026-02-13T03:32:22.083 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set mds mds_bal_split_size 100 2026-02-13T03:32:22.088 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:22.089 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:22.089 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:22.089 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:32:22.089 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:32:22.089 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:22.089 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:21 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3483168723' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:22.090 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:22.090 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:22.090 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:32:22.090 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:32:22.090 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:22.090 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:22.090 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:22.090 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:22.090 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:22.090 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:22.090 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:22.090 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:22.091 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:32:22.091 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T03:32:22.091 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:32:22.091 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:22.092 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2026-02-13T03:32:22.092 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set mds mds_debug_frag True 2026-02-13T03:32:22.093 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:22.125 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:22.126 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2026-02-13T03:32:22.126 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set mds mds_debug_scatterstat True 2026-02-13T03:32:22.169 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:22.171 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2026-02-13T03:32:22.171 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set mds mds_op_complaint_time 180 2026-02-13T03:32:22.181 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:22.183 INFO:tasks.cephadm:setting config [mds] mds_use_global_snaprealm_seq_for_subvol = False 2026-02-13T03:32:22.183 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set mds mds_use_global_snaprealm_seq_for_subvol False 2026-02-13T03:32:22.196 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2026-02-13T03:32:22.196 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set mds mds_verify_scatter True 2026-02-13T03:32:22.218 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.220+0000 7fcca87c06c0 1 -- 10.20.193.96:0/676079490 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcc7c03f8f0 msgr2=0x7fcc7c05fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.218 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.220+0000 7fcca87c06c0 1 --2- 10.20.193.96:0/676079490 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcc7c03f8f0 0x7fcc7c05fda0 secure :-1 s=READY pgs=49 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc94005980 tx=0x7fcc94005910 comp rx=0 tx=0).stop 2026-02-13T03:32:22.218 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.220+0000 7fcca87c06c0 1 -- 10.20.193.96:0/676079490 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcca010eed0 msgr2=0x7fcca00f87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.218 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.220+0000 7fcca87c06c0 1 --2- 10.20.193.96:0/676079490 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcca010eed0 0x7fcca00f87b0 secure :-1 s=READY pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc9002fbf0 tx=0x7fcc90004750 comp rx=0 tx=0).stop 2026-02-13T03:32:22.218 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.220+0000 7fcca87c06c0 1 -- 10.20.193.96:0/676079490 shutdown_connections 2026-02-13T03:32:22.219 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.220+0000 7fcca87c06c0 1 --2- 10.20.193.96:0/676079490 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcc7c03f8f0 0x7fcc7c05fda0 unknown :-1 s=CLOSED pgs=49 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.219 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.220+0000 7fcca87c06c0 1 --2- 10.20.193.96:0/676079490 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fcca0110a00 0x7fcca00f9010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.219 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.220+0000 7fcca87c06c0 1 --2- 10.20.193.96:0/676079490 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fcca0110050 0x7fcca0171390 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.219 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.220+0000 7fcca87c06c0 1 --2- 10.20.193.96:0/676079490 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcca010eed0 0x7fcca00f87b0 unknown :-1 s=CLOSED pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.219 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.220+0000 7fcca87c06c0 1 -- 10.20.193.96:0/676079490 >> 10.20.193.96:0/676079490 conn(0x7fcca00ec5f0 msgr2=0x7fcca00eed30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.219 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.220+0000 7fcca87c06c0 1 -- 10.20.193.96:0/676079490 shutdown_connections 2026-02-13T03:32:22.220 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.221+0000 7fcca87c06c0 1 -- 10.20.193.96:0/676079490 wait complete. 2026-02-13T03:32:22.222 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2026-02-13T03:32:22.222 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set mds osd_op_complaint_time 180 2026-02-13T03:32:22.229 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:22.231 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2026-02-13T03:32:22.231 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set mds rados_mon_op_timeout 900 2026-02-13T03:32:22.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:22.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:22.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:32:22.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:32:22.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:22.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:21 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3483168723' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:22.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:22.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:22.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:32:22.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:32:22.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:22.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:22.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:22.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:22.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:22.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:22.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:22.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:22.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:32:22.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T03:32:22.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:32:22.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:22.236 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:22.239 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2026-02-13T03:32:22.240 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set mds rados_osd_op_timeout 900 2026-02-13T03:32:22.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.243+0000 7fdb488256c0 1 -- 10.20.193.96:0/2792439199 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fdb40171aa0 con 0x7fdb4010e780 2026-02-13T03:32:22.244 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.246+0000 7fdb2b7fe6c0 1 -- 10.20.193.96:0/2792439199 <== mon.0 v2:10.20.193.96:3300/0 10 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7fdb34012030 con 0x7fdb4010e780 2026-02-13T03:32:22.246 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2026-02-13T03:32:22.247 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set mgr client_mount_timeout 30 2026-02-13T03:32:22.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.247+0000 7fdb2b7fe6c0 1 -- 10.20.193.96:0/2792439199 <== mon.0 v2:10.20.193.96:3300/0 11 ==== config(27 keys) ==== 1115+0+0 (secure 0 0 0) 0x7fdb34012030 con 0x7fdb4010e780 2026-02-13T03:32:22.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.247+0000 7fef4affd6c0 1 -- 10.20.193.96:0/4118340054 <== mon.0 v2:10.20.193.96:3300/0 8 ==== config(27 keys) ==== 1115+0+0 (secure 0 0 0) 0x7fef58035030 con 0x7fef5c10e780 2026-02-13T03:32:22.249 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.250+0000 7fdb488256c0 1 -- 10.20.193.96:0/2792439199 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fdb1c03f8f0 msgr2=0x7fdb1c05fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.250+0000 7fdb488256c0 1 --2- 10.20.193.96:0/2792439199 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fdb1c03f8f0 0x7fdb1c05fda0 secure :-1 s=READY pgs=50 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb380098c0 tx=0x7fdb380023a0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.250+0000 7fdb488256c0 1 -- 10.20.193.96:0/2792439199 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdb4010e780 msgr2=0x7fdb400f90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.250+0000 7fdb488256c0 1 --2- 10.20.193.96:0/2792439199 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdb4010e780 0x7fdb400f90d0 secure :-1 s=READY pgs=92 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb34006ea0 tx=0x7fdb3400cca0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.250+0000 7fdb488256c0 1 -- 10.20.193.96:0/2792439199 shutdown_connections 2026-02-13T03:32:22.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.250+0000 7fdb488256c0 1 --2- 10.20.193.96:0/2792439199 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fdb1c03f8f0 0x7fdb1c05fda0 unknown :-1 s=CLOSED pgs=50 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.250+0000 7fdb488256c0 1 --2- 10.20.193.96:0/2792439199 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdb4010e780 0x7fdb400f90d0 unknown :-1 s=CLOSED pgs=92 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.250+0000 7fdb488256c0 1 --2- 10.20.193.96:0/2792439199 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fdb4010ddd0 0x7fdb4016f110 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.250+0000 7fdb488256c0 1 --2- 10.20.193.96:0/2792439199 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fdb4010cc50 0x7fdb400f8870 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.251 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.250+0000 7fdb488256c0 1 -- 10.20.193.96:0/2792439199 >> 10.20.193.96:0/2792439199 conn(0x7fdb400ea370 msgr2=0x7fdb40061830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.251 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.251+0000 7fdb488256c0 1 -- 10.20.193.96:0/2792439199 shutdown_connections 2026-02-13T03:32:22.251 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.251+0000 7fdb488256c0 1 -- 10.20.193.96:0/2792439199 wait complete. 2026-02-13T03:32:22.252 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2026-02-13T03:32:22.252 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set mgr debug_client 20 2026-02-13T03:32:22.261 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.263+0000 7f4f966fb6c0 1 -- 10.20.193.96:0/1187747251 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4f9010eed0 msgr2=0x7f4f9010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.261 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.263+0000 7f4f966fb6c0 1 --2- 10.20.193.96:0/1187747251 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4f9010eed0 0x7f4f9010f2c0 secure :-1 s=READY pgs=95 gs=1 cs=0 l=1 c_cookie=12849601657006955520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f84014f00 tx=0x7f4f84038810 comp rx=0 tx=0).stop 2026-02-13T03:32:22.263 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2026-02-13T03:32:22.263 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set mgr debug_mgr 20 2026-02-13T03:32:22.267 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.265+0000 7f4f966fb6c0 1 -- 10.20.193.96:0/1187747251 shutdown_connections 2026-02-13T03:32:22.267 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.265+0000 7f4f966fb6c0 1 --2- 10.20.193.96:0/1187747251 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4f90110a00 0x7f4f90171390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.267 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.265+0000 7f4f966fb6c0 1 --2- 10.20.193.96:0/1187747251 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4f90110050 0x7f4f901104c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.268 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.265+0000 7f4f966fb6c0 1 --2- 10.20.193.96:0/1187747251 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4f9010eed0 0x7f4f9010f2c0 unknown :-1 s=CLOSED pgs=95 gs=1 cs=0 l=1 c_cookie=12849601657006955520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.268 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.265+0000 7f4f966fb6c0 1 -- 10.20.193.96:0/1187747251 >> 10.20.193.96:0/1187747251 conn(0x7f4f900ec5f0 msgr2=0x7f4f9010ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.268 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.265+0000 7f4f966fb6c0 1 -- 10.20.193.96:0/1187747251 shutdown_connections 2026-02-13T03:32:22.268 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.265+0000 7f4f966fb6c0 1 -- 10.20.193.96:0/1187747251 wait complete. 2026-02-13T03:32:22.268 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.265+0000 7f4f966fb6c0 1 Processor -- start 2026-02-13T03:32:22.268 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.266+0000 7f4f966fb6c0 1 -- start start 2026-02-13T03:32:22.268 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.266+0000 7f4f966fb6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4f9010eed0 0x7f4f90100a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.268 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.266+0000 7f4f966fb6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4f90110050 0x7f4f90171370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.268 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.266+0000 7f4f966fb6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4f90110a00 0x7f4f90101280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.268 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.266+0000 7f4f966fb6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4f90101ed0 con 0x7f4f90110a00 2026-02-13T03:32:22.268 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.266+0000 7f4f966fb6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4f90102010 con 0x7f4f9010eed0 2026-02-13T03:32:22.269 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.266+0000 7f4f966fb6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4f901021a0 con 0x7f4f90110050 2026-02-13T03:32:22.269 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.266+0000 7f4f94c6d6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4f90110a00 0x7f4f90101280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.269 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.266+0000 7f4f94c6d6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4f90110a00 0x7f4f90101280 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:58640/0 (socket says 10.20.193.96:58640) 2026-02-13T03:32:22.269 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.266+0000 7f4f94c6d6c0 1 -- 10.20.193.96:0/2171758879 learned_addr learned my addr 10.20.193.96:0/2171758879 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:22.269 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.266+0000 7f4f94c6d6c0 1 -- 10.20.193.96:0/2171758879 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4f90110050 msgr2=0x7f4f90171370 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:32:22.269 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.266+0000 7f4f94c6d6c0 1 --2- 10.20.193.96:0/2171758879 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4f90110050 0x7f4f90171370 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.269 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.266+0000 7f4f94c6d6c0 1 -- 10.20.193.96:0/2171758879 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4f9010eed0 msgr2=0x7f4f90100a40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:32:22.269 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.266+0000 7f4f94c6d6c0 1 --2- 10.20.193.96:0/2171758879 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4f9010eed0 0x7f4f90100a40 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.269 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.266+0000 7f4f94c6d6c0 1 -- 10.20.193.96:0/2171758879 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f84014b20 con 0x7f4f90110a00 2026-02-13T03:32:22.269 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.267+0000 7f4f94c6d6c0 1 --2- 10.20.193.96:0/2171758879 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4f90110a00 0x7f4f90101280 secure :-1 s=READY pgs=96 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f74005dc0 tx=0x7f4f7400bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.269 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.267+0000 7f4f8d7fa6c0 1 -- 10.20.193.96:0/2171758879 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4f74004250 con 0x7f4f90110a00 2026-02-13T03:32:22.270 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.267+0000 7f4f8d7fa6c0 1 -- 10.20.193.96:0/2171758879 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(27 keys) ==== 1115+0+0 (secure 0 0 0) 0x7f4f74009070 con 0x7f4f90110a00 2026-02-13T03:32:22.270 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.267+0000 7f4f8d7fa6c0 1 -- 10.20.193.96:0/2171758879 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4f7400cd30 con 0x7f4f90110a00 2026-02-13T03:32:22.270 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.268+0000 7fbb30ff06c0 1 -- 10.20.193.96:0/2448715259 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbb2c113f10 msgr2=0x7fbb2c175870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.270 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.268+0000 7fbb30ff06c0 1 --2- 10.20.193.96:0/2448715259 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbb2c113f10 0x7fbb2c175870 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=16292602720242025748 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb1c00aa40 tx=0x7fbb1c02fde0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.271 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2026-02-13T03:32:22.271 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set mgr debug_ms 1 2026-02-13T03:32:22.272 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.269+0000 7f4f966fb6c0 1 -- 10.20.193.96:0/2171758879 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f90102480 con 0x7f4f90110a00 2026-02-13T03:32:22.272 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.269+0000 7f4f966fb6c0 1 -- 10.20.193.96:0/2171758879 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f901028e0 con 0x7f4f90110a00 2026-02-13T03:32:22.272 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.269+0000 7f4f966fb6c0 1 -- 10.20.193.96:0/2171758879 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f90065c50 con 0x7f4f90110a00 2026-02-13T03:32:22.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.271+0000 7fbb30ff06c0 1 -- 10.20.193.96:0/2448715259 shutdown_connections 2026-02-13T03:32:22.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.271+0000 7fbb30ff06c0 1 --2- 10.20.193.96:0/2448715259 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbb2c113f10 0x7fbb2c175870 unknown :-1 s=CLOSED pgs=97 gs=1 cs=0 l=1 c_cookie=16292602720242025748 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.271+0000 7fbb30ff06c0 1 --2- 10.20.193.96:0/2448715259 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fbb2c113560 0x7fbb2c1139d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.271+0000 7fbb30ff06c0 1 --2- 10.20.193.96:0/2448715259 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fbb2c1147f0 0x7fbb2c114be0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.271+0000 7fbb30ff06c0 1 -- 10.20.193.96:0/2448715259 >> 10.20.193.96:0/2448715259 conn(0x7fbb2c064300 msgr2=0x7fbb2c064700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.271+0000 7fbb30ff06c0 1 -- 10.20.193.96:0/2448715259 shutdown_connections 2026-02-13T03:32:22.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.272+0000 7fbb30ff06c0 1 -- 10.20.193.96:0/2448715259 wait complete. 2026-02-13T03:32:22.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.272+0000 7fbb30ff06c0 1 Processor -- start 2026-02-13T03:32:22.276 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.272+0000 7fbb30ff06c0 1 -- start start 2026-02-13T03:32:22.276 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.273+0000 7fbb30ff06c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbb2c113560 0x7fbb2c059680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.276 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.273+0000 7fbb30ff06c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fbb2c113f10 0x7fbb2c175850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.276 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.273+0000 7fbb30ff06c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fbb2c1147f0 0x7fbb2c059ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.276 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.273+0000 7fbb30ff06c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2c05ab10 con 0x7fbb2c113560 2026-02-13T03:32:22.276 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.273+0000 7fbb30ff06c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2c05ac80 con 0x7fbb2c113f10 2026-02-13T03:32:22.276 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.273+0000 7fbb30ff06c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2c05ae40 con 0x7fbb2c1147f0 2026-02-13T03:32:22.276 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.273+0000 7fbb2a5756c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbb2c113560 0x7fbb2c059680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.276 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.273+0000 7fbb2a5756c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbb2c113560 0x7fbb2c059680 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:58666/0 (socket says 10.20.193.96:58666) 2026-02-13T03:32:22.276 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.273+0000 7fbb2a5756c0 1 -- 10.20.193.96:0/4142347136 learned_addr learned my addr 10.20.193.96:0/4142347136 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:22.276 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.273+0000 7fbb2a5756c0 1 -- 10.20.193.96:0/4142347136 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fbb2c1147f0 msgr2=0x7fbb2c059ec0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:32:22.276 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.273+0000 7fbb2a5756c0 1 --2- 10.20.193.96:0/4142347136 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fbb2c1147f0 0x7fbb2c059ec0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.277 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.273+0000 7fbb2a5756c0 1 -- 10.20.193.96:0/4142347136 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fbb2c113f10 msgr2=0x7fbb2c175850 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:32:22.277 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.273+0000 7fbb2a5756c0 1 --2- 10.20.193.96:0/4142347136 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fbb2c113f10 0x7fbb2c175850 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.277 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.273+0000 7fbb2a5756c0 1 -- 10.20.193.96:0/4142347136 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1c00a660 con 0x7fbb2c113560 2026-02-13T03:32:22.277 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.273+0000 7fbb2a5756c0 1 --2- 10.20.193.96:0/4142347136 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbb2c113560 0x7fbb2c059680 secure :-1 s=READY pgs=98 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb2000b710 tx=0x7fbb2000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.278 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.275+0000 7f4f8d7fa6c0 1 -- 10.20.193.96:0/2171758879 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f4f740028c0 con 0x7f4f90110a00 2026-02-13T03:32:22.278 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.275+0000 7f4f8d7fa6c0 1 --2- 10.20.193.96:0/2171758879 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4f6003f8f0 0x7f4f6005fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.278 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.275+0000 7f4f8d7fa6c0 1 -- 10.20.193.96:0/2171758879 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f4f74051260 con 0x7f4f90110a00 2026-02-13T03:32:22.278 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.275+0000 7f4f8d7fa6c0 1 -- 10.20.193.96:0/2171758879 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4f74051610 con 0x7f4f90110a00 2026-02-13T03:32:22.278 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.276+0000 7f4f8ffff6c0 1 --2- 10.20.193.96:0/2171758879 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4f6003f8f0 0x7f4f6005fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.279 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.274+0000 7fbb137fe6c0 1 -- 10.20.193.96:0/4142347136 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbb20004250 con 0x7fbb2c113560 2026-02-13T03:32:22.279 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.274+0000 7fbb137fe6c0 1 -- 10.20.193.96:0/4142347136 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(27 keys) ==== 1115+0+0 (secure 0 0 0) 0x7fbb20009070 con 0x7fbb2c113560 2026-02-13T03:32:22.279 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.275+0000 7fbb137fe6c0 1 -- 10.20.193.96:0/4142347136 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbb2000cd30 con 0x7fbb2c113560 2026-02-13T03:32:22.279 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.275+0000 7fbb30ff06c0 1 -- 10.20.193.96:0/4142347136 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb2c05b0c0 con 0x7fbb2c113560 2026-02-13T03:32:22.279 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.275+0000 7fbb30ff06c0 1 -- 10.20.193.96:0/4142347136 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb2c05b570 con 0x7fbb2c113560 2026-02-13T03:32:22.280 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.276+0000 7fbb30ff06c0 1 -- 10.20.193.96:0/4142347136 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb2c1797d0 con 0x7fbb2c113560 2026-02-13T03:32:22.280 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.276+0000 7fbb137fe6c0 1 -- 10.20.193.96:0/4142347136 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7fbb200028c0 con 0x7fbb2c113560 2026-02-13T03:32:22.280 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.277+0000 7fbb137fe6c0 1 --2- 10.20.193.96:0/4142347136 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fbb0403f870 0x7fbb0405fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.280 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.277+0000 7fbb137fe6c0 1 -- 10.20.193.96:0/4142347136 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7fbb20051290 con 0x7fbb2c113560 2026-02-13T03:32:22.280 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.277+0000 7f4f8ffff6c0 1 --2- 10.20.193.96:0/2171758879 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4f6003f8f0 0x7f4f6005fda0 secure :-1 s=READY pgs=52 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f84038d20 tx=0x7f4f84038fd0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.280 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.277+0000 7fbb29d746c0 1 --2- 10.20.193.96:0/4142347136 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fbb0403f870 0x7fbb0405fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.281 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2026-02-13T03:32:22.281 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set mgr mon_warn_on_pool_no_app False 2026-02-13T03:32:22.282 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.280+0000 7fbb137fe6c0 1 -- 10.20.193.96:0/4142347136 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbb200043b0 con 0x7fbb2c113560 2026-02-13T03:32:22.282 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.282+0000 7fbb29d746c0 1 --2- 10.20.193.96:0/4142347136 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fbb0403f870 0x7fbb0405fd20 secure :-1 s=READY pgs=53 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb14004750 tx=0x7fbb14005c40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.292 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:22.293 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2026-02-13T03:32:22.293 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set mon mon_op_complaint_time 120 2026-02-13T03:32:22.295 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.296+0000 7efe211a76c0 1 -- 10.20.193.96:0/4130767081 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efe1c10eed0 msgr2=0x7efe1c10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.295 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.296+0000 7efe211a76c0 1 --2- 10.20.193.96:0/4130767081 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efe1c10eed0 0x7efe1c10f2c0 secure :-1 s=READY pgs=99 gs=2 cs=0 l=1 c_cookie=6416118476655226189 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe04009b00 tx=0x7efe0402eed0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.295 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.296+0000 7efe211a76c0 1 -- 10.20.193.96:0/4130767081 shutdown_connections 2026-02-13T03:32:22.295 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.296+0000 7efe211a76c0 1 --2- 10.20.193.96:0/4130767081 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efe1c110a00 0x7efe1c171390 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.295 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.296+0000 7efe211a76c0 1 --2- 10.20.193.96:0/4130767081 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efe1c110050 0x7efe1c1104c0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.296 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.296+0000 7efe211a76c0 1 --2- 10.20.193.96:0/4130767081 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efe1c10eed0 0x7efe1c10f2c0 unknown :-1 s=CLOSED pgs=99 gs=2 cs=0 l=1 c_cookie=6416118476655226189 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.296 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.296+0000 7efe211a76c0 1 -- 10.20.193.96:0/4130767081 >> 10.20.193.96:0/4130767081 conn(0x7efe1c0ec5f0 msgr2=0x7efe1c10ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.296 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.297+0000 7efe211a76c0 1 -- 10.20.193.96:0/4130767081 shutdown_connections 2026-02-13T03:32:22.296 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.298+0000 7efe211a76c0 1 -- 10.20.193.96:0/4130767081 wait complete. 2026-02-13T03:32:22.297 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2026-02-13T03:32:22.297 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config set osd osd_op_complaint_time 180 2026-02-13T03:32:22.299 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.298+0000 7efe211a76c0 1 Processor -- start 2026-02-13T03:32:22.299 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.299+0000 7efe211a76c0 1 -- start start 2026-02-13T03:32:22.299 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.299+0000 7efe211a76c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efe1c10eed0 0x7efe1c109960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.299 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.299+0000 7efe211a76c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efe1c110050 0x7efe1c171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.300 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.299+0000 7efe211a76c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efe1c110a00 0x7efe1c10a1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.300 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.299+0000 7efe1a5756c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efe1c110050 0x7efe1c171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.300 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.299+0000 7efe1a5756c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efe1c110050 0x7efe1c171390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.133:3300/0 says I am v2:10.20.193.96:33368/0 (socket says 10.20.193.96:33368) 2026-02-13T03:32:22.300 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.299+0000 7efe1b5776c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efe1c110a00 0x7efe1c10a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.300 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.299+0000 7efe1b5776c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efe1c110a00 0x7efe1c10a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:58690/0 (socket says 10.20.193.96:58690) 2026-02-13T03:32:22.300 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.299+0000 7efe1a5756c0 1 -- 10.20.193.96:0/133051141 learned_addr learned my addr 10.20.193.96:0/133051141 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:22.300 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.299+0000 7efe211a76c0 1 -- 10.20.193.96:0/133051141 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7efe1c10adf0 con 0x7efe1c110a00 2026-02-13T03:32:22.300 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.299+0000 7efe211a76c0 1 -- 10.20.193.96:0/133051141 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7efe1c10af60 con 0x7efe1c10eed0 2026-02-13T03:32:22.300 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.299+0000 7efe211a76c0 1 -- 10.20.193.96:0/133051141 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7efe1c10b120 con 0x7efe1c110050 2026-02-13T03:32:22.300 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.299+0000 7efe1a5756c0 1 -- 10.20.193.96:0/133051141 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efe1c110050 msgr2=0x7efe1c171390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-13T03:32:22.300 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.299+0000 7efe1a5756c0 1 -- 10.20.193.96:0/133051141 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efe1c110050 msgr2=0x7efe1c171390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:32:22.300 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.299+0000 7efe1a5756c0 1 --2- 10.20.193.96:0/133051141 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efe1c110050 0x7efe1c171390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:32:22.301 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.300+0000 7efe1a5756c0 1 --2- 10.20.193.96:0/133051141 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efe1c110050 0x7efe1c171390 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:32:22.301 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.300+0000 7efe1b5776c0 1 -- 10.20.193.96:0/133051141 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efe1c110050 msgr2=0x7efe1c171390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:32:22.301 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.300+0000 7efe1b5776c0 1 --2- 10.20.193.96:0/133051141 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efe1c110050 0x7efe1c171390 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.301 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.300+0000 7efe1b5776c0 1 -- 10.20.193.96:0/133051141 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efe1c10eed0 msgr2=0x7efe1c109960 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:32:22.301 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.300+0000 7efe1b5776c0 1 --2- 10.20.193.96:0/133051141 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efe1c10eed0 0x7efe1c109960 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.301 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.300+0000 7efe1b5776c0 1 -- 10.20.193.96:0/133051141 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe040094c0 con 0x7efe1c110a00 2026-02-13T03:32:22.301 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.300+0000 7efe1b5776c0 1 --2- 10.20.193.96:0/133051141 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efe1c110a00 0x7efe1c10a1c0 secure :-1 s=READY pgs=100 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe0c0061f0 tx=0x7efe0c0066c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.302 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.303+0000 7efdfbfff6c0 1 -- 10.20.193.96:0/133051141 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe0c003af0 con 0x7efe1c110a00 2026-02-13T03:32:22.302 DEBUG:tasks.cephadm:set 27 configs 2026-02-13T03:32:22.313 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.313 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.313 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.313 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.314 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.303+0000 7efdfbfff6c0 1 -- 10.20.193.96:0/133051141 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(27 keys) ==== 1115+0+0 (secure 0 0 0) 0x7efe0c0054f0 con 0x7efe1c110a00 2026-02-13T03:32:22.314 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.303+0000 7efdfbfff6c0 1 -- 10.20.193.96:0/133051141 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe0c00dd90 con 0x7efe1c110a00 2026-02-13T03:32:22.314 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.304+0000 7efe211a76c0 1 -- 10.20.193.96:0/133051141 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe1c10b400 con 0x7efe1c110a00 2026-02-13T03:32:22.314 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.304+0000 7efe211a76c0 1 -- 10.20.193.96:0/133051141 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe1c10b860 con 0x7efe1c110a00 2026-02-13T03:32:22.314 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.305+0000 7efdfbfff6c0 1 -- 10.20.193.96:0/133051141 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7efe0c005030 con 0x7efe1c110a00 2026-02-13T03:32:22.314 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.305+0000 7efdfbfff6c0 1 --2- 10.20.193.96:0/133051141 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efdf003f940 0x7efdf005fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.315 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.305+0000 7efdfbfff6c0 1 -- 10.20.193.96:0/133051141 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7efe0c0637e0 con 0x7efe1c110a00 2026-02-13T03:32:22.315 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.306+0000 7efe211a76c0 1 -- 10.20.193.96:0/133051141 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe1c175380 con 0x7efe1c110a00 2026-02-13T03:32:22.315 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.307+0000 7efe1ad766c0 1 --2- 10.20.193.96:0/133051141 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efdf003f940 0x7efdf005fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.315 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.311+0000 7efe1ad766c0 1 --2- 10.20.193.96:0/133051141 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efdf003f940 0x7efdf005fdf0 secure :-1 s=READY pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe0402f3e0 tx=0x7efe040023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.315 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.313+0000 7efdfbfff6c0 1 -- 10.20.193.96:0/133051141 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7efe0c005310 con 0x7efe1c110a00 2026-02-13T03:32:22.338 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.339 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.341+0000 7fef63cfc6c0 1 -- 10.20.193.96:0/4118340054 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fef5c1702f0 con 0x7fef5c10e780 2026-02-13T03:32:22.343 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.345+0000 7fef4affd6c0 1 -- 10.20.193.96:0/4118340054 <== mon.0 v2:10.20.193.96:3300/0 9 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7fef5803a450 con 0x7fef5c10e780 2026-02-13T03:32:22.343 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.346+0000 7efdfbfff6c0 1 -- 10.20.193.96:0/133051141 <== mon.0 v2:10.20.193.96:3300/0 7 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7efe0c0631b0 con 0x7efe1c110a00 2026-02-13T03:32:22.343 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.346+0000 7f4f8d7fa6c0 1 -- 10.20.193.96:0/2171758879 <== mon.0 v2:10.20.193.96:3300/0 7 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f4f74050c30 con 0x7f4f90110a00 2026-02-13T03:32:22.344 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.346+0000 7fbb137fe6c0 1 -- 10.20.193.96:0/4142347136 <== mon.0 v2:10.20.193.96:3300/0 7 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fbb200056f0 con 0x7fbb2c113560 2026-02-13T03:32:22.344 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.346+0000 7fef4affd6c0 1 -- 10.20.193.96:0/4118340054 <== mon.0 v2:10.20.193.96:3300/0 10 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fef58035030 con 0x7fef5c10e780 2026-02-13T03:32:22.346 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:22.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.351+0000 7fef63cfc6c0 1 -- 10.20.193.96:0/4118340054 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fef3803f8f0 msgr2=0x7fef3805fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.351+0000 7fef63cfc6c0 1 --2- 10.20.193.96:0/4118340054 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fef3803f8f0 0x7fef3805fda0 secure :-1 s=READY pgs=51 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef4c005980 tx=0x7fef4c005910 comp rx=0 tx=0).stop 2026-02-13T03:32:22.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.351+0000 7fef63cfc6c0 1 -- 10.20.193.96:0/4118340054 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fef5c10e780 msgr2=0x7fef5c118ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.351+0000 7fef63cfc6c0 1 --2- 10.20.193.96:0/4118340054 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fef5c10e780 0x7fef5c118ac0 secure :-1 s=READY pgs=94 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef58030960 tx=0x7fef58005810 comp rx=0 tx=0).stop 2026-02-13T03:32:22.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.351+0000 7fdc4e1886c0 1 -- 10.20.193.96:0/3154229311 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdc48134920 msgr2=0x7fdc48154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.351+0000 7fdc4e1886c0 1 --2- 10.20.193.96:0/3154229311 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdc48134920 0x7fdc48154da0 secure :-1 s=READY pgs=101 gs=1 cs=0 l=1 c_cookie=1959349767193457982 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc280075a0 tx=0x7fdc2802fe80 comp rx=0 tx=0).stop 2026-02-13T03:32:22.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.351+0000 7fdc4e1886c0 1 -- 10.20.193.96:0/3154229311 shutdown_connections 2026-02-13T03:32:22.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.351+0000 7fdc4e1886c0 1 --2- 10.20.193.96:0/3154229311 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fdc481554e0 0x7fdc48175990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.351+0000 7fdc4e1886c0 1 --2- 10.20.193.96:0/3154229311 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdc48134920 0x7fdc48154da0 unknown :-1 s=CLOSED pgs=101 gs=1 cs=0 l=1 c_cookie=1959349767193457982 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.351+0000 7fdc4e1886c0 1 --2- 10.20.193.96:0/3154229311 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fdc48113f70 0x7fdc48134350 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.351+0000 7fdc4e1886c0 1 -- 10.20.193.96:0/3154229311 >> 10.20.193.96:0/3154229311 conn(0x7fdc4805b8e0 msgr2=0x7fdc4805bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.351+0000 7fdc4e1886c0 1 -- 10.20.193.96:0/3154229311 shutdown_connections 2026-02-13T03:32:22.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.351+0000 7fdc4e1886c0 1 -- 10.20.193.96:0/3154229311 wait complete. 2026-02-13T03:32:22.349 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:22.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.351+0000 7fef63cfc6c0 1 -- 10.20.193.96:0/4118340054 shutdown_connections 2026-02-13T03:32:22.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.351+0000 7fef63cfc6c0 1 --2- 10.20.193.96:0/4118340054 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fef3803f8f0 0x7fef3805fda0 unknown :-1 s=CLOSED pgs=51 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.351+0000 7fef63cfc6c0 1 --2- 10.20.193.96:0/4118340054 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fef5c10e780 0x7fef5c118ac0 unknown :-1 s=CLOSED pgs=94 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.351+0000 7fef63cfc6c0 1 --2- 10.20.193.96:0/4118340054 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fef5c10ddd0 0x7fef5c117ed0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.351+0000 7fef63cfc6c0 1 --2- 10.20.193.96:0/4118340054 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fef5c10cc50 0x7fef5c117880 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.351+0000 7fef63cfc6c0 1 -- 10.20.193.96:0/4118340054 >> 10.20.193.96:0/4118340054 conn(0x7fef5c0ea370 msgr2=0x7fef5c10a750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.352+0000 7fdc4e1886c0 1 Processor -- start 2026-02-13T03:32:22.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.352+0000 7fdc4e1886c0 1 -- start start 2026-02-13T03:32:22.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.352+0000 7fdc4e1886c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdc48113f70 0x7fdc48175970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.352+0000 7fdc4e1886c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fdc48134920 0x7fdc48154d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.352+0000 7fdc4e1886c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fdc481554e0 0x7fdc4811cfd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.352+0000 7fdc4e1886c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4811d760 con 0x7fdc48113f70 2026-02-13T03:32:22.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.352+0000 7fdc4e1886c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4811d8d0 con 0x7fdc481554e0 2026-02-13T03:32:22.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.352+0000 7fdc4e1886c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4811df30 con 0x7fdc48134920 2026-02-13T03:32:22.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.351+0000 7fef63cfc6c0 1 -- 10.20.193.96:0/4118340054 shutdown_connections 2026-02-13T03:32:22.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.351+0000 7fef63cfc6c0 1 -- 10.20.193.96:0/4118340054 wait complete. 2026-02-13T03:32:22.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.352+0000 7fdc477fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdc48113f70 0x7fdc48175970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.352+0000 7fdc477fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdc48113f70 0x7fdc48175970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:58712/0 (socket says 10.20.193.96:58712) 2026-02-13T03:32:22.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.352+0000 7fdc477fe6c0 1 -- 10.20.193.96:0/1129437695 learned_addr learned my addr 10.20.193.96:0/1129437695 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:22.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.352+0000 7fdc46ffd6c0 1 --2- 10.20.193.96:0/1129437695 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fdc48134920 0x7fdc48154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.352+0000 7fdc46ffd6c0 1 -- 10.20.193.96:0/1129437695 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fdc48134920 msgr2=0x7fdc48154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T03:32:22.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.352+0000 7fdc46ffd6c0 1 -- 10.20.193.96:0/1129437695 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fdc48134920 msgr2=0x7fdc48154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:32:22.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.352+0000 7fdc46ffd6c0 1 --2- 10.20.193.96:0/1129437695 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fdc48134920 0x7fdc48154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:32:22.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.352+0000 7fdc46ffd6c0 1 --2- 10.20.193.96:0/1129437695 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fdc48134920 0x7fdc48154d40 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:32:22.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.352+0000 7fdc477fe6c0 1 -- 10.20.193.96:0/1129437695 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fdc48134920 msgr2=0x7fdc48154d40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:32:22.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.352+0000 7fdc477fe6c0 1 --2- 10.20.193.96:0/1129437695 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fdc48134920 0x7fdc48154d40 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.352+0000 7fdc477fe6c0 1 -- 10.20.193.96:0/1129437695 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fdc481554e0 msgr2=0x7fdc4811cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.352+0000 7fdc477fe6c0 1 --2- 10.20.193.96:0/1129437695 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fdc481554e0 0x7fdc4811cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.352+0000 7fdc477fe6c0 1 -- 10.20.193.96:0/1129437695 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc280071c0 con 0x7fdc48113f70 2026-02-13T03:32:22.354 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.353+0000 7fdc477fe6c0 1 --2- 10.20.193.96:0/1129437695 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdc48113f70 0x7fdc48175970 secure :-1 s=READY pgs=102 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc4000c6c0 tx=0x7fdc4000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.354 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.353+0000 7fdc44ff96c0 1 -- 10.20.193.96:0/1129437695 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdc40003ce0 con 0x7fdc48113f70 2026-02-13T03:32:22.354 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.354+0000 7fdc4e1886c0 1 -- 10.20.193.96:0/1129437695 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc4811e210 con 0x7fdc48113f70 2026-02-13T03:32:22.354 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.354+0000 7fdc4e1886c0 1 -- 10.20.193.96:0/1129437695 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc4811e770 con 0x7fdc48113f70 2026-02-13T03:32:22.354 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.354+0000 7fdc44ff96c0 1 -- 10.20.193.96:0/1129437695 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fdc40003e40 con 0x7fdc48113f70 2026-02-13T03:32:22.354 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.354+0000 7fdc44ff96c0 1 -- 10.20.193.96:0/1129437695 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdc4000de90 con 0x7fdc48113f70 2026-02-13T03:32:22.354 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.355+0000 7fdc44ff96c0 1 -- 10.20.193.96:0/1129437695 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7fdc400100d0 con 0x7fdc48113f70 2026-02-13T03:32:22.354 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.355+0000 7fdc44ff96c0 1 --2- 10.20.193.96:0/1129437695 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fdc1403f870 0x7fdc1405fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.354 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.355+0000 7fdc44ff96c0 1 -- 10.20.193.96:0/1129437695 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7fdc40052240 con 0x7fdc48113f70 2026-02-13T03:32:22.354 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.355+0000 7fdc46ffd6c0 1 --2- 10.20.193.96:0/1129437695 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fdc1403f870 0x7fdc1405fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.354 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.356+0000 7fdc4e1886c0 1 -- 10.20.193.96:0/1129437695 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc0c005310 con 0x7fdc48113f70 2026-02-13T03:32:22.359 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.359+0000 7fdc46ffd6c0 1 --2- 10.20.193.96:0/1129437695 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fdc1403f870 0x7fdc1405fd20 secure :-1 s=READY pgs=55 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc280023e0 tx=0x7fdc28005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.359 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.360+0000 7fdc44ff96c0 1 -- 10.20.193.96:0/1129437695 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdc40015250 con 0x7fdc48113f70 2026-02-13T03:32:22.360 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.362+0000 7f6d7a4086c0 1 -- 10.20.193.96:0/946925690 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6d74117160 msgr2=0x7f6d74177af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.360 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.362+0000 7f6d72ffd6c0 1 -- 10.20.193.96:0/946925690 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d6800a030 con 0x7f6d74117160 2026-02-13T03:32:22.360 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.362+0000 7f6d7a4086c0 1 --2- 10.20.193.96:0/946925690 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6d74117160 0x7f6d74177af0 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=16936103395703342442 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d68006fd0 tx=0x7f6d68034250 comp rx=0 tx=0).stop 2026-02-13T03:32:22.362 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.365+0000 7f6d7a4086c0 1 -- 10.20.193.96:0/946925690 shutdown_connections 2026-02-13T03:32:22.362 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.365+0000 7f6d7a4086c0 1 --2- 10.20.193.96:0/946925690 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6d74117160 0x7f6d74177af0 unknown :-1 s=CLOSED pgs=103 gs=1 cs=0 l=1 c_cookie=16936103395703342442 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.362 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.365+0000 7f6d7a4086c0 1 --2- 10.20.193.96:0/946925690 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6d741167b0 0x7f6d74116c20 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.362 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.365+0000 7f6d7a4086c0 1 --2- 10.20.193.96:0/946925690 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6d74115630 0x7f6d74115a20 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.362 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.365+0000 7f6d7a4086c0 1 -- 10.20.193.96:0/946925690 >> 10.20.193.96:0/946925690 conn(0x7f6d7405db80 msgr2=0x7f6d7405df80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.362 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.365+0000 7f6d7a4086c0 1 -- 10.20.193.96:0/946925690 shutdown_connections 2026-02-13T03:32:22.363 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.365+0000 7f6d7a4086c0 1 -- 10.20.193.96:0/946925690 wait complete. 2026-02-13T03:32:22.363 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.365+0000 7f6d7a4086c0 1 Processor -- start 2026-02-13T03:32:22.363 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.366+0000 7f6d7a4086c0 1 -- start start 2026-02-13T03:32:22.363 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.366+0000 7f6d7a4086c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6d74115630 0x7f6d74100090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.363 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.366+0000 7f6d7a4086c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6d741167b0 0x7f6d74177af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.363 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.366+0000 7f6d7a4086c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6d74117160 0x7f6d741008f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.363 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.366+0000 7f6d7a4086c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f6d74101520 con 0x7f6d741167b0 2026-02-13T03:32:22.363 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.366+0000 7f6d7a4086c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6d74101660 con 0x7f6d74115630 2026-02-13T03:32:22.363 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.366+0000 7f6d7a4086c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6d74101820 con 0x7f6d74117160 2026-02-13T03:32:22.364 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.366+0000 7f6d737fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6d741167b0 0x7f6d74177af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.364 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.366+0000 7f6d737fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6d741167b0 0x7f6d74177af0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:58736/0 (socket says 10.20.193.96:58736) 2026-02-13T03:32:22.364 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.366+0000 7f6d737fe6c0 1 -- 10.20.193.96:0/1783222492 learned_addr learned my addr 10.20.193.96:0/1783222492 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:22.364 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.366+0000 7f6d737fe6c0 1 -- 10.20.193.96:0/1783222492 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6d74117160 msgr2=0x7f6d741008f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.364 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.366+0000 7f6d737fe6c0 1 --2- 10.20.193.96:0/1783222492 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6d74117160 0x7f6d741008f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.364 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.366+0000 7f6d737fe6c0 1 -- 10.20.193.96:0/1783222492 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6d74115630 msgr2=0x7f6d74100090 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:32:22.364 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.366+0000 7f6d737fe6c0 1 --2- 10.20.193.96:0/1783222492 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6d74115630 0x7f6d74100090 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.364 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.366+0000 7f6d737fe6c0 1 -- 10.20.193.96:0/1783222492 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d6800a5b0 con 0x7f6d741167b0 2026-02-13T03:32:22.364 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.366+0000 7f6d737fe6c0 1 --2- 10.20.193.96:0/1783222492 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6d741167b0 0x7f6d74177af0 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d64005dc0 tx=0x7f6d6400bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.364 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.366+0000 7f6d717fa6c0 1 -- 10.20.193.96:0/1783222492 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d64004250 con 0x7f6d741167b0 2026-02-13T03:32:22.364 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.367+0000 7f6d717fa6c0 1 -- 10.20.193.96:0/1783222492 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f6d6400be30 con 0x7f6d741167b0 2026-02-13T03:32:22.364 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.367+0000 7f6d717fa6c0 1 -- 10.20.193.96:0/1783222492 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d640052a0 con 0x7f6d741167b0 2026-02-13T03:32:22.364 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.367+0000 7f6d7a4086c0 1 -- 10.20.193.96:0/1783222492 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d74101b00 con 0x7f6d741167b0 2026-02-13T03:32:22.364 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.367+0000 7f6d7a4086c0 1 -- 10.20.193.96:0/1783222492 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d74101f90 con 0x7f6d741167b0 2026-02-13T03:32:22.365 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.368+0000 7f6d7a4086c0 1 -- 10.20.193.96:0/1783222492 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d741823a0 con 0x7f6d741167b0 2026-02-13T03:32:22.369 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.372+0000 7f6d717fa6c0 1 -- 10.20.193.96:0/1783222492 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f6d640043b0 con 0x7f6d741167b0 2026-02-13T03:32:22.370 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.372+0000 7f6d717fa6c0 1 --2- 10.20.193.96:0/1783222492 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f6d4803f8f0 0x7f6d4805fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.370 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.372+0000 7f6d717fa6c0 1 -- 10.20.193.96:0/1783222492 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f6d64051170 con 0x7f6d741167b0 2026-02-13T03:32:22.370 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.372+0000 7f6d717fa6c0 1 -- 10.20.193.96:0/1783222492 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6d64051590 con 0x7f6d741167b0 2026-02-13T03:32:22.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.374+0000 7f6d73fff6c0 1 --2- 10.20.193.96:0/1783222492 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f6d4803f8f0 0x7f6d4805fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.374+0000 7f6d73fff6c0 1 --2- 10.20.193.96:0/1783222492 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f6d4803f8f0 0x7f6d4805fda0 secure :-1 s=READY pgs=56 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d60005b40 tx=0x7f6d600073d0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.423 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:22.426 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:22.429 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:22.437 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:22.437 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.442 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.444+0000 7f15e32686c0 1 -- 10.20.193.96:0/3211874932 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f15dc113560 msgr2=0x7f15dc1139d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.442 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.444+0000 7f15e32686c0 1 --2- 10.20.193.96:0/3211874932 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f15dc113560 0x7f15dc1139d0 secure :-1 s=READY pgs=105 gs=1 cs=0 l=1 c_cookie=12434141520613140072 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15c4009970 tx=0x7f15c402ed70 comp rx=0 tx=0).stop 2026-02-13T03:32:22.445 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.447+0000 7fbb30ff06c0 1 -- 10.20.193.96:0/4142347136 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fbb2c114be0 con 0x7fbb2c113560 2026-02-13T03:32:22.445 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.448+0000 7f63b7c986c0 1 -- 10.20.193.96:0/338920388 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f63b010cc40 msgr2=0x7f63b010d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.445 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.448+0000 7f63b7c986c0 1 --2- 10.20.193.96:0/338920388 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f63b010cc40 0x7f63b010d030 secure :-1 s=READY pgs=107 gs=1 cs=0 l=1 c_cookie=7564069568377672287 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63a0009970 tx=0x7f63a002ed70 comp rx=0 tx=0).stop 2026-02-13T03:32:22.446 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.445+0000 7f15e32686c0 1 -- 10.20.193.96:0/3211874932 shutdown_connections 2026-02-13T03:32:22.446 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.445+0000 7f15e32686c0 1 --2- 10.20.193.96:0/3211874932 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f15dc113f10 0x7f15dc175870 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.446 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.445+0000 7f15e32686c0 1 --2- 10.20.193.96:0/3211874932 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f15dc113560 0x7f15dc1139d0 unknown :-1 s=CLOSED pgs=105 gs=1 cs=0 l=1 c_cookie=12434141520613140072 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.446 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.445+0000 7f15e32686c0 1 --2- 10.20.193.96:0/3211874932 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f15dc1147f0 0x7f15dc114be0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.446 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.445+0000 7f15e32686c0 1 -- 10.20.193.96:0/3211874932 >> 10.20.193.96:0/3211874932 conn(0x7f15dc064300 msgr2=0x7f15dc064700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.446 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.445+0000 7f15e32686c0 1 -- 10.20.193.96:0/3211874932 shutdown_connections 2026-02-13T03:32:22.446 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.446+0000 7f15e32686c0 1 -- 10.20.193.96:0/3211874932 wait complete. 2026-02-13T03:32:22.446 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.446+0000 7f15e32686c0 1 Processor -- start 2026-02-13T03:32:22.446 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.446+0000 7f15e32686c0 1 -- start start 2026-02-13T03:32:22.446 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.446+0000 7f15e32686c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f15dc113560 0x7f15dc107430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.446 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.446+0000 7f15e32686c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f15dc113f10 0x7f15dc175870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.446 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.446+0000 7f15e32686c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f15dc1147f0 0x7f15dc107c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.446 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.447+0000 7f15d3fff6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f15dc113f10 0x7f15dc175870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.446 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.447+0000 7f15e0fdd6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f15dc113560 0x7f15dc107430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.446 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.447+0000 7f15e32686c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc1088c0 con 0x7f15dc1147f0 2026-02-13T03:32:22.446 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.447+0000 7f15e0fdd6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f15dc113560 0x7f15dc107430 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.133:3300/0 says I am v2:10.20.193.96:33436/0 (socket says 10.20.193.96:33436) 2026-02-13T03:32:22.446 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.447+0000 7f15e32686c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc108a30 con 0x7f15dc113f10 2026-02-13T03:32:22.446 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.447+0000 7f15e0fdd6c0 1 -- 10.20.193.96:0/1668050570 learned_addr learned my addr 10.20.193.96:0/1668050570 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:22.446 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.447+0000 7f15e32686c0 1 -- 10.20.193.96:0/1668050570 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc108bf0 con 0x7f15dc113560 2026-02-13T03:32:22.446 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.447+0000 7f15e17de6c0 1 --2- 10.20.193.96:0/1668050570 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f15dc1147f0 0x7f15dc107c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.446 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.447+0000 7f15e17de6c0 1 -- 10.20.193.96:0/1668050570 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f15dc113560 msgr2=0x7f15dc107430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.446 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.447+0000 7f15e17de6c0 1 --2- 10.20.193.96:0/1668050570 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f15dc113560 0x7f15dc107430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.446 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.447+0000 7f15e17de6c0 1 -- 10.20.193.96:0/1668050570 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f15dc113f10 msgr2=0x7f15dc175870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.447 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.447+0000 7f15e17de6c0 1 --2- 10.20.193.96:0/1668050570 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f15dc113f10 0x7f15dc175870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.447 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.447+0000 7f15e17de6c0 1 -- 10.20.193.96:0/1668050570 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c4009590 con 0x7f15dc1147f0 2026-02-13T03:32:22.447 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.447+0000 7f15e17de6c0 1 --2- 10.20.193.96:0/1668050570 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f15dc1147f0 0x7f15dc107c90 secure :-1 s=READY pgs=106 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15d800c6c0 tx=0x7f15d800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.447 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.447+0000 7f15d1ffb6c0 1 -- 10.20.193.96:0/1668050570 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f15d8005340 con 0x7f15dc1147f0 2026-02-13T03:32:22.447 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.447+0000 7f15d1ffb6c0 1 -- 10.20.193.96:0/1668050570 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f15d8003cf0 con 0x7f15dc1147f0 2026-02-13T03:32:22.447 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.447+0000 7f15d1ffb6c0 1 -- 10.20.193.96:0/1668050570 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f15d800dc50 con 0x7f15dc1147f0 2026-02-13T03:32:22.447 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.447+0000 7f15e32686c0 1 -- 10.20.193.96:0/1668050570 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15dc108ed0 con 0x7f15dc1147f0 2026-02-13T03:32:22.447 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.447+0000 7f15e32686c0 1 -- 10.20.193.96:0/1668050570 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15dc109300 con 0x7f15dc1147f0 2026-02-13T03:32:22.447 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.448+0000 7f15e32686c0 1 -- 10.20.193.96:0/1668050570 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15dc1799d0 con 0x7f15dc1147f0 2026-02-13T03:32:22.447 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.448+0000 7f15d1ffb6c0 1 -- 10.20.193.96:0/1668050570 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f15d8003810 con 0x7f15dc1147f0 2026-02-13T03:32:22.447 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.449+0000 7f15d1ffb6c0 1 --2- 10.20.193.96:0/1668050570 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f15b803f8f0 0x7f15b805fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.447 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.449+0000 7f63b7c986c0 1 -- 10.20.193.96:0/338920388 shutdown_connections 2026-02-13T03:32:22.447 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.449+0000 7f63b7c986c0 1 --2- 10.20.193.96:0/338920388 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f63b010e770 0x7f63b016f100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.447 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.449+0000 7f63b7c986c0 1 --2- 10.20.193.96:0/338920388 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f63b010ddc0 0x7f63b010e230 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.447 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.449+0000 7f63b7c986c0 1 --2- 10.20.193.96:0/338920388 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f63b010cc40 0x7f63b010d030 unknown :-1 s=CLOSED pgs=107 gs=1 cs=0 l=1 c_cookie=7564069568377672287 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.447 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.449+0000 7f63b7c986c0 1 -- 10.20.193.96:0/338920388 >> 10.20.193.96:0/338920388 conn(0x7f63b00ea360 msgr2=0x7f63b010a770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.448 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.449+0000 7f63b7c986c0 1 -- 10.20.193.96:0/338920388 shutdown_connections 2026-02-13T03:32:22.448 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.449+0000 7f63b7c986c0 1 -- 10.20.193.96:0/338920388 wait complete. 2026-02-13T03:32:22.448 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.449+0000 7f63b7c986c0 1 Processor -- start 2026-02-13T03:32:22.448 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.449+0000 7f63b7c986c0 1 -- start start 2026-02-13T03:32:22.448 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.449+0000 7f63b7c986c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f63b010cc40 0x7f63b0061ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.448 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.449+0000 7f63b7c986c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f63b010ddc0 0x7f63b016f100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.448 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.449+0000 7f63b7c986c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f63b010e770 0x7f63b00605e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.448 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.449+0000 7f63b7c986c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f63b0060b20 con 0x7f63b010cc40 2026-02-13T03:32:22.448 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.449+0000 7f63b7c986c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f63b0060c90 con 0x7f63b010e770 2026-02-13T03:32:22.448 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.449+0000 7f63b7c986c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f63b0060e50 con 0x7f63b010ddc0 2026-02-13T03:32:22.448 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.450+0000 7f63b620a6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f63b010e770 0x7f63b00605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.448 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.450+0000 7f63b620a6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f63b010e770 0x7f63b00605e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.132:3300/0 says I am v2:10.20.193.96:47628/0 (socket says 10.20.193.96:47628) 2026-02-13T03:32:22.448 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.450+0000 7f63b620a6c0 1 -- 10.20.193.96:0/640931609 learned_addr learned my addr 10.20.193.96:0/640931609 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:22.448 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.450+0000 7f63b620a6c0 1 -- 10.20.193.96:0/640931609 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f63b010e770 msgr2=0x7f63b00605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T03:32:22.448 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.450+0000 7f63b620a6c0 1 -- 10.20.193.96:0/640931609 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f63b010e770 msgr2=0x7f63b00605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:32:22.448 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.450+0000 7f63b620a6c0 1 --2- 10.20.193.96:0/640931609 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f63b010e770 0x7f63b00605e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:32:22.448 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.450+0000 7f63b620a6c0 1 --2- 10.20.193.96:0/640931609 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f63b010e770 0x7f63b00605e0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:32:22.448 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:22.449 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.451+0000 7f63b52086c0 1 --2- 10.20.193.96:0/640931609 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f63b010ddc0 0x7f63b016f100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.449 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.451+0000 7f63b5a096c0 1 --2- 10.20.193.96:0/640931609 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f63b010cc40 0x7f63b0061ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.449 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.451+0000 7f63b52086c0 1 -- 10.20.193.96:0/640931609 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f63b010ddc0 msgr2=0x7f63b016f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-13T03:32:22.449 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.451+0000 7f63b52086c0 1 -- 10.20.193.96:0/640931609 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f63b010ddc0 msgr2=0x7f63b016f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:32:22.449 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.451+0000 7f63b52086c0 1 --2- 10.20.193.96:0/640931609 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f63b010ddc0 0x7f63b016f100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:32:22.449 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.451+0000 7f63b52086c0 1 --2- 10.20.193.96:0/640931609 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f63b010ddc0 0x7f63b016f100 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:32:22.449 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.451+0000 7f63b5a096c0 1 -- 10.20.193.96:0/640931609 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f63b010ddc0 msgr2=0x7f63b016f100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:32:22.449 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.451+0000 7f63b5a096c0 1 --2- 10.20.193.96:0/640931609 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f63b010ddc0 0x7f63b016f100 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.449 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.451+0000 7f63b5a096c0 1 -- 10.20.193.96:0/640931609 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f63b010e770 msgr2=0x7f63b00605e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:32:22.449 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.451+0000 7f63b5a096c0 1 --2- 10.20.193.96:0/640931609 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f63b010e770 0x7f63b00605e0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.449 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.451+0000 7f63b5a096c0 1 -- 10.20.193.96:0/640931609 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a0009590 con 0x7f63b010cc40 2026-02-13T03:32:22.449 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.451+0000 7f63b5a096c0 1 --2- 10.20.193.96:0/640931609 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f63b010cc40 0x7f63b0061ce0 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63a0005b40 tx=0x7f63a0004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.449 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.452+0000 7f639effd6c0 1 -- 10.20.193.96:0/640931609 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63a0002ae0 con 0x7f63b010cc40 2026-02-13T03:32:22.449 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.452+0000 7f639effd6c0 1 -- 10.20.193.96:0/640931609 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f63a0002c40 con 0x7f63b010cc40 2026-02-13T03:32:22.450 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.452+0000 7f63b7c986c0 1 -- 10.20.193.96:0/640931609 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63b00610d0 con 0x7f63b010cc40 2026-02-13T03:32:22.450 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.449+0000 7f15d1ffb6c0 1 -- 10.20.193.96:0/1668050570 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f15d8052240 con 0x7f15dc1147f0 2026-02-13T03:32:22.450 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.452+0000 7f15d1ffb6c0 1 -- 10.20.193.96:0/1668050570 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f15d800dde0 con 0x7f15dc1147f0 2026-02-13T03:32:22.451 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.453+0000 7f639effd6c0 1 -- 10.20.193.96:0/640931609 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63a00312a0 con 0x7f63b010cc40 2026-02-13T03:32:22.451 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.453+0000 7f63b7c986c0 1 -- 10.20.193.96:0/640931609 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63b00f6000 con 0x7f63b010cc40 2026-02-13T03:32:22.452 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.454+0000 7fbb137fe6c0 1 -- 10.20.193.96:0/4142347136 <== mon.0 v2:10.20.193.96:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v14)=0 v14) ==== 117+0+0 (secure 0 0 0) 0x7fbb2000e720 con 0x7fbb2c113560 2026-02-13T03:32:22.452 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.455+0000 7f63b7c986c0 1 -- 10.20.193.96:0/640931609 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6378005310 con 0x7f63b010cc40 2026-02-13T03:32:22.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.458+0000 7fbb30ff06c0 1 -- 10.20.193.96:0/4142347136 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fbb0403f870 msgr2=0x7fbb0405fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.458+0000 7fbb30ff06c0 1 --2- 10.20.193.96:0/4142347136 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fbb0403f870 0x7fbb0405fd20 secure :-1 s=READY pgs=53 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb14004750 tx=0x7fbb14005c40 comp rx=0 tx=0).stop 2026-02-13T03:32:22.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.458+0000 7fbb30ff06c0 1 -- 10.20.193.96:0/4142347136 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbb2c113560 msgr2=0x7fbb2c059680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.458+0000 7fbb30ff06c0 1 --2- 10.20.193.96:0/4142347136 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbb2c113560 0x7fbb2c059680 secure :-1 s=READY pgs=98 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb2000b710 tx=0x7fbb2000bbe0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.458 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:22.458 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.458+0000 7f15e0fdd6c0 1 --2- 10.20.193.96:0/1668050570 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f15dc113560 0x7f15dc107430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:32:22.458 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.458+0000 7f15e0fdd6c0 1 --2- 10.20.193.96:0/1668050570 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f15b803f8f0 0x7f15b805fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.458 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.459+0000 7f15e0fdd6c0 1 --2- 10.20.193.96:0/1668050570 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f15b803f8f0 0x7f15b805fda0 secure :-1 s=READY pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15cc006ae0 tx=0x7f15cc006ef0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.459 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.462+0000 7fbb30ff06c0 1 -- 10.20.193.96:0/4142347136 shutdown_connections 2026-02-13T03:32:22.459 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.462+0000 7fbb30ff06c0 1 --2- 10.20.193.96:0/4142347136 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fbb0403f870 0x7fbb0405fd20 unknown :-1 s=CLOSED pgs=53 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.459 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.462+0000 7fbb30ff06c0 1 --2- 10.20.193.96:0/4142347136 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fbb2c1147f0 0x7fbb2c059ec0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.459 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.462+0000 7fbb30ff06c0 1 --2- 10.20.193.96:0/4142347136 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fbb2c113f10 0x7fbb2c175850 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.459 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.462+0000 7fbb30ff06c0 1 --2- 10.20.193.96:0/4142347136 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbb2c113560 0x7fbb2c059680 unknown :-1 s=CLOSED pgs=98 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.460 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.462+0000 7fbb30ff06c0 1 -- 10.20.193.96:0/4142347136 >> 10.20.193.96:0/4142347136 conn(0x7fbb2c064300 msgr2=0x7fbb2c069170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.460 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.461+0000 7f639effd6c0 1 -- 10.20.193.96:0/640931609 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f63a0007260 con 0x7f63b010cc40 2026-02-13T03:32:22.460 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.461+0000 7f639effd6c0 1 --2- 10.20.193.96:0/640931609 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f638c03f8c0 0x7f638c05fd70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.460 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.461+0000 7f639effd6c0 1 -- 10.20.193.96:0/640931609 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f63a0075360 con 0x7f63b010cc40 2026-02-13T03:32:22.460 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.462+0000 7f63b52086c0 1 --2- 10.20.193.96:0/640931609 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f638c03f8c0 0x7f638c05fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.461 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.462+0000 7f63b52086c0 1 --2- 10.20.193.96:0/640931609 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f638c03f8c0 0x7f638c05fd70 secure :-1 s=READY pgs=58 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63a4005980 tx=0x7f63a4005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.461 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.462+0000 7f639effd6c0 1 -- 10.20.193.96:0/640931609 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f63a0002db0 con 0x7f63b010cc40 2026-02-13T03:32:22.462 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.465+0000 7fbb30ff06c0 1 -- 10.20.193.96:0/4142347136 shutdown_connections 2026-02-13T03:32:22.462 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.465+0000 7fbb30ff06c0 1 -- 10.20.193.96:0/4142347136 wait complete. 2026-02-13T03:32:22.464 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.465+0000 7f4f966fb6c0 1 -- 10.20.193.96:0/2171758879 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f4f9010f2a0 con 0x7f4f90110a00 2026-02-13T03:32:22.467 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.469+0000 7f4f8d7fa6c0 1 -- 10.20.193.96:0/2171758879 <== mon.0 v2:10.20.193.96:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v15)=0 v15) ==== 108+0+0 (secure 0 0 0) 0x7f4f74012750 con 0x7f4f90110a00 2026-02-13T03:32:22.473 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.476+0000 7f4f966fb6c0 1 -- 10.20.193.96:0/2171758879 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4f6003f8f0 msgr2=0x7f4f6005fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.473 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.476+0000 7f4f966fb6c0 1 --2- 10.20.193.96:0/2171758879 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4f6003f8f0 0x7f4f6005fda0 secure :-1 s=READY pgs=52 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f84038d20 tx=0x7f4f84038fd0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.473 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.476+0000 7f4f966fb6c0 1 -- 10.20.193.96:0/2171758879 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4f90110a00 msgr2=0x7f4f90101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.473 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.476+0000 7f4f966fb6c0 1 --2- 10.20.193.96:0/2171758879 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4f90110a00 0x7f4f90101280 secure :-1 s=READY pgs=96 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f74005dc0 tx=0x7f4f7400bb60 comp rx=0 tx=0).stop 2026-02-13T03:32:22.474 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.476+0000 7f4f966fb6c0 1 -- 10.20.193.96:0/2171758879 shutdown_connections 2026-02-13T03:32:22.474 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.476+0000 7f4f966fb6c0 1 --2- 10.20.193.96:0/2171758879 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4f6003f8f0 0x7f4f6005fda0 unknown :-1 s=CLOSED pgs=52 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.474 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.476+0000 7f4f966fb6c0 1 --2- 10.20.193.96:0/2171758879 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4f90110a00 0x7f4f90101280 unknown :-1 s=CLOSED pgs=96 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.475 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.476+0000 7f4f966fb6c0 1 --2- 10.20.193.96:0/2171758879 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4f90110050 0x7f4f90171370 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.475 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.476+0000 7f4f966fb6c0 1 --2- 10.20.193.96:0/2171758879 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4f9010eed0 0x7f4f90100a40 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.475 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.476+0000 7f4f966fb6c0 1 -- 10.20.193.96:0/2171758879 >> 10.20.193.96:0/2171758879 conn(0x7f4f900ec5f0 msgr2=0x7f4f900561d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.475 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.476+0000 7f4f966fb6c0 1 -- 10.20.193.96:0/2171758879 shutdown_connections 2026-02-13T03:32:22.475 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.477+0000 7f4f966fb6c0 1 -- 10.20.193.96:0/2171758879 wait complete. 2026-02-13T03:32:22.483 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:22.491 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.492+0000 7efe211a76c0 1 -- 10.20.193.96:0/133051141 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7efe1c10cf50 con 0x7efe1c110a00 2026-02-13T03:32:22.495 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.496+0000 7efdfbfff6c0 1 -- 10.20.193.96:0/133051141 <== mon.0 v2:10.20.193.96:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v16)=0 v16) ==== 106+0+0 (secure 0 0 0) 0x7efe0c00fe40 con 0x7efe1c110a00 2026-02-13T03:32:22.502 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.502+0000 7efe211a76c0 1 -- 10.20.193.96:0/133051141 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efdf003f940 msgr2=0x7efdf005fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.502 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.502+0000 7efe211a76c0 1 --2- 10.20.193.96:0/133051141 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efdf003f940 0x7efdf005fdf0 secure :-1 s=READY pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe0402f3e0 tx=0x7efe040023a0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.502 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.502+0000 7efe211a76c0 1 -- 10.20.193.96:0/133051141 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efe1c110a00 msgr2=0x7efe1c10a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.502 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.502+0000 7efe211a76c0 1 --2- 10.20.193.96:0/133051141 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efe1c110a00 0x7efe1c10a1c0 secure :-1 s=READY pgs=100 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe0c0061f0 tx=0x7efe0c0066c0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.502 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.503+0000 7efe211a76c0 1 -- 10.20.193.96:0/133051141 shutdown_connections 2026-02-13T03:32:22.502 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.503+0000 7efe211a76c0 1 --2- 10.20.193.96:0/133051141 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efdf003f940 0x7efdf005fdf0 unknown :-1 s=CLOSED pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.502 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.503+0000 7efe211a76c0 1 --2- 10.20.193.96:0/133051141 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efe1c110a00 0x7efe1c10a1c0 unknown :-1 s=CLOSED pgs=100 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.502 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.503+0000 7efe211a76c0 1 --2- 10.20.193.96:0/133051141 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efe1c110050 0x7efe1c171390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.502 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.503+0000 7efe211a76c0 1 --2- 10.20.193.96:0/133051141 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efe1c10eed0 0x7efe1c109960 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.502 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.503+0000 7efe211a76c0 1 -- 10.20.193.96:0/133051141 >> 10.20.193.96:0/133051141 conn(0x7efe1c0ec5f0 msgr2=0x7efe1c0561d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.502 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.503+0000 7efe211a76c0 1 -- 10.20.193.96:0/133051141 shutdown_connections 2026-02-13T03:32:22.503 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.504+0000 7efe211a76c0 1 -- 10.20.193.96:0/133051141 wait complete. 2026-02-13T03:32:22.503 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:22.507 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.510+0000 7fdc4e1886c0 1 -- 10.20.193.96:0/1129437695 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7fdc0c0055c0 con 0x7fdc48113f70 2026-02-13T03:32:22.512 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.514+0000 7fdc44ff96c0 1 -- 10.20.193.96:0/1129437695 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v17)=0 v17) ==== 127+0+0 (secure 0 0 0) 0x7fdc40012030 con 0x7fdc48113f70 2026-02-13T03:32:22.513 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:22.514 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:22.517 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.519+0000 7fdc4e1886c0 1 -- 10.20.193.96:0/1129437695 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fdc1403f870 msgr2=0x7fdc1405fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.517 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.519+0000 7fdc4e1886c0 1 --2- 10.20.193.96:0/1129437695 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fdc1403f870 0x7fdc1405fd20 secure :-1 s=READY pgs=55 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc280023e0 tx=0x7fdc28005910 comp rx=0 tx=0).stop 2026-02-13T03:32:22.517 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.519+0000 7fdc4e1886c0 1 -- 10.20.193.96:0/1129437695 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdc48113f70 msgr2=0x7fdc48175970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.517 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.520+0000 7fdc4e1886c0 1 --2- 10.20.193.96:0/1129437695 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdc48113f70 0x7fdc48175970 secure :-1 s=READY pgs=102 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc4000c6c0 tx=0x7fdc4000cb90 comp rx=0 tx=0).stop 2026-02-13T03:32:22.518 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.517+0000 7f6d90c0c6c0 1 -- 10.20.193.96:0/2167879982 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6d8c10ddd0 msgr2=0x7f6d8c10e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.519 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.517+0000 7f6d90c0c6c0 1 --2- 10.20.193.96:0/2167879982 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6d8c10ddd0 0x7f6d8c10e240 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=5548686330295922340 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d740098a0 tx=0x7f6d7402ec70 comp rx=0 tx=0).stop 2026-02-13T03:32:22.519 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.517+0000 7f6d90c0c6c0 1 -- 10.20.193.96:0/2167879982 shutdown_connections 2026-02-13T03:32:22.519 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.517+0000 7f6d90c0c6c0 1 --2- 10.20.193.96:0/2167879982 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6d8c10e780 0x7f6d8c16f110 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.519 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.517+0000 7f6d90c0c6c0 1 --2- 10.20.193.96:0/2167879982 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6d8c10ddd0 0x7f6d8c10e240 unknown :-1 s=CLOSED pgs=109 gs=1 cs=0 l=1 c_cookie=5548686330295922340 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.519 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.517+0000 7f6d90c0c6c0 1 --2- 10.20.193.96:0/2167879982 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6d8c10cc50 0x7f6d8c10d040 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.519 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.517+0000 7f6d90c0c6c0 1 -- 10.20.193.96:0/2167879982 >> 10.20.193.96:0/2167879982 conn(0x7f6d8c0ea370 msgr2=0x7f6d8c10a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.519 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.518+0000 7f6d90c0c6c0 1 -- 10.20.193.96:0/2167879982 shutdown_connections 2026-02-13T03:32:22.519 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.519+0000 7f6d90c0c6c0 1 -- 10.20.193.96:0/2167879982 wait complete. 2026-02-13T03:32:22.519 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.519+0000 7f6d90c0c6c0 1 Processor -- start 2026-02-13T03:32:22.519 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.519+0000 7f6d90c0c6c0 1 -- start start 2026-02-13T03:32:22.520 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.519+0000 7f6d90c0c6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6d8c10cc50 0x7f6d8c061ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.520 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.519+0000 7f6d90c0c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6d8c10ddd0 0x7f6d8c062330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.520 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.520+0000 7f6d89d746c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6d8c10ddd0 0x7f6d8c062330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.520 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.520+0000 7f6d89d746c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6d8c10ddd0 0x7f6d8c062330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:58792/0 (socket says 10.20.193.96:58792) 2026-02-13T03:32:22.520 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.520+0000 7f6d90c0c6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6d8c10e780 0x7f6d8c0607f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.520 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.520+0000 7f6d89d746c0 1 -- 10.20.193.96:0/4273568872 learned_addr learned my addr 10.20.193.96:0/4273568872 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:22.520 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.520+0000 7f6d90c0c6c0 1 -- 10.20.193.96:0/4273568872 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8c060f80 con 0x7f6d8c10ddd0 2026-02-13T03:32:22.520 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.520+0000 7f6d90c0c6c0 1 -- 10.20.193.96:0/4273568872 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8c0610f0 con 0x7f6d8c10e780 2026-02-13T03:32:22.520 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.520+0000 7f6d90c0c6c0 1 -- 10.20.193.96:0/4273568872 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8c0612b0 con 0x7f6d8c10cc50 2026-02-13T03:32:22.520 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.520+0000 7f6d8ad766c0 1 --2- 10.20.193.96:0/4273568872 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6d8c10e780 0x7f6d8c0607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.520 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.520+0000 7f6d8ad766c0 1 -- 10.20.193.96:0/4273568872 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6d8c10e780 msgr2=0x7f6d8c0607f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-13T03:32:22.520 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.520+0000 7f6d8ad766c0 1 -- 10.20.193.96:0/4273568872 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6d8c10e780 msgr2=0x7f6d8c0607f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:32:22.521 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.520+0000 7f6d8ad766c0 1 --2- 10.20.193.96:0/4273568872 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6d8c10e780 0x7f6d8c0607f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:32:22.521 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.520+0000 7f6d8ad766c0 1 --2- 10.20.193.96:0/4273568872 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6d8c10e780 0x7f6d8c0607f0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:32:22.521 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.520+0000 7f6d8a5756c0 1 --2- 10.20.193.96:0/4273568872 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6d8c10cc50 0x7f6d8c061ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.521 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.520+0000 7f6d8a5756c0 1 -- 10.20.193.96:0/4273568872 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6d8c10cc50 msgr2=0x7f6d8c061ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T03:32:22.521 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.520+0000 7f6d8a5756c0 1 -- 10.20.193.96:0/4273568872 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6d8c10cc50 msgr2=0x7f6d8c061ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:32:22.521 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.520+0000 7f6d8a5756c0 1 --2- 10.20.193.96:0/4273568872 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6d8c10cc50 0x7f6d8c061ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:32:22.521 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.520+0000 7f6d8a5756c0 1 --2- 10.20.193.96:0/4273568872 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6d8c10cc50 0x7f6d8c061ce0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:32:22.525 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.527+0000 7f6d89d746c0 1 -- 10.20.193.96:0/4273568872 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6d8c10cc50 msgr2=0x7f6d8c061ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:32:22.525 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.527+0000 7f6d89d746c0 1 --2- 10.20.193.96:0/4273568872 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6d8c10cc50 0x7f6d8c061ce0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.525 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.527+0000 7f6d89d746c0 1 -- 10.20.193.96:0/4273568872 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6d8c10e780 msgr2=0x7f6d8c0607f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:32:22.525 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.527+0000 7f6d89d746c0 1 --2- 10.20.193.96:0/4273568872 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6d8c10e780 0x7f6d8c0607f0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.525 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.527+0000 7f6d89d746c0 1 -- 10.20.193.96:0/4273568872 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d740094c0 con 0x7f6d8c10ddd0 2026-02-13T03:32:22.526 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.527+0000 7f6d89d746c0 1 --2- 10.20.193.96:0/4273568872 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6d8c10ddd0 0x7f6d8c062330 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d74009230 tx=0x7f6d74002960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.526 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.527+0000 7f6d737fe6c0 1 -- 10.20.193.96:0/4273568872 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d740071c0 con 0x7f6d8c10ddd0 2026-02-13T03:32:22.526 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.528+0000 7f6d90c0c6c0 1 -- 10.20.193.96:0/4273568872 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d8c176410 con 0x7f6d8c10ddd0 2026-02-13T03:32:22.526 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.528+0000 7f6d737fe6c0 1 -- 10.20.193.96:0/4273568872 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f6d74007800 con 0x7f6d8c10ddd0 2026-02-13T03:32:22.526 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.528+0000 7f6d737fe6c0 1 -- 10.20.193.96:0/4273568872 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d74036730 con 0x7f6d8c10ddd0 2026-02-13T03:32:22.526 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.528+0000 7f6d90c0c6c0 1 -- 10.20.193.96:0/4273568872 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d8c176780 con 0x7f6d8c10ddd0 2026-02-13T03:32:22.526 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.527+0000 7f6d7a4086c0 1 -- 10.20.193.96:0/1783222492 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f6d741819f0 con 0x7f6d741167b0 2026-02-13T03:32:22.527 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.530+0000 7f6d90c0c6c0 1 -- 10.20.193.96:0/4273568872 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d8c058370 con 0x7f6d8c10ddd0 2026-02-13T03:32:22.528 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.531+0000 7fdc4e1886c0 1 -- 10.20.193.96:0/1129437695 shutdown_connections 2026-02-13T03:32:22.528 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.531+0000 7fdc4e1886c0 1 --2- 10.20.193.96:0/1129437695 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fdc1403f870 0x7fdc1405fd20 unknown :-1 s=CLOSED pgs=55 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.528 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.531+0000 7fdc4e1886c0 1 --2- 10.20.193.96:0/1129437695 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fdc481554e0 0x7fdc4811cfd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.531+0000 7fdc4e1886c0 1 --2- 10.20.193.96:0/1129437695 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fdc48134920 0x7fdc48154d40 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.531+0000 7fdc4e1886c0 1 --2- 10.20.193.96:0/1129437695 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdc48113f70 0x7fdc48175970 unknown :-1 s=CLOSED pgs=102 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.531+0000 7fdc4e1886c0 1 -- 10.20.193.96:0/1129437695 >> 10.20.193.96:0/1129437695 conn(0x7fdc4805b8e0 msgr2=0x7fdc4817ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.531+0000 7fdc4e1886c0 1 -- 10.20.193.96:0/1129437695 shutdown_connections 2026-02-13T03:32:22.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.531+0000 7fdc4e1886c0 1 -- 10.20.193.96:0/1129437695 wait complete. 2026-02-13T03:32:22.531 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.533+0000 7f6d717fa6c0 1 -- 10.20.193.96:0/1783222492 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v18)=0 v18) ==== 116+0+0 (secure 0 0 0) 0x7f6d64004780 con 0x7f6d741167b0 2026-02-13T03:32:22.531 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.531+0000 7f6d737fe6c0 1 -- 10.20.193.96:0/4273568872 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f6d74007320 con 0x7f6d8c10ddd0 2026-02-13T03:32:22.531 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.531+0000 7f6d737fe6c0 1 --2- 10.20.193.96:0/4273568872 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f6d6403f8f0 0x7f6d6405fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.531 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.531+0000 7f6d737fe6c0 1 -- 10.20.193.96:0/4273568872 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f6d74075a40 con 0x7f6d8c10ddd0 2026-02-13T03:32:22.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.532+0000 7f6d8a5756c0 1 --2- 10.20.193.96:0/4273568872 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f6d6403f8f0 0x7f6d6405fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.533+0000 7f6d8a5756c0 1 --2- 10.20.193.96:0/4273568872 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f6d6403f8f0 0x7f6d6405fda0 secure :-1 s=READY pgs=59 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d80005980 tx=0x7f6d80005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.536 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.539+0000 7f6d737fe6c0 1 -- 10.20.193.96:0/4273568872 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6d74034230 con 0x7f6d8c10ddd0 2026-02-13T03:32:22.538 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.541+0000 7f6d7a4086c0 1 -- 10.20.193.96:0/1783222492 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f6d4803f8f0 msgr2=0x7f6d4805fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.539 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.541+0000 7f6d7a4086c0 1 --2- 10.20.193.96:0/1783222492 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f6d4803f8f0 0x7f6d4805fda0 secure :-1 s=READY pgs=56 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d60005b40 tx=0x7f6d600073d0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.539 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.541+0000 7f6d7a4086c0 1 -- 10.20.193.96:0/1783222492 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6d741167b0 msgr2=0x7f6d74177af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.539 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.541+0000 7f6d7a4086c0 1 --2- 10.20.193.96:0/1783222492 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6d741167b0 0x7f6d74177af0 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d64005dc0 tx=0x7f6d6400bbd0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.539 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.541+0000 7f6d7a4086c0 1 -- 10.20.193.96:0/1783222492 shutdown_connections 2026-02-13T03:32:22.539 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.541+0000 7f6d7a4086c0 1 --2- 10.20.193.96:0/1783222492 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f6d4803f8f0 0x7f6d4805fda0 unknown :-1 s=CLOSED pgs=56 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.540 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.541+0000 7f6d7a4086c0 1 --2- 10.20.193.96:0/1783222492 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6d74117160 0x7f6d741008f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.540 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.541+0000 7f6d7a4086c0 1 --2- 10.20.193.96:0/1783222492 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6d741167b0 0x7f6d74177af0 unknown :-1 s=CLOSED pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.540 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.541+0000 7f6d7a4086c0 1 --2- 10.20.193.96:0/1783222492 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6d74115630 0x7f6d74100090 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.540 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.542+0000 7f6d7a4086c0 1 -- 10.20.193.96:0/1783222492 >> 10.20.193.96:0/1783222492 conn(0x7f6d7405db80 msgr2=0x7f6d740f6620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.540 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.542+0000 7f6d7a4086c0 1 -- 10.20.193.96:0/1783222492 shutdown_connections 2026-02-13T03:32:22.541 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.544+0000 7f6d7a4086c0 1 -- 10.20.193.96:0/1783222492 wait complete. 2026-02-13T03:32:22.550 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:22.554 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:22.582 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.580+0000 7f2b461326c0 1 -- 10.20.193.96:0/869243380 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2b380b4370 msgr2=0x7f2b380b4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.582 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.580+0000 7f2b461326c0 1 --2- 10.20.193.96:0/869243380 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2b380b4370 0x7f2b380b4810 secure :-1 s=READY pgs=113 gs=3 cs=0 l=1 c_cookie=16624296253508244139 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b340098a0 tx=0x7f2b3402ec40 comp rx=0 tx=0).stop 2026-02-13T03:32:22.582 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.581+0000 7f2b461326c0 1 -- 10.20.193.96:0/869243380 shutdown_connections 2026-02-13T03:32:22.582 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.581+0000 7f2b461326c0 1 --2- 10.20.193.96:0/869243380 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2b380b4370 0x7f2b380b4810 unknown :-1 s=CLOSED pgs=113 gs=3 cs=0 l=1 c_cookie=16624296253508244139 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.581+0000 7f2b461326c0 1 --2- 10.20.193.96:0/869243380 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2b380073e0 0x7f2b38007850 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.581+0000 7f2b461326c0 1 --2- 10.20.193.96:0/869243380 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2b38008820 0x7f2b38006ea0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.581+0000 7f2b461326c0 1 -- 10.20.193.96:0/869243380 >> 10.20.193.96:0/869243380 conn(0x7f2b38091f90 msgr2=0x7f2b380b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.581+0000 7f2b461326c0 1 -- 10.20.193.96:0/869243380 shutdown_connections 2026-02-13T03:32:22.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.581+0000 7f2b461326c0 1 -- 10.20.193.96:0/869243380 wait complete. 2026-02-13T03:32:22.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.581+0000 7f2b461326c0 1 Processor -- start 2026-02-13T03:32:22.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.581+0000 7f2b461326c0 1 -- start start 2026-02-13T03:32:22.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.581+0000 7f2b461326c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2b380073e0 0x7f2b3809d8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.581+0000 7f2b461326c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2b38008820 0x7f2b3809df20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.581+0000 7f2b461326c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2b380b4370 0x7f2b3809eb10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.582+0000 7f2b461326c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3809f2a0 con 0x7f2b38008820 2026-02-13T03:32:22.584 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.582+0000 7f2b461326c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3809f410 con 0x7f2b380073e0 2026-02-13T03:32:22.584 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.582+0000 7f2b461326c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3809f5d0 con 0x7f2b380b4370 2026-02-13T03:32:22.584 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.582+0000 7f2b451306c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2b380073e0 0x7f2b3809d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.584 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.582+0000 7f2b451306c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2b380073e0 0x7f2b3809d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.132:3300/0 says I am v2:10.20.193.96:47678/0 (socket says 10.20.193.96:47678) 2026-02-13T03:32:22.584 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.582+0000 7f2b451306c0 1 -- 10.20.193.96:0/1182099770 learned_addr learned my addr 10.20.193.96:0/1182099770 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:22.584 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.582+0000 7f2b4492f6c0 1 --2- 10.20.193.96:0/1182099770 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2b38008820 0x7f2b3809df20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.584 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.582+0000 7f2b451306c0 1 -- 10.20.193.96:0/1182099770 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2b380073e0 msgr2=0x7f2b3809d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-13T03:32:22.584 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.582+0000 7f2b451306c0 1 -- 10.20.193.96:0/1182099770 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2b380073e0 msgr2=0x7f2b3809d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:32:22.584 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.582+0000 7f2b451306c0 1 --2- 10.20.193.96:0/1182099770 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2b380073e0 0x7f2b3809d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:32:22.584 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.582+0000 7f2b451306c0 1 --2- 10.20.193.96:0/1182099770 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2b380073e0 0x7f2b3809d8d0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:32:22.584 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.582+0000 7f2b459316c0 1 --2- 10.20.193.96:0/1182099770 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2b380b4370 0x7f2b3809eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.584 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.582+0000 7f2b459316c0 1 -- 10.20.193.96:0/1182099770 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2b380b4370 msgr2=0x7f2b3809eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T03:32:22.585 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.582+0000 7f2b459316c0 1 -- 10.20.193.96:0/1182099770 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2b380b4370 msgr2=0x7f2b3809eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:32:22.585 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.582+0000 7f2b459316c0 1 --2- 10.20.193.96:0/1182099770 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2b380b4370 0x7f2b3809eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:32:22.585 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.582+0000 7f2b459316c0 1 --2- 10.20.193.96:0/1182099770 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2b380b4370 0x7f2b3809eb10 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:32:22.585 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.582+0000 7f2b4492f6c0 1 -- 10.20.193.96:0/1182099770 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2b380b4370 msgr2=0x7f2b3809eb10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:32:22.585 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.582+0000 7f2b4492f6c0 1 --2- 10.20.193.96:0/1182099770 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2b380b4370 0x7f2b3809eb10 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.585 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.582+0000 7f2b4492f6c0 1 -- 10.20.193.96:0/1182099770 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2b380073e0 msgr2=0x7f2b3809d8d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:32:22.585 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.582+0000 7f2b4492f6c0 1 --2- 10.20.193.96:0/1182099770 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2b380073e0 0x7f2b3809d8d0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.585 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.582+0000 7f2b4492f6c0 1 -- 10.20.193.96:0/1182099770 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b340094c0 con 0x7f2b38008820 2026-02-13T03:32:22.585 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.582+0000 7f2b4492f6c0 1 --2- 10.20.193.96:0/1182099770 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2b38008820 0x7f2b3809df20 secure :-1 s=READY pgs=114 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b3000b6c0 tx=0x7f2b3000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.585 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.583+0000 7f2b2e7fc6c0 1 -- 10.20.193.96:0/1182099770 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b30004250 con 0x7f2b38008820 2026-02-13T03:32:22.585 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.583+0000 7f2b2e7fc6c0 1 -- 10.20.193.96:0/1182099770 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f2b30004d40 con 0x7f2b38008820 2026-02-13T03:32:22.586 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.584+0000 7f2b2e7fc6c0 1 -- 10.20.193.96:0/1182099770 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b30002930 con 0x7f2b38008820 2026-02-13T03:32:22.586 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.585+0000 7f2b461326c0 1 -- 10.20.193.96:0/1182099770 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b3809f8b0 con 0x7f2b38008820 2026-02-13T03:32:22.586 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.585+0000 7f2b461326c0 1 -- 10.20.193.96:0/1182099770 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b3813e950 con 0x7f2b38008820 2026-02-13T03:32:22.586 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.586+0000 7f2b461326c0 1 -- 10.20.193.96:0/1182099770 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b380b8ae0 con 0x7f2b38008820 2026-02-13T03:32:22.586 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.586+0000 7f2b2e7fc6c0 1 -- 10.20.193.96:0/1182099770 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f2b300043b0 con 0x7f2b38008820 2026-02-13T03:32:22.586 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.586+0000 7f2b2e7fc6c0 1 --2- 10.20.193.96:0/1182099770 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f2b1c03f870 0x7f2b1c05fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.587 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.586+0000 7f2b2e7fc6c0 1 -- 10.20.193.96:0/1182099770 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f2b30051130 con 0x7f2b38008820 2026-02-13T03:32:22.587 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.586+0000 7f2b451306c0 1 --2- 10.20.193.96:0/1182099770 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f2b1c03f870 0x7f2b1c05fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.587 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.587+0000 7f2b451306c0 1 --2- 10.20.193.96:0/1182099770 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f2b1c03f870 0x7f2b1c05fd20 secure :-1 s=READY pgs=60 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b3c005830 tx=0x7f2b3c0069f0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.588 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.590+0000 7f2b2e7fc6c0 1 -- 10.20.193.96:0/1182099770 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2b30004780 con 0x7f2b38008820 2026-02-13T03:32:22.592 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.596 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.597 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.598+0000 7fa2351c86c0 1 -- 10.20.193.96:0/1630260459 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa23010cc90 msgr2=0x7fa23010d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.597 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.598+0000 7fa2351c86c0 1 --2- 10.20.193.96:0/1630260459 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa23010cc90 0x7fa23010d100 secure :-1 s=READY pgs=115 gs=1 cs=0 l=1 c_cookie=2778676578394824474 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa218009970 tx=0x7fa21802ed70 comp rx=0 tx=0).stop 2026-02-13T03:32:22.597 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.598+0000 7fa2351c86c0 1 -- 10.20.193.96:0/1630260459 shutdown_connections 2026-02-13T03:32:22.598 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.598+0000 7fa2351c86c0 1 --2- 10.20.193.96:0/1630260459 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa23010d640 0x7fa23016dfd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.598 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.598+0000 7fa2351c86c0 1 --2- 10.20.193.96:0/1630260459 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa23010cc90 0x7fa23010d100 unknown :-1 s=CLOSED pgs=115 gs=1 cs=0 l=1 c_cookie=2778676578394824474 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.598 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.598+0000 7fa2351c86c0 1 --2- 10.20.193.96:0/1630260459 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa23010bb10 0x7fa23010bf00 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.598 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.598+0000 7fa2351c86c0 1 -- 10.20.193.96:0/1630260459 >> 10.20.193.96:0/1630260459 conn(0x7fa2300e9230 msgr2=0x7fa230109640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.598 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.600+0000 7fa2351c86c0 1 -- 10.20.193.96:0/1630260459 shutdown_connections 2026-02-13T03:32:22.598 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.600+0000 7fa2351c86c0 1 -- 10.20.193.96:0/1630260459 wait complete. 2026-02-13T03:32:22.599 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.598+0000 7f810442d6c0 1 -- 10.20.193.96:0/3559321532 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f80fc110a00 msgr2=0x7f80fc171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.599 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.598+0000 7f810442d6c0 1 --2- 10.20.193.96:0/3559321532 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f80fc110a00 0x7f80fc171390 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=2563278005124829388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80f800aa40 tx=0x7f80f802fde0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.599 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.599+0000 7f810442d6c0 1 -- 10.20.193.96:0/3559321532 shutdown_connections 2026-02-13T03:32:22.599 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.599+0000 7f810442d6c0 1 --2- 10.20.193.96:0/3559321532 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f80fc110a00 0x7f80fc171390 unknown :-1 s=CLOSED pgs=116 gs=1 cs=0 l=1 c_cookie=2563278005124829388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.599+0000 7f810442d6c0 1 --2- 10.20.193.96:0/3559321532 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f80fc110050 0x7f80fc1104c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.599+0000 7f810442d6c0 1 --2- 10.20.193.96:0/3559321532 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f80fc10eed0 0x7f80fc10f2c0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.599+0000 7f810442d6c0 1 -- 10.20.193.96:0/3559321532 >> 10.20.193.96:0/3559321532 conn(0x7f80fc0ec5f0 msgr2=0x7f80fc10ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.599+0000 7f810442d6c0 1 -- 10.20.193.96:0/3559321532 shutdown_connections 2026-02-13T03:32:22.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.599+0000 7f810442d6c0 1 -- 10.20.193.96:0/3559321532 wait complete. 2026-02-13T03:32:22.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.599+0000 7f810442d6c0 1 Processor -- start 2026-02-13T03:32:22.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.600+0000 7f810442d6c0 1 -- start start 2026-02-13T03:32:22.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.600+0000 7f810442d6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f80fc10eed0 0x7f80fc0f82c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.600+0000 7f810442d6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f80fc110050 0x7f80fc171370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.600+0000 7f810199d6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f80fc110050 0x7f80fc171370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.600+0000 7f810199d6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f80fc110050 0x7f80fc171370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:58856/0 (socket says 10.20.193.96:58856) 2026-02-13T03:32:22.601 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.600+0000 7f810199d6c0 1 -- 10.20.193.96:0/915957713 learned_addr learned my addr 10.20.193.96:0/915957713 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:22.601 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.600+0000 7f810442d6c0 1 --2- 10.20.193.96:0/915957713 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f80fc110a00 0x7f80fc0f8b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.601 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.600+0000 7f810442d6c0 1 -- 10.20.193.96:0/915957713 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f80fc0f9750 con 0x7f80fc110050 2026-02-13T03:32:22.601 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.601+0000 7f810442d6c0 1 -- 10.20.193.96:0/915957713 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f80fc0f98c0 con 0x7f80fc110a00 2026-02-13T03:32:22.602 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.601+0000 7fa2351c86c0 1 Processor -- start 2026-02-13T03:32:22.602 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.601+0000 7fa2351c86c0 1 -- start start 2026-02-13T03:32:22.602 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.601+0000 7fa2351c86c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa23010bb10 0x7fa2300f5110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.602 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.601+0000 7fa2351c86c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa23010cc90 0x7fa23016dfd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.602 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.601+0000 7fa2351c86c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa23010d640 0x7fa2300f5970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.603 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.601+0000 7fa22ed766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa23010bb10 0x7fa2300f5110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.603 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.601+0000 7fa2351c86c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa2300f65a0 con 0x7fa23010bb10 2026-02-13T03:32:22.603 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.601+0000 7fa22ed766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa23010bb10 0x7fa2300f5110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:58868/0 (socket says 10.20.193.96:58868) 2026-02-13T03:32:22.603 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.601+0000 7fa22ed766c0 1 -- 10.20.193.96:0/2255798277 learned_addr learned my addr 10.20.193.96:0/2255798277 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:22.603 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.601+0000 7fa2351c86c0 1 -- 10.20.193.96:0/2255798277 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa2300f6710 con 0x7fa23010cc90 2026-02-13T03:32:22.603 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.601+0000 7fa2351c86c0 1 -- 10.20.193.96:0/2255798277 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa2300f68d0 con 0x7fa23010d640 2026-02-13T03:32:22.603 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.601+0000 7f810299f6c0 1 --2- 10.20.193.96:0/915957713 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f80fc110a00 0x7f80fc0f8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.603 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.601+0000 7f810442d6c0 1 -- 10.20.193.96:0/915957713 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f80fc0f9a80 con 0x7f80fc10eed0 2026-02-13T03:32:22.605 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.601+0000 7fa22f5776c0 1 --2- 10.20.193.96:0/2255798277 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa23010d640 0x7fa2300f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.605 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.602+0000 7fa22f5776c0 1 -- 10.20.193.96:0/2255798277 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa23010d640 msgr2=0x7fa2300f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T03:32:22.606 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.602+0000 7fa22f5776c0 1 -- 10.20.193.96:0/2255798277 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa23010d640 msgr2=0x7fa2300f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:32:22.606 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.602+0000 7fa22f5776c0 1 --2- 10.20.193.96:0/2255798277 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa23010d640 0x7fa2300f5970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:32:22.606 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.602+0000 7fa22ed766c0 1 -- 10.20.193.96:0/2255798277 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa23010d640 msgr2=0x7fa2300f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.606 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.602+0000 7fa22f5776c0 1 --2- 10.20.193.96:0/2255798277 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa23010d640 0x7fa2300f5970 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:32:22.606 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.602+0000 7fa22ed766c0 1 --2- 10.20.193.96:0/2255798277 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa23010d640 0x7fa2300f5970 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.606 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.602+0000 7fa22ed766c0 1 -- 10.20.193.96:0/2255798277 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa23010cc90 msgr2=0x7fa23016dfd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:32:22.606 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.602+0000 7fa22ed766c0 1 --2- 10.20.193.96:0/2255798277 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa23010cc90 0x7fa23016dfd0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.606 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.602+0000 7fa22ed766c0 1 -- 10.20.193.96:0/2255798277 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa218009590 con 0x7fa23010bb10 2026-02-13T03:32:22.606 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.602+0000 7fa22ed766c0 1 --2- 10.20.193.96:0/2255798277 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa23010bb10 0x7fa2300f5110 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa22400b750 tx=0x7fa22400bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.606 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.602+0000 7fa20ffff6c0 1 -- 10.20.193.96:0/2255798277 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa224004290 con 0x7fa23010bb10 2026-02-13T03:32:22.606 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.602+0000 7fa2351c86c0 1 -- 10.20.193.96:0/2255798277 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2300f6bb0 con 0x7fa23010bb10 2026-02-13T03:32:22.607 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.602+0000 7fa2351c86c0 1 -- 10.20.193.96:0/2255798277 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2300f70e0 con 0x7fa23010bb10 2026-02-13T03:32:22.607 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.602+0000 7fa20ffff6c0 1 -- 10.20.193.96:0/2255798277 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fa2240043f0 con 0x7fa23010bb10 2026-02-13T03:32:22.607 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.602+0000 7fa20ffff6c0 1 -- 10.20.193.96:0/2255798277 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa22400cc80 con 0x7fa23010bb10 2026-02-13T03:32:22.607 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.603+0000 7fa20ffff6c0 1 -- 10.20.193.96:0/2255798277 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7fa22400e070 con 0x7fa23010bb10 2026-02-13T03:32:22.607 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.603+0000 7fa2351c86c0 1 -- 10.20.193.96:0/2255798277 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2301720e0 con 0x7fa23010bb10 2026-02-13T03:32:22.607 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.603+0000 7fa20ffff6c0 1 --2- 10.20.193.96:0/2255798277 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa20403f8f0 0x7fa20405fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.607 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.603+0000 7fa20ffff6c0 1 -- 10.20.193.96:0/2255798277 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7fa224051140 con 0x7fa23010bb10 2026-02-13T03:32:22.607 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.603+0000 7fa22e5756c0 1 --2- 10.20.193.96:0/2255798277 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa20403f8f0 0x7fa20405fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.607 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.604+0000 7fa22e5756c0 1 --2- 10.20.193.96:0/2255798277 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa20403f8f0 0x7fa20405fda0 secure :-1 s=READY pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2180098c0 tx=0x7fa2180023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.608 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.601+0000 7f810199d6c0 1 -- 10.20.193.96:0/915957713 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f80fc10eed0 msgr2=0x7f80fc0f82c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:32:22.608 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.601+0000 7f810199d6c0 1 --2- 10.20.193.96:0/915957713 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f80fc10eed0 0x7f80fc0f82c0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.609 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.601+0000 7f810199d6c0 1 -- 10.20.193.96:0/915957713 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f80fc110a00 msgr2=0x7f80fc0f8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.609 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.601+0000 7f810199d6c0 1 --2- 10.20.193.96:0/915957713 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f80fc110a00 0x7f80fc0f8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.609 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.601+0000 7f810199d6c0 1 -- 10.20.193.96:0/915957713 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f800a660 con 0x7f80fc110050 2026-02-13T03:32:22.609 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.601+0000 7f810199d6c0 1 --2- 10.20.193.96:0/915957713 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f80fc110050 0x7f80fc171370 secure :-1 s=READY pgs=117 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80f0005dc0 tx=0x7f80f000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.609 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.602+0000 7f80e37fe6c0 1 -- 10.20.193.96:0/915957713 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f80f0016ca0 con 0x7f80fc110050 2026-02-13T03:32:22.609 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.602+0000 7f80e37fe6c0 1 -- 10.20.193.96:0/915957713 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f80f0004510 con 0x7f80fc110050 2026-02-13T03:32:22.609 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.603+0000 7f80e37fe6c0 1 -- 10.20.193.96:0/915957713 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f80f0002930 con 0x7f80fc110050 2026-02-13T03:32:22.609 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.606+0000 7f63b7c986c0 1 -- 10.20.193.96:0/640931609 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f63780055c0 con 0x7f63b010cc40 2026-02-13T03:32:22.610 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.607+0000 7fa20ffff6c0 1 -- 10.20.193.96:0/2255798277 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa22400fd90 con 0x7fa23010bb10 2026-02-13T03:32:22.610 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.607+0000 7f810442d6c0 1 -- 10.20.193.96:0/915957713 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80fc0f9d00 con 0x7f80fc110050 2026-02-13T03:32:22.611 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.607+0000 7f810442d6c0 1 -- 10.20.193.96:0/915957713 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80fc0fa160 con 0x7f80fc110050 2026-02-13T03:32:22.611 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.607+0000 7f80e17fa6c0 1 -- 10.20.193.96:0/915957713 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80c8005310 con 0x7f80fc110050 2026-02-13T03:32:22.611 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.608+0000 7f80e37fe6c0 1 -- 10.20.193.96:0/915957713 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f80f0004030 con 0x7f80fc110050 2026-02-13T03:32:22.611 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.608+0000 7f80e37fe6c0 1 --2- 10.20.193.96:0/915957713 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f80cc03f940 0x7f80cc05fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.611 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.608+0000 7f810219e6c0 1 --2- 10.20.193.96:0/915957713 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f80cc03f940 0x7f80cc05fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.611 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.609+0000 7f80e37fe6c0 1 -- 10.20.193.96:0/915957713 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f80f0016e00 con 0x7f80fc110050 2026-02-13T03:32:22.611 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.609+0000 7f810219e6c0 1 --2- 10.20.193.96:0/915957713 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f80cc03f940 0x7f80cc05fdf0 secure :-1 s=READY pgs=62 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80ec005980 tx=0x7f80ec005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.611 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.612+0000 7f15e32686c0 1 -- 10.20.193.96:0/1668050570 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f15dc114be0 con 0x7f15dc1147f0 2026-02-13T03:32:22.612 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.612+0000 7f80e37fe6c0 1 -- 10.20.193.96:0/915957713 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f80f0004780 con 0x7f80fc110050 2026-02-13T03:32:22.613 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.615+0000 7f639effd6c0 1 -- 10.20.193.96:0/640931609 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v19)=0 v19) ==== 118+0+0 (secure 0 0 0) 0x7f63a00348d0 con 0x7f63b010cc40 2026-02-13T03:32:22.616 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.619+0000 7f63b7c986c0 1 -- 10.20.193.96:0/640931609 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f638c03f8c0 msgr2=0x7f638c05fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.616 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.619+0000 7f63b7c986c0 1 --2- 10.20.193.96:0/640931609 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f638c03f8c0 0x7f638c05fd70 secure :-1 s=READY pgs=58 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63a4005980 tx=0x7f63a4005910 comp rx=0 tx=0).stop 2026-02-13T03:32:22.616 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.619+0000 7f63b7c986c0 1 -- 10.20.193.96:0/640931609 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f63b010cc40 msgr2=0x7f63b0061ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.616 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.619+0000 7f63b7c986c0 1 --2- 10.20.193.96:0/640931609 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f63b010cc40 0x7f63b0061ce0 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63a0005b40 tx=0x7f63a0004570 comp rx=0 tx=0).stop 2026-02-13T03:32:22.617 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.620+0000 7f23055f76c0 1 -- 10.20.193.96:0/4256575404 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f230010e780 msgr2=0x7f230016f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.620+0000 7f23055f76c0 1 --2- 10.20.193.96:0/4256575404 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f230010e780 0x7f230016f110 secure :-1 s=READY pgs=119 gs=1 cs=0 l=1 c_cookie=1816064192567108831 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22f0006fd0 tx=0x7f22f002fd20 comp rx=0 tx=0).stop 2026-02-13T03:32:22.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.620+0000 7f15d1ffb6c0 1 -- 10.20.193.96:0/1668050570 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v20)=0 v20) ==== 116+0+0 (secure 0 0 0) 0x7f15d8003af0 con 0x7f15dc1147f0 2026-02-13T03:32:22.620 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.620+0000 7f23055f76c0 1 -- 10.20.193.96:0/4256575404 shutdown_connections 2026-02-13T03:32:22.621 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.620+0000 7f23055f76c0 1 --2- 10.20.193.96:0/4256575404 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f230010e780 0x7f230016f110 unknown :-1 s=CLOSED pgs=119 gs=1 cs=0 l=1 c_cookie=1816064192567108831 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.621 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.620+0000 7f23055f76c0 1 --2- 10.20.193.96:0/4256575404 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f230010ddd0 0x7f230010e240 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.621 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.620+0000 7f23055f76c0 1 --2- 10.20.193.96:0/4256575404 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f230010cc50 0x7f230010d040 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.621 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.620+0000 7f23055f76c0 1 -- 10.20.193.96:0/4256575404 >> 10.20.193.96:0/4256575404 conn(0x7f23000ea370 msgr2=0x7f230010a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.621 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.620+0000 7f23055f76c0 1 -- 10.20.193.96:0/4256575404 shutdown_connections 2026-02-13T03:32:22.621 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.620+0000 7f23055f76c0 1 -- 10.20.193.96:0/4256575404 wait complete. 2026-02-13T03:32:22.621 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.621+0000 7f23055f76c0 1 Processor -- start 2026-02-13T03:32:22.621 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.621+0000 7f23055f76c0 1 -- start start 2026-02-13T03:32:22.621 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.621+0000 7f23055f76c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f230010cc50 0x7f23000f6020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.621 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.621+0000 7f23055f76c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f230010ddd0 0x7f230016f110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.622 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.621+0000 7f22feffd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f230010cc50 0x7f23000f6020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.622 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.621+0000 7f22feffd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f230010cc50 0x7f23000f6020 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:58890/0 (socket says 10.20.193.96:58890) 2026-02-13T03:32:22.622 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.621+0000 7f22feffd6c0 1 -- 10.20.193.96:0/3215187975 learned_addr learned my addr 10.20.193.96:0/3215187975 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:22.622 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.622+0000 7f23055f76c0 1 --2- 10.20.193.96:0/3215187975 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f230010e780 0x7f23000f6880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.622 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.622+0000 7f22fe7fc6c0 1 --2- 10.20.193.96:0/3215187975 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f230010ddd0 0x7f230016f110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.622 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.622+0000 7f23055f76c0 1 -- 10.20.193.96:0/3215187975 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f23000f74b0 con 0x7f230010cc50 2026-02-13T03:32:22.622 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.622+0000 7f23055f76c0 1 -- 10.20.193.96:0/3215187975 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f23000f7620 con 0x7f230010e780 2026-02-13T03:32:22.622 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.622+0000 7f23055f76c0 1 -- 10.20.193.96:0/3215187975 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f23000f77e0 con 0x7f230010ddd0 2026-02-13T03:32:22.622 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.622+0000 7f22ff7fe6c0 1 --2- 10.20.193.96:0/3215187975 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f230010e780 0x7f23000f6880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.622 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.622+0000 7f22fe7fc6c0 1 -- 10.20.193.96:0/3215187975 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f230010ddd0 msgr2=0x7f230016f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-13T03:32:22.622 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.622+0000 7f22fe7fc6c0 1 -- 10.20.193.96:0/3215187975 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f230010ddd0 msgr2=0x7f230016f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:32:22.623 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.622+0000 7f22fe7fc6c0 1 --2- 10.20.193.96:0/3215187975 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f230010ddd0 0x7f230016f110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:32:22.623 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.622+0000 7f22feffd6c0 1 -- 10.20.193.96:0/3215187975 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f230010ddd0 msgr2=0x7f230016f110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:32:22.623 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.622+0000 7f22fe7fc6c0 1 --2- 10.20.193.96:0/3215187975 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f230010ddd0 0x7f230016f110 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:32:22.623 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.622+0000 7f22feffd6c0 1 --2- 10.20.193.96:0/3215187975 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f230010ddd0 0x7f230016f110 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.623 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.622+0000 7f22feffd6c0 1 -- 10.20.193.96:0/3215187975 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f230010e780 msgr2=0x7f23000f6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.623 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.622+0000 7f22feffd6c0 1 --2- 10.20.193.96:0/3215187975 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f230010e780 0x7f23000f6880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.623 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.622+0000 7f22feffd6c0 1 -- 10.20.193.96:0/3215187975 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f000a5b0 con 0x7f230010cc50 2026-02-13T03:32:22.623 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.622+0000 7f22feffd6c0 1 --2- 10.20.193.96:0/3215187975 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f230010cc50 0x7f23000f6020 secure :-1 s=READY pgs=120 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22f4005980 tx=0x7f22f400bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.624 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.622+0000 7f22ff7fe6c0 1 --2- 10.20.193.96:0/3215187975 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f230010e780 0x7f23000f6880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:32:22.624 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.622+0000 7f22dffff6c0 1 -- 10.20.193.96:0/3215187975 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22f4004250 con 0x7f230010cc50 2026-02-13T03:32:22.624 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.622+0000 7f22dffff6c0 1 -- 10.20.193.96:0/3215187975 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f22f400be30 con 0x7f230010cc50 2026-02-13T03:32:22.624 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.622+0000 7f22dffff6c0 1 -- 10.20.193.96:0/3215187975 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22f4011070 con 0x7f230010cc50 2026-02-13T03:32:22.624 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.623+0000 7f23055f76c0 1 -- 10.20.193.96:0/3215187975 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23000f7ac0 con 0x7f230010cc50 2026-02-13T03:32:22.624 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.623+0000 7f23055f76c0 1 -- 10.20.193.96:0/3215187975 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23000f7f50 con 0x7f230010cc50 2026-02-13T03:32:22.626 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.623+0000 7f22ddffb6c0 1 -- 10.20.193.96:0/3215187975 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22c8005310 con 0x7f230010cc50 2026-02-13T03:32:22.627 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.623+0000 7f22dffff6c0 1 -- 10.20.193.96:0/3215187975 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f22f4004860 con 0x7f230010cc50 2026-02-13T03:32:22.627 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.624+0000 7f22dffff6c0 1 --2- 10.20.193.96:0/3215187975 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f22d403f8f0 0x7f22d405fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.627 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.624+0000 7f22dffff6c0 1 -- 10.20.193.96:0/3215187975 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f22f40514d0 con 0x7f230010cc50 2026-02-13T03:32:22.627 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.624+0000 7f22fe7fc6c0 1 --2- 10.20.193.96:0/3215187975 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f22d403f8f0 0x7f22d405fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.628 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.623+0000 7f63b7c986c0 1 -- 10.20.193.96:0/640931609 shutdown_connections 2026-02-13T03:32:22.628 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.623+0000 7f63b7c986c0 1 --2- 10.20.193.96:0/640931609 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f638c03f8c0 0x7f638c05fd70 unknown :-1 s=CLOSED pgs=58 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.628 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.623+0000 7f63b7c986c0 1 --2- 10.20.193.96:0/640931609 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f63b010e770 0x7f63b00605e0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.628 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.623+0000 7f63b7c986c0 1 --2- 10.20.193.96:0/640931609 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f63b010ddc0 0x7f63b016f100 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.628 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.623+0000 7f63b7c986c0 1 --2- 10.20.193.96:0/640931609 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f63b010cc40 0x7f63b0061ce0 unknown :-1 s=CLOSED pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.628 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.623+0000 7f63b7c986c0 1 -- 10.20.193.96:0/640931609 >> 10.20.193.96:0/640931609 conn(0x7f63b00ea360 msgr2=0x7f63b00ec2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.629 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.623+0000 7f63b7c986c0 1 -- 10.20.193.96:0/640931609 shutdown_connections 2026-02-13T03:32:22.629 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.624+0000 7f22fe7fc6c0 1 --2- 10.20.193.96:0/3215187975 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f22d403f8f0 0x7f22d405fda0 secure :-1 s=READY pgs=63 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22e8005980 tx=0x7f22e8005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.630 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.624+0000 7f63b7c986c0 1 -- 10.20.193.96:0/640931609 wait complete. 2026-02-13T03:32:22.631 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.625+0000 7f15e32686c0 1 -- 10.20.193.96:0/1668050570 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f15b803f8f0 msgr2=0x7f15b805fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.631 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.625+0000 7f15e32686c0 1 --2- 10.20.193.96:0/1668050570 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f15b803f8f0 0x7f15b805fda0 secure :-1 s=READY pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15cc006ae0 tx=0x7f15cc006ef0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.631 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.625+0000 7f15e32686c0 1 -- 10.20.193.96:0/1668050570 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f15dc1147f0 msgr2=0x7f15dc107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.631 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.625+0000 7f15e32686c0 1 --2- 10.20.193.96:0/1668050570 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f15dc1147f0 0x7f15dc107c90 secure :-1 s=READY pgs=106 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15d800c6c0 tx=0x7f15d800cb90 comp rx=0 tx=0).stop 2026-02-13T03:32:22.631 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.625+0000 7f15e32686c0 1 -- 10.20.193.96:0/1668050570 shutdown_connections 2026-02-13T03:32:22.631 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.625+0000 7f15e32686c0 1 --2- 10.20.193.96:0/1668050570 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f15b803f8f0 0x7f15b805fda0 unknown :-1 s=CLOSED pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.625+0000 7f15e32686c0 1 --2- 10.20.193.96:0/1668050570 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f15dc1147f0 0x7f15dc107c90 unknown :-1 s=CLOSED pgs=106 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.625+0000 7f15e32686c0 1 --2- 10.20.193.96:0/1668050570 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f15dc113f10 0x7f15dc175870 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.625+0000 7f15e32686c0 1 --2- 10.20.193.96:0/1668050570 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f15dc113560 0x7f15dc107430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.625+0000 7f15e32686c0 1 -- 10.20.193.96:0/1668050570 >> 10.20.193.96:0/1668050570 conn(0x7f15dc064300 msgr2=0x7f15dc066d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.625+0000 7f15e32686c0 1 -- 10.20.193.96:0/1668050570 shutdown_connections 2026-02-13T03:32:22.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.625+0000 7f15e32686c0 1 -- 10.20.193.96:0/1668050570 wait complete. 2026-02-13T03:32:22.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.628+0000 7f22dffff6c0 1 -- 10.20.193.96:0/3215187975 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f22f4004b40 con 0x7f230010cc50 2026-02-13T03:32:22.636 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.629+0000 7f97244016c0 1 -- 10.20.193.96:0/1539387059 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f971c110a00 msgr2=0x7f971c171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.629+0000 7f97244016c0 1 --2- 10.20.193.96:0/1539387059 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f971c110a00 0x7f971c171390 secure :-1 s=READY pgs=121 gs=2 cs=0 l=1 c_cookie=17216587652491684188 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9718006fd0 tx=0x7f971802fd20 comp rx=0 tx=0).stop 2026-02-13T03:32:22.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.629+0000 7f97244016c0 1 -- 10.20.193.96:0/1539387059 shutdown_connections 2026-02-13T03:32:22.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.629+0000 7f97244016c0 1 --2- 10.20.193.96:0/1539387059 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f971c110a00 0x7f971c171390 unknown :-1 s=CLOSED pgs=121 gs=2 cs=0 l=1 c_cookie=17216587652491684188 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.629+0000 7f97244016c0 1 --2- 10.20.193.96:0/1539387059 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f971c110050 0x7f971c1104c0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.629+0000 7f97244016c0 1 --2- 10.20.193.96:0/1539387059 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f971c10eed0 0x7f971c10f2c0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.629+0000 7f97244016c0 1 -- 10.20.193.96:0/1539387059 >> 10.20.193.96:0/1539387059 conn(0x7f971c0ec5f0 msgr2=0x7f971c10ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.629+0000 7f97244016c0 1 -- 10.20.193.96:0/1539387059 shutdown_connections 2026-02-13T03:32:22.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.629+0000 7f97244016c0 1 -- 10.20.193.96:0/1539387059 wait complete. 2026-02-13T03:32:22.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.629+0000 7f97244016c0 1 Processor -- start 2026-02-13T03:32:22.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.629+0000 7f97244016c0 1 -- start start 2026-02-13T03:32:22.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.630+0000 7f97244016c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f971c10eed0 0x7f971c1138a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.630+0000 7f97244016c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f971c110050 0x7f971c113ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.630+0000 7f97244016c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f971c110a00 0x7f971c114ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.630+0000 7f97244016c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f971c115270 con 0x7f971c110a00 2026-02-13T03:32:22.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.630+0000 7f97244016c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f971c1153e0 con 0x7f971c10eed0 2026-02-13T03:32:22.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.630+0000 7f97244016c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f971c1155a0 con 0x7f971c110050 2026-02-13T03:32:22.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.630+0000 7f97219716c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f971c110050 0x7f971c113ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.630+0000 7f97219716c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f971c110050 0x7f971c113ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.133:3300/0 says I am v2:10.20.193.96:33550/0 (socket says 10.20.193.96:33550) 2026-02-13T03:32:22.639 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.630+0000 7f97219716c0 1 -- 10.20.193.96:0/1589063580 learned_addr learned my addr 10.20.193.96:0/1589063580 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:22.639 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.630+0000 7f97219716c0 1 -- 10.20.193.96:0/1589063580 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f971c110050 msgr2=0x7f971c113ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-13T03:32:22.639 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.630+0000 7f97219716c0 1 -- 10.20.193.96:0/1589063580 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f971c110050 msgr2=0x7f971c113ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:32:22.639 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.630+0000 7f97219716c0 1 --2- 10.20.193.96:0/1589063580 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f971c110050 0x7f971c113ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:32:22.639 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.630+0000 7f97219716c0 1 --2- 10.20.193.96:0/1589063580 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f971c110050 0x7f971c113ef0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:32:22.639 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.630+0000 7f97229736c0 1 --2- 10.20.193.96:0/1589063580 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f971c110a00 0x7f971c114ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.639 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.630+0000 7f97229736c0 1 -- 10.20.193.96:0/1589063580 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f971c110050 msgr2=0x7f971c113ef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:32:22.639 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.630+0000 7f97229736c0 1 --2- 10.20.193.96:0/1589063580 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f971c110050 0x7f971c113ef0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.639 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.630+0000 7f97229736c0 1 -- 10.20.193.96:0/1589063580 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f971c10eed0 msgr2=0x7f971c1138a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:32:22.639 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.630+0000 7f97229736c0 1 --2- 10.20.193.96:0/1589063580 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f971c10eed0 0x7f971c1138a0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.640 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.630+0000 7f97229736c0 1 -- 10.20.193.96:0/1589063580 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f971800a5b0 con 0x7f971c110a00 2026-02-13T03:32:22.640 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.633+0000 7f97229736c0 1 --2- 10.20.193.96:0/1589063580 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f971c110a00 0x7f971c114ae0 secure :-1 s=READY pgs=122 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9718006fd0 tx=0x7f97180307b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.640 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.633+0000 7f97037fe6c0 1 -- 10.20.193.96:0/1589063580 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9718003c40 con 0x7f971c110a00 2026-02-13T03:32:22.640 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.633+0000 7f97037fe6c0 1 -- 10.20.193.96:0/1589063580 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f9718003da0 con 0x7f971c110a00 2026-02-13T03:32:22.640 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.634+0000 7f97037fe6c0 1 -- 10.20.193.96:0/1589063580 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9718039500 con 0x7f971c110a00 2026-02-13T03:32:22.640 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.634+0000 7f97244016c0 1 -- 10.20.193.96:0/1589063580 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f971c115820 con 0x7f971c110a00 2026-02-13T03:32:22.640 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.634+0000 7f97244016c0 1 -- 10.20.193.96:0/1589063580 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f971c155d20 con 0x7f971c110a00 2026-02-13T03:32:22.640 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.634+0000 7f97244016c0 1 -- 10.20.193.96:0/1589063580 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f971c065d10 con 0x7f971c110a00 2026-02-13T03:32:22.640 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.635+0000 7f97037fe6c0 1 -- 10.20.193.96:0/1589063580 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f9718039660 con 0x7f971c110a00 2026-02-13T03:32:22.640 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.635+0000 7f97037fe6c0 1 --2- 10.20.193.96:0/1589063580 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f96f803f870 0x7f96f805fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.641 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.635+0000 7f97037fe6c0 1 -- 10.20.193.96:0/1589063580 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f9718076620 con 0x7f971c110a00 2026-02-13T03:32:22.641 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.636+0000 7f97221726c0 1 --2- 10.20.193.96:0/1589063580 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f96f803f870 0x7f96f805fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.641 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.636+0000 7f97221726c0 1 --2- 10.20.193.96:0/1589063580 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f96f803f870 0x7f96f805fd20 secure :-1 s=READY pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f970c005b40 tx=0x7f970c0073d0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.641 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.639+0000 7f97037fe6c0 1 -- 10.20.193.96:0/1589063580 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9718008970 con 0x7f971c110a00 2026-02-13T03:32:22.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.639+0000 7fd91cb986c0 1 -- 10.20.193.96:0/1011855993 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd91810ddd0 msgr2=0x7fd91810e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.639+0000 7fd91cb986c0 1 --2- 10.20.193.96:0/1011855993 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd91810ddd0 0x7fd91810e240 secure :-1 s=READY pgs=123 gs=1 cs=0 l=1 c_cookie=2468141411455607560 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9000098a0 tx=0x7fd90002ec40 comp rx=0 tx=0).stop 2026-02-13T03:32:22.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.640+0000 7fd91cb986c0 1 -- 10.20.193.96:0/1011855993 shutdown_connections 2026-02-13T03:32:22.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.640+0000 7fd91cb986c0 1 --2- 10.20.193.96:0/1011855993 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd91810e780 0x7fd91816f110 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.640+0000 7fd91cb986c0 1 --2- 10.20.193.96:0/1011855993 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd91810ddd0 0x7fd91810e240 unknown :-1 s=CLOSED pgs=123 gs=1 cs=0 l=1 c_cookie=2468141411455607560 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.640+0000 7fd91cb986c0 1 --2- 10.20.193.96:0/1011855993 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd91810cc50 0x7fd91810d040 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.640+0000 7fd91cb986c0 1 -- 10.20.193.96:0/1011855993 >> 10.20.193.96:0/1011855993 conn(0x7fd9180ea370 msgr2=0x7fd91810a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.640+0000 7fd91cb986c0 1 -- 10.20.193.96:0/1011855993 shutdown_connections 2026-02-13T03:32:22.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.640+0000 7fd91cb986c0 1 -- 10.20.193.96:0/1011855993 wait complete. 2026-02-13T03:32:22.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.641+0000 7fd91cb986c0 1 Processor -- start 2026-02-13T03:32:22.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.641+0000 7fd91cb986c0 1 -- start start 2026-02-13T03:32:22.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.642+0000 7fd91cb986c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd91810cc50 0x7fd9180f6070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.642+0000 7fd91cb986c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd91810ddd0 0x7fd91816f0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.642+0000 7fd91cb986c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd91810e780 0x7fd9180f68b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.642+0000 7fd91cb986c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd9180f7500 con 0x7fd91810e780 2026-02-13T03:32:22.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.642+0000 7fd91cb986c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd9180f7670 con 0x7fd91810ddd0 2026-02-13T03:32:22.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.642+0000 7fd91cb986c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd9180f7830 con 0x7fd91810cc50 2026-02-13T03:32:22.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.642+0000 7fd916d766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd91810e780 0x7fd9180f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.642+0000 7fd9165756c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd91810cc50 0x7fd9180f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.642+0000 7fd916d766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd91810e780 0x7fd9180f68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:58934/0 (socket says 10.20.193.96:58934) 2026-02-13T03:32:22.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.642+0000 7fd916d766c0 1 -- 10.20.193.96:0/3924985232 learned_addr learned my addr 10.20.193.96:0/3924985232 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:22.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.642+0000 7fd9165756c0 1 -- 10.20.193.96:0/3924985232 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd91810cc50 msgr2=0x7fd9180f6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-13T03:32:22.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.642+0000 7fd9165756c0 1 -- 10.20.193.96:0/3924985232 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd91810cc50 msgr2=0x7fd9180f6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:32:22.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.642+0000 7fd9165756c0 1 --2- 10.20.193.96:0/3924985232 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd91810cc50 0x7fd9180f6070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:32:22.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.642+0000 7fd9165756c0 1 --2- 10.20.193.96:0/3924985232 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd91810cc50 0x7fd9180f6070 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:32:22.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.642+0000 7fd916d766c0 1 -- 10.20.193.96:0/3924985232 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd91810cc50 msgr2=0x7fd9180f6070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:32:22.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.642+0000 7fd916d766c0 1 --2- 10.20.193.96:0/3924985232 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd91810cc50 0x7fd9180f6070 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.642+0000 7fd916d766c0 1 -- 10.20.193.96:0/3924985232 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd91810ddd0 msgr2=0x7fd91816f0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:32:22.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.642+0000 7fd916d766c0 1 --2- 10.20.193.96:0/3924985232 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd91810ddd0 0x7fd91816f0f0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.642+0000 7fd916d766c0 1 -- 10.20.193.96:0/3924985232 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9000094c0 con 0x7fd91810e780 2026-02-13T03:32:22.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.642+0000 7fd916d766c0 1 --2- 10.20.193.96:0/3924985232 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd91810e780 0x7fd9180f68b0 secure :-1 s=READY pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd908006ea0 tx=0x7fd908006530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.643+0000 7fd8ff7fe6c0 1 -- 10.20.193.96:0/3924985232 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd908003c40 con 0x7fd91810e780 2026-02-13T03:32:22.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.643+0000 7fd91cb986c0 1 -- 10.20.193.96:0/3924985232 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9180f7ab0 con 0x7fd91810e780 2026-02-13T03:32:22.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.643+0000 7fd91cb986c0 1 -- 10.20.193.96:0/3924985232 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9180f7f30 con 0x7fd91810e780 2026-02-13T03:32:22.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.643+0000 7fd8ff7fe6c0 1 -- 10.20.193.96:0/3924985232 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fd908003da0 con 0x7fd91810e780 2026-02-13T03:32:22.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.643+0000 7fd8ff7fe6c0 1 -- 10.20.193.96:0/3924985232 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd90800de50 con 0x7fd91810e780 2026-02-13T03:32:22.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.644+0000 7fd8ff7fe6c0 1 -- 10.20.193.96:0/3924985232 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7fd908005030 con 0x7fd91810e780 2026-02-13T03:32:22.649 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.644+0000 7fd8ff7fe6c0 1 --2- 10.20.193.96:0/3924985232 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd8f0043d80 0x7fd8f0064230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.649 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.644+0000 7fd8ff7fe6c0 1 -- 10.20.193.96:0/3924985232 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7fd908052410 con 0x7fd91810e780 2026-02-13T03:32:22.649 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.644+0000 7fd9165756c0 1 --2- 10.20.193.96:0/3924985232 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd8f0043d80 0x7fd8f0064230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.649 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.645+0000 7fd9165756c0 1 --2- 10.20.193.96:0/3924985232 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd8f0043d80 0x7fd8f0064230 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd90c004750 tx=0x7fd90c005ac0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.649 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.646+0000 7fd91cb986c0 1 -- 10.20.193.96:0/3924985232 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9181731f0 con 0x7fd91810e780 2026-02-13T03:32:22.650 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.653+0000 7fd8ff7fe6c0 1 -- 10.20.193.96:0/3924985232 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd90800f7c0 con 0x7fd91810e780 2026-02-13T03:32:22.684 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.686+0000 7f7b42d106c0 1 -- 10.20.193.96:0/3453627113 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7b3c10e780 msgr2=0x7f7b3c16f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.684 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.686+0000 7f7b42d106c0 1 --2- 10.20.193.96:0/3453627113 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7b3c10e780 0x7f7b3c16f110 secure :-1 s=READY pgs=125 gs=1 cs=0 l=1 c_cookie=7084925430601269121 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b38006fd0 tx=0x7f7b3802fd20 comp rx=0 tx=0).stop 2026-02-13T03:32:22.684 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.686+0000 7f7b42d106c0 1 -- 10.20.193.96:0/3453627113 shutdown_connections 2026-02-13T03:32:22.684 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.686+0000 7f7b42d106c0 1 --2- 10.20.193.96:0/3453627113 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7b3c10e780 0x7f7b3c16f110 unknown :-1 s=CLOSED pgs=125 gs=1 cs=0 l=1 c_cookie=7084925430601269121 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.684 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.686+0000 7f7b42d106c0 1 --2- 10.20.193.96:0/3453627113 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7b3c10ddd0 0x7f7b3c10e240 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.684 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.686+0000 7f7b42d106c0 1 --2- 10.20.193.96:0/3453627113 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7b3c10cc50 0x7f7b3c10d040 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.685 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.686+0000 7f7b42d106c0 1 -- 10.20.193.96:0/3453627113 >> 10.20.193.96:0/3453627113 conn(0x7f7b3c0ea370 msgr2=0x7f7b3c10a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.685 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.686 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.686 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.687 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.686+0000 7f7b42d106c0 1 -- 10.20.193.96:0/3453627113 shutdown_connections 2026-02-13T03:32:22.687 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.686+0000 7f7b42d106c0 1 -- 10.20.193.96:0/3453627113 wait complete. 2026-02-13T03:32:22.687 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.687+0000 7f7b42d106c0 1 Processor -- start 2026-02-13T03:32:22.687 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.687+0000 7f7b42d106c0 1 -- start start 2026-02-13T03:32:22.687 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.687+0000 7f7b42d106c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7b3c10cc50 0x7f7b3c0f6020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.687 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.687+0000 7f7b42d106c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7b3c10ddd0 0x7f7b3c16f110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.687 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.688+0000 7f7b42d106c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7b3c10e780 0x7f7b3c0f6880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.687 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.688+0000 7f7b42d106c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3c0f74b0 con 0x7f7b3c10cc50 2026-02-13T03:32:22.687 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.688+0000 7f7b33fff6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7b3c10ddd0 0x7f7b3c16f110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.687 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.688+0000 7f7b42d106c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3c0f7620 con 0x7f7b3c10e780 2026-02-13T03:32:22.687 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.688+0000 7f7b42d106c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3c0f77e0 con 0x7f7b3c10ddd0 2026-02-13T03:32:22.687 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.688+0000 7f7b33fff6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7b3c10ddd0 0x7f7b3c16f110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.133:3300/0 says I am v2:10.20.193.96:33592/0 (socket says 10.20.193.96:33592) 2026-02-13T03:32:22.688 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.688+0000 7f7b33fff6c0 1 -- 10.20.193.96:0/270126815 learned_addr learned my addr 10.20.193.96:0/270126815 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:22.688 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.688+0000 7f7b33fff6c0 1 -- 10.20.193.96:0/270126815 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7b3c10ddd0 msgr2=0x7f7b3c16f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-13T03:32:22.688 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.688+0000 7f7b33fff6c0 1 -- 10.20.193.96:0/270126815 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7b3c10ddd0 msgr2=0x7f7b3c16f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:32:22.688 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.688+0000 7f7b33fff6c0 1 --2- 10.20.193.96:0/270126815 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7b3c10ddd0 0x7f7b3c16f110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:32:22.688 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.688+0000 7f7b33fff6c0 1 --2- 10.20.193.96:0/270126815 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7b3c10ddd0 0x7f7b3c16f110 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:32:22.688 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.688+0000 7f7b412866c0 1 --2- 10.20.193.96:0/270126815 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7b3c10e780 0x7f7b3c0f6880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.688 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.688+0000 7f7b412866c0 1 -- 10.20.193.96:0/270126815 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7b3c10e780 msgr2=0x7f7b3c0f6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T03:32:22.688 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.688+0000 7f7b412866c0 1 -- 10.20.193.96:0/270126815 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7b3c10e780 msgr2=0x7f7b3c0f6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:32:22.688 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.688+0000 7f7b412866c0 1 --2- 10.20.193.96:0/270126815 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7b3c10e780 0x7f7b3c0f6880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:32:22.688 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.688+0000 7f7b412866c0 1 --2- 10.20.193.96:0/270126815 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7b3c10e780 0x7f7b3c0f6880 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:32:22.688 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.689+0000 7f7b40a856c0 1 --2- 10.20.193.96:0/270126815 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7b3c10cc50 0x7f7b3c0f6020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.688 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.689+0000 7f7b40a856c0 1 -- 10.20.193.96:0/270126815 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7b3c10ddd0 msgr2=0x7f7b3c16f110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:32:22.688 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.689+0000 7f7b40a856c0 1 --2- 10.20.193.96:0/270126815 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7b3c10ddd0 0x7f7b3c16f110 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.688 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.689+0000 7f7b40a856c0 1 -- 10.20.193.96:0/270126815 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7b3c10e780 msgr2=0x7f7b3c0f6880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:32:22.688 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.689+0000 7f7b40a856c0 1 --2- 10.20.193.96:0/270126815 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7b3c10e780 0x7f7b3c0f6880 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.688 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.689+0000 7f7b40a856c0 1 -- 10.20.193.96:0/270126815 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b3800a5b0 con 0x7f7b3c10cc50 2026-02-13T03:32:22.689 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.689+0000 7f7b40a856c0 1 --2- 10.20.193.96:0/270126815 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7b3c10cc50 0x7f7b3c0f6020 secure :-1 s=READY pgs=127 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b2c00b6c0 tx=0x7f7b2c00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.689 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.689+0000 7f7b31ffb6c0 1 -- 10.20.193.96:0/270126815 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b2c004250 con 0x7f7b3c10cc50 2026-02-13T03:32:22.689 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.689+0000 7f7b42d106c0 1 -- 10.20.193.96:0/270126815 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b3c0f7ac0 con 0x7f7b3c10cc50 2026-02-13T03:32:22.689 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.689+0000 7f7b42d106c0 1 -- 10.20.193.96:0/270126815 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b3c0f7ff0 con 0x7f7b3c10cc50 2026-02-13T03:32:22.689 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.690+0000 7f7b31ffb6c0 1 -- 10.20.193.96:0/270126815 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f7b2c004d40 con 0x7f7b3c10cc50 2026-02-13T03:32:22.689 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.690+0000 7f7b31ffb6c0 1 -- 10.20.193.96:0/270126815 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b2c005020 con 0x7f7b3c10cc50 2026-02-13T03:32:22.689 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.690+0000 7f7b0b7fe6c0 1 -- 10.20.193.96:0/270126815 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7afc005310 con 0x7f7b3c10cc50 2026-02-13T03:32:22.690 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.691+0000 7f7b31ffb6c0 1 -- 10.20.193.96:0/270126815 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f7b2c0051b0 con 0x7f7b3c10cc50 2026-02-13T03:32:22.690 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.691+0000 7f60a4e8c6c0 1 -- 10.20.193.96:0/2331924912 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f60a010c250 msgr2=0x7f60a012c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.690 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.691+0000 7f60a4e8c6c0 1 --2- 10.20.193.96:0/2331924912 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f60a010c250 0x7f60a012c650 secure :-1 s=READY pgs=126 gs=3 cs=0 l=1 c_cookie=1304631949535275598 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6094009b00 tx=0x7f60940333c0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.690 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.691+0000 7f7b31ffb6c0 1 --2- 10.20.193.96:0/270126815 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7b1803f8f0 0x7f7b1805fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.690 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.691+0000 7f7b31ffb6c0 1 -- 10.20.193.96:0/270126815 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f7b2c0511d0 con 0x7f7b3c10cc50 2026-02-13T03:32:22.691 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.691+0000 7f60a4e8c6c0 1 -- 10.20.193.96:0/2331924912 shutdown_connections 2026-02-13T03:32:22.691 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.691+0000 7f60a4e8c6c0 1 --2- 10.20.193.96:0/2331924912 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f60a014d850 0x7f60a016dd00 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.691 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.691+0000 7f60a4e8c6c0 1 --2- 10.20.193.96:0/2331924912 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f60a012cc90 0x7f60a014d110 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.691 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.691+0000 7f60a4e8c6c0 1 --2- 10.20.193.96:0/2331924912 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f60a010c250 0x7f60a012c650 unknown :-1 s=CLOSED pgs=126 gs=3 cs=0 l=1 c_cookie=1304631949535275598 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.691 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.691+0000 7f60a4e8c6c0 1 -- 10.20.193.96:0/2331924912 >> 10.20.193.96:0/2331924912 conn(0x7f60a00e8510 msgr2=0x7f60a0108940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.691 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.691+0000 7f60a4e8c6c0 1 -- 10.20.193.96:0/2331924912 shutdown_connections 2026-02-13T03:32:22.691 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.690+0000 7f6d90c0c6c0 1 -- 10.20.193.96:0/4273568872 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f6d8c05cdc0 con 0x7f6d8c10ddd0 2026-02-13T03:32:22.692 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.691+0000 7f64282836c0 1 -- 10.20.193.96:0/3151923748 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6420062cd0 msgr2=0x7f64200630c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.692 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.691+0000 7f64282836c0 1 --2- 10.20.193.96:0/3151923748 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6420062cd0 0x7f64200630c0 secure :-1 s=READY pgs=128 gs=1 cs=0 l=1 c_cookie=2195755789048619517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6410009970 tx=0x7f641002ed70 comp rx=0 tx=0).stop 2026-02-13T03:32:22.692 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.692+0000 7f60a4e8c6c0 1 -- 10.20.193.96:0/2331924912 wait complete. 2026-02-13T03:32:22.692 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.692+0000 7f7b33fff6c0 1 --2- 10.20.193.96:0/270126815 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7b1803f8f0 0x7f7b1805fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.693 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.692+0000 7f64282836c0 1 -- 10.20.193.96:0/3151923748 shutdown_connections 2026-02-13T03:32:22.693 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.692+0000 7f64282836c0 1 --2- 10.20.193.96:0/3151923748 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6420064800 0x7f6420065160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.693 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.692+0000 7f64282836c0 1 --2- 10.20.193.96:0/3151923748 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6420063e50 0x7f64200642c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.693 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.692+0000 7f64282836c0 1 --2- 10.20.193.96:0/3151923748 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6420062cd0 0x7f64200630c0 unknown :-1 s=CLOSED pgs=128 gs=1 cs=0 l=1 c_cookie=2195755789048619517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.693 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.692+0000 7f64282836c0 1 -- 10.20.193.96:0/3151923748 >> 10.20.193.96:0/3151923748 conn(0x7f64200ec5f0 msgr2=0x7f642010ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.693 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.692+0000 7f64282836c0 1 -- 10.20.193.96:0/3151923748 shutdown_connections 2026-02-13T03:32:22.693 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.692+0000 7f64282836c0 1 -- 10.20.193.96:0/3151923748 wait complete. 2026-02-13T03:32:22.693 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.692+0000 7f64282836c0 1 Processor -- start 2026-02-13T03:32:22.693 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.692+0000 7f64282836c0 1 -- start start 2026-02-13T03:32:22.693 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.692+0000 7f64282836c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6420062cd0 0x7f64201012a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.693 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.692+0000 7f64282836c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6420063e50 0x7f64201018f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.693 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.692+0000 7f64282836c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6420064800 0x7f64201024e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.693 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.693+0000 7f64267f56c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6420064800 0x7f64201024e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.693 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.693+0000 7f64267f56c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6420064800 0x7f64201024e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:59000/0 (socket says 10.20.193.96:59000) 2026-02-13T03:32:22.693 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.693+0000 7f6425ff46c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6420062cd0 0x7f64201012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.693+0000 7f6425ff46c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6420062cd0 0x7f64201012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.132:3300/0 says I am v2:10.20.193.96:47812/0 (socket says 10.20.193.96:47812) 2026-02-13T03:32:22.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.693+0000 7f64267f56c0 1 -- 10.20.193.96:0/1257702778 learned_addr learned my addr 10.20.193.96:0/1257702778 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:22.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.693+0000 7f7b33fff6c0 1 --2- 10.20.193.96:0/270126815 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7b1803f8f0 0x7f7b1805fda0 secure :-1 s=READY pgs=66 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b24005b40 tx=0x7f7b240072a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.693+0000 7f64282836c0 1 -- 10.20.193.96:0/1257702778 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f6420102c70 con 0x7f6420064800 2026-02-13T03:32:22.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.693+0000 7f64282836c0 1 -- 10.20.193.96:0/1257702778 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6420102de0 con 0x7f6420062cd0 2026-02-13T03:32:22.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.693+0000 7f64282836c0 1 -- 10.20.193.96:0/1257702778 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6420102fa0 con 0x7f6420063e50 2026-02-13T03:32:22.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.693+0000 7f64257f36c0 1 --2- 10.20.193.96:0/1257702778 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6420063e50 0x7f64201018f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.693+0000 7f64267f56c0 1 -- 10.20.193.96:0/1257702778 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6420063e50 msgr2=0x7f64201018f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.693+0000 7f64267f56c0 1 --2- 10.20.193.96:0/1257702778 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6420063e50 0x7f64201018f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.693+0000 7f64267f56c0 1 -- 10.20.193.96:0/1257702778 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6420062cd0 msgr2=0x7f64201012a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.693+0000 7f64267f56c0 1 --2- 10.20.193.96:0/1257702778 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6420062cd0 0x7f64201012a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.693+0000 7f64267f56c0 1 -- 10.20.193.96:0/1257702778 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6410009590 con 0x7f6420064800 2026-02-13T03:32:22.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.693+0000 7f64267f56c0 1 --2- 10.20.193.96:0/1257702778 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6420064800 0x7f64201024e0 secure :-1 s=READY pgs=130 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f641c006ea0 tx=0x7f641c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.696 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.694+0000 7f60a4e8c6c0 1 Processor -- start 2026-02-13T03:32:22.696 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.694+0000 7f60a4e8c6c0 1 -- start start 2026-02-13T03:32:22.696 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.694+0000 7f60a4e8c6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f60a010c250 0x7f60a014d110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.696 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.694+0000 7f60a4e8c6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f60a012cc90 0x7f60a01088f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.696 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.694+0000 7f60a4e8c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f60a014d850 0x7f60a0159f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.696 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.695+0000 7f60a4e8c6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f60a015a6c0 con 0x7f60a014d850 2026-02-13T03:32:22.696 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.695+0000 7f609ed766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f60a014d850 0x7f60a0159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.696 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.695+0000 7f7b31ffb6c0 1 -- 10.20.193.96:0/270126815 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7b2c005490 con 0x7f7b3c10cc50 2026-02-13T03:32:22.697 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.695+0000 7f640effd6c0 1 -- 10.20.193.96:0/1257702778 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f641c003a30 con 0x7f6420064800 2026-02-13T03:32:22.697 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.695+0000 7f640effd6c0 1 -- 10.20.193.96:0/1257702778 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f641c005510 con 0x7f6420064800 2026-02-13T03:32:22.697 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.695+0000 7f640effd6c0 1 -- 10.20.193.96:0/1257702778 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f641c00dd70 con 0x7f6420064800 2026-02-13T03:32:22.697 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.695+0000 7f64282836c0 1 -- 10.20.193.96:0/1257702778 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6420103280 con 0x7f6420064800 2026-02-13T03:32:22.697 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.695+0000 7f609e5756c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f60a010c250 0x7f60a014d110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.697 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.695+0000 7f609e5756c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f60a010c250 0x7f60a014d110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.133:3300/0 says I am v2:10.20.193.96:33616/0 (socket says 10.20.193.96:33616) 2026-02-13T03:32:22.698 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.695+0000 7f609e5756c0 1 -- 10.20.193.96:0/4150554553 learned_addr learned my addr 10.20.193.96:0/4150554553 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:22.698 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.695+0000 7f609dd746c0 1 --2- 10.20.193.96:0/4150554553 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f60a012cc90 0x7f60a01088f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.698 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.695+0000 7f60a4e8c6c0 1 -- 10.20.193.96:0/4150554553 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f60a015a830 con 0x7f60a012cc90 2026-02-13T03:32:22.698 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.695+0000 7f60a4e8c6c0 1 -- 10.20.193.96:0/4150554553 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f60a015a9f0 con 0x7f60a010c250 2026-02-13T03:32:22.698 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.695+0000 7f609ed766c0 1 -- 10.20.193.96:0/4150554553 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f60a010c250 msgr2=0x7f60a014d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.698 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.695+0000 7f609ed766c0 1 --2- 10.20.193.96:0/4150554553 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f60a010c250 0x7f60a014d110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.698 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.695+0000 7f609ed766c0 1 -- 10.20.193.96:0/4150554553 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f60a012cc90 msgr2=0x7f60a01088f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.698 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.695+0000 7f609ed766c0 1 --2- 10.20.193.96:0/4150554553 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f60a012cc90 0x7f60a01088f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.698 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.696+0000 7f609ed766c0 1 -- 10.20.193.96:0/4150554553 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60940094c0 con 0x7f60a014d850 2026-02-13T03:32:22.698 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.696+0000 7f64282836c0 1 -- 10.20.193.96:0/1257702778 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f642016ec50 con 0x7f6420064800 2026-02-13T03:32:22.699 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.696+0000 7f609ed766c0 1 --2- 10.20.193.96:0/4150554553 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f60a014d850 0x7f60a0159f30 secure :-1 s=READY pgs=131 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6090006090 tx=0x7f6090006560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.699 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.696+0000 7f609e5756c0 1 --2- 10.20.193.96:0/4150554553 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f60a010c250 0x7f60a014d110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:32:22.699 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.695+0000 7fd02106f6c0 1 -- 10.20.193.96:0/3287798114 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd01c10cc50 msgr2=0x7fd01c10d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.700 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.695+0000 7fd02106f6c0 1 --2- 10.20.193.96:0/3287798114 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd01c10cc50 0x7fd01c10d040 secure :-1 s=READY pgs=129 gs=3 cs=0 l=1 c_cookie=14699991904842019977 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd01000fa00 tx=0x7fd010033160 comp rx=0 tx=0).stop 2026-02-13T03:32:22.700 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.696+0000 7fd02106f6c0 1 -- 10.20.193.96:0/3287798114 shutdown_connections 2026-02-13T03:32:22.700 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.696+0000 7fd02106f6c0 1 --2- 10.20.193.96:0/3287798114 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd01c10e780 0x7fd01c16f110 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.700 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.696+0000 7fd02106f6c0 1 --2- 10.20.193.96:0/3287798114 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd01c10ddd0 0x7fd01c10e240 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.700 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.696+0000 7fd02106f6c0 1 --2- 10.20.193.96:0/3287798114 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd01c10cc50 0x7fd01c10d040 unknown :-1 s=CLOSED pgs=129 gs=3 cs=0 l=1 c_cookie=14699991904842019977 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.700 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.696+0000 7fd02106f6c0 1 -- 10.20.193.96:0/3287798114 >> 10.20.193.96:0/3287798114 conn(0x7fd01c0ea370 msgr2=0x7fd01c10a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.700 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.696+0000 7fd02106f6c0 1 -- 10.20.193.96:0/3287798114 shutdown_connections 2026-02-13T03:32:22.700 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.696+0000 7fd02106f6c0 1 -- 10.20.193.96:0/3287798114 wait complete. 2026-02-13T03:32:22.700 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.696+0000 7f64282836c0 1 -- 10.20.193.96:0/1257702778 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6420179990 con 0x7f6420064800 2026-02-13T03:32:22.701 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.697+0000 7fd02106f6c0 1 Processor -- start 2026-02-13T03:32:22.701 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.697+0000 7fd02106f6c0 1 -- start start 2026-02-13T03:32:22.701 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.697+0000 7f6d737fe6c0 1 -- 10.20.193.96:0/4273568872 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v21)=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7f6d74039030 con 0x7f6d8c10ddd0 2026-02-13T03:32:22.701 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.697+0000 7fd02106f6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd01c10cc50 0x7fd01c0f6250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.701 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.697+0000 7fd02106f6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd01c10ddd0 0x7fd01c16f110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.702 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.697+0000 7fd02106f6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd01c10e780 0x7fd01c0f6ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.702 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.697+0000 7fd02106f6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c0f76e0 con 0x7fd01c10cc50 2026-02-13T03:32:22.702 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.697+0000 7fd02106f6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c0f7850 con 0x7fd01c10e780 2026-02-13T03:32:22.702 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.697+0000 7fd02106f6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c0f7a10 con 0x7fd01c10ddd0 2026-02-13T03:32:22.702 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.697+0000 7fd01b5776c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd01c10e780 0x7fd01c0f6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.702 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.697+0000 7fd01ad766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd01c10cc50 0x7fd01c0f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.702 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.697+0000 7fd01a5756c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd01c10ddd0 0x7fd01c16f110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.702 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.697+0000 7fd01ad766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd01c10cc50 0x7fd01c0f6250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:59018/0 (socket says 10.20.193.96:59018) 2026-02-13T03:32:22.702 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.697+0000 7fd01ad766c0 1 -- 10.20.193.96:0/2044308504 learned_addr learned my addr 10.20.193.96:0/2044308504 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:22.702 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.697+0000 7fd01b5776c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd01c10e780 0x7fd01c0f6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.132:3300/0 says I am v2:10.20.193.96:47826/0 (socket says 10.20.193.96:47826) 2026-02-13T03:32:22.703 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.698+0000 7fd01b5776c0 1 -- 10.20.193.96:0/2044308504 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd01c10e780 msgr2=0x7fd01c0f6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T03:32:22.703 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.698+0000 7fd01b5776c0 1 -- 10.20.193.96:0/2044308504 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd01c10e780 msgr2=0x7fd01c0f6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:32:22.703 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.698+0000 7fd01b5776c0 1 --2- 10.20.193.96:0/2044308504 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd01c10e780 0x7fd01c0f6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:32:22.703 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.698+0000 7fd01b5776c0 1 --2- 10.20.193.96:0/2044308504 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd01c10e780 0x7fd01c0f6ab0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:32:22.703 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.704 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.698+0000 7fd01a5756c0 1 -- 10.20.193.96:0/2044308504 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd01c10ddd0 msgr2=0x7fd01c16f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-13T03:32:22.704 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.698+0000 7fd01a5756c0 1 -- 10.20.193.96:0/2044308504 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd01c10ddd0 msgr2=0x7fd01c16f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:32:22.704 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.698+0000 7fd01a5756c0 1 --2- 10.20.193.96:0/2044308504 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd01c10ddd0 0x7fd01c16f110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:32:22.704 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.698+0000 7fd01a5756c0 1 --2- 10.20.193.96:0/2044308504 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd01c10ddd0 0x7fd01c16f110 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:32:22.704 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.698+0000 7fd01ad766c0 1 -- 10.20.193.96:0/2044308504 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd01c10ddd0 msgr2=0x7fd01c16f110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:32:22.704 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.698+0000 7fd01ad766c0 1 --2- 10.20.193.96:0/2044308504 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd01c10ddd0 0x7fd01c16f110 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.704 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.698+0000 7fd01ad766c0 1 -- 10.20.193.96:0/2044308504 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd01c10e780 msgr2=0x7fd01c0f6ab0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:32:22.705 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.698+0000 7fd01ad766c0 1 --2- 10.20.193.96:0/2044308504 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd01c10e780 0x7fd01c0f6ab0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.705 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.698+0000 7fd01ad766c0 1 -- 10.20.193.96:0/2044308504 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd01000f620 con 0x7fd01c10cc50 2026-02-13T03:32:22.705 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.699+0000 7fd01ad766c0 1 --2- 10.20.193.96:0/2044308504 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd01c10cc50 0x7fd01c0f6250 secure :-1 s=READY pgs=132 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd010005980 tx=0x7fd010003bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.705 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.699+0000 7fcffbfff6c0 1 -- 10.20.193.96:0/2044308504 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd010033bc0 con 0x7fd01c10cc50 2026-02-13T03:32:22.705 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.699+0000 7fd02106f6c0 1 -- 10.20.193.96:0/2044308504 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd01c0f7c90 con 0x7fd01c10cc50 2026-02-13T03:32:22.705 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.699+0000 7fd02106f6c0 1 -- 10.20.193.96:0/2044308504 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd01c0f8050 con 0x7fd01c10cc50 2026-02-13T03:32:22.705 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.699+0000 7f60877fe6c0 1 -- 10.20.193.96:0/4150554553 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6090003c40 con 0x7f60a014d850 2026-02-13T03:32:22.705 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.699+0000 7f60a4e8c6c0 1 -- 10.20.193.96:0/4150554553 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60a015b150 con 0x7f60a014d850 2026-02-13T03:32:22.705 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.700+0000 7f60a4e8c6c0 1 -- 10.20.193.96:0/4150554553 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60a015b5d0 con 0x7f60a014d850 2026-02-13T03:32:22.705 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.700+0000 7f640effd6c0 1 -- 10.20.193.96:0/1257702778 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f641c003b90 con 0x7f6420064800 2026-02-13T03:32:22.706 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.700+0000 7fd02106f6c0 1 -- 10.20.193.96:0/2044308504 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd01c170f60 con 0x7fd01c10cc50 2026-02-13T03:32:22.706 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.700+0000 7f640effd6c0 1 --2- 10.20.193.96:0/1257702778 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f63fc03f8c0 0x7f63fc05fd70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.706 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.700+0000 7f640effd6c0 1 -- 10.20.193.96:0/1257702778 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f641c052280 con 0x7f6420064800 2026-02-13T03:32:22.706 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.700+0000 7f6425ff46c0 1 --2- 10.20.193.96:0/1257702778 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f63fc03f8c0 0x7f63fc05fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.706 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.700+0000 7f60a4e8c6c0 1 -- 10.20.193.96:0/4150554553 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60a0170fe0 con 0x7f60a014d850 2026-02-13T03:32:22.707 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.701+0000 7f6425ff46c0 1 --2- 10.20.193.96:0/1257702778 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f63fc03f8c0 0x7f63fc05fd70 secure :-1 s=READY pgs=67 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64100098c0 tx=0x7f6410031f70 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.707 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.701+0000 7f6d90c0c6c0 1 -- 10.20.193.96:0/4273568872 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f6d6403f8f0 msgr2=0x7f6d6405fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.707 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.701+0000 7f6d90c0c6c0 1 --2- 10.20.193.96:0/4273568872 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f6d6403f8f0 0x7f6d6405fda0 secure :-1 s=READY pgs=59 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d80005980 tx=0x7f6d80005910 comp rx=0 tx=0).stop 2026-02-13T03:32:22.707 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.701+0000 7f6d90c0c6c0 1 -- 10.20.193.96:0/4273568872 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6d8c10ddd0 msgr2=0x7f6d8c062330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.707 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.701+0000 7f6d90c0c6c0 1 --2- 10.20.193.96:0/4273568872 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6d8c10ddd0 0x7f6d8c062330 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d74009230 tx=0x7f6d74002960 comp rx=0 tx=0).stop 2026-02-13T03:32:22.707 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.702+0000 7f6d90c0c6c0 1 -- 10.20.193.96:0/4273568872 shutdown_connections 2026-02-13T03:32:22.707 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.702+0000 7f6d90c0c6c0 1 --2- 10.20.193.96:0/4273568872 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f6d6403f8f0 0x7f6d6405fda0 unknown :-1 s=CLOSED pgs=59 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.707 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.702+0000 7f6d90c0c6c0 1 --2- 10.20.193.96:0/4273568872 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6d8c10e780 0x7f6d8c0607f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.708 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.702+0000 7f6d90c0c6c0 1 --2- 10.20.193.96:0/4273568872 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6d8c10ddd0 0x7f6d8c062330 unknown :-1 s=CLOSED pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.708 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.702+0000 7f6d90c0c6c0 1 --2- 10.20.193.96:0/4273568872 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6d8c10cc50 0x7f6d8c061ce0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.708 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.702+0000 7f6d90c0c6c0 1 -- 10.20.193.96:0/4273568872 >> 10.20.193.96:0/4273568872 conn(0x7f6d8c0ea370 msgr2=0x7f6d8c10a750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.708 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.702+0000 7f6d90c0c6c0 1 -- 10.20.193.96:0/4273568872 shutdown_connections 2026-02-13T03:32:22.708 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.702+0000 7f6d90c0c6c0 1 -- 10.20.193.96:0/4273568872 wait complete. 2026-02-13T03:32:22.708 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.701+0000 7f60877fe6c0 1 -- 10.20.193.96:0/4150554553 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f6090003da0 con 0x7f60a014d850 2026-02-13T03:32:22.708 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.701+0000 7f60877fe6c0 1 -- 10.20.193.96:0/4150554553 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f609000dcd0 con 0x7f60a014d850 2026-02-13T03:32:22.708 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.702+0000 7f60877fe6c0 1 -- 10.20.193.96:0/4150554553 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f6090016080 con 0x7f60a014d850 2026-02-13T03:32:22.708 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.702+0000 7f60877fe6c0 1 --2- 10.20.193.96:0/4150554553 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f606c03f8f0 0x7f606c05fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.708 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.702+0000 7f60877fe6c0 1 -- 10.20.193.96:0/4150554553 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f6090053310 con 0x7f60a014d850 2026-02-13T03:32:22.708 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.702+0000 7f609e5756c0 1 --2- 10.20.193.96:0/4150554553 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f606c03f8f0 0x7f606c05fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.708 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.703+0000 7f609e5756c0 1 --2- 10.20.193.96:0/4150554553 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f606c03f8f0 0x7f606c05fda0 secure :-1 s=READY pgs=68 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60940023e0 tx=0x7f6094002ee0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.709 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.701+0000 7fcffbfff6c0 1 -- 10.20.193.96:0/2044308504 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fd010033d20 con 0x7fd01c10cc50 2026-02-13T03:32:22.709 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.701+0000 7fcffbfff6c0 1 -- 10.20.193.96:0/2044308504 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd010035030 con 0x7fd01c10cc50 2026-02-13T03:32:22.709 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.702+0000 7fcffbfff6c0 1 -- 10.20.193.96:0/2044308504 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7fd0100351c0 con 0x7fd01c10cc50 2026-02-13T03:32:22.709 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.703+0000 7fcffbfff6c0 1 --2- 10.20.193.96:0/2044308504 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcfe803f8f0 0x7fcfe805fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.709 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.703+0000 7fcffbfff6c0 1 -- 10.20.193.96:0/2044308504 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7fd01007ac80 con 0x7fd01c10cc50 2026-02-13T03:32:22.709 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.703+0000 7fd01a5756c0 1 --2- 10.20.193.96:0/2044308504 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcfe803f8f0 0x7fcfe805fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.709 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.703+0000 7fd01a5756c0 1 --2- 10.20.193.96:0/2044308504 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcfe803f8f0 0x7fcfe805fda0 secure :-1 s=READY pgs=69 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd004004750 tx=0x7fd004005ac0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.709 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.704+0000 7f60877fe6c0 1 -- 10.20.193.96:0/4150554553 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f609000de60 con 0x7f60a014d850 2026-02-13T03:32:22.710 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.701+0000 7f640effd6c0 1 -- 10.20.193.96:0/1257702778 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f641c00e270 con 0x7f6420064800 2026-02-13T03:32:22.710 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.705+0000 7fcffbfff6c0 1 -- 10.20.193.96:0/2044308504 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd0100354a0 con 0x7fd01c10cc50 2026-02-13T03:32:22.711 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.710+0000 7f5c29e0d6c0 1 -- 10.20.193.96:0/2184191217 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5c2410e780 msgr2=0x7f5c2416f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.712 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.710+0000 7f5c29e0d6c0 1 --2- 10.20.193.96:0/2184191217 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5c2410e780 0x7f5c2416f110 secure :-1 s=READY pgs=133 gs=2 cs=0 l=1 c_cookie=8838933564569277255 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c18006fd0 tx=0x7f5c1802fd40 comp rx=0 tx=0).stop 2026-02-13T03:32:22.712 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.710+0000 7f5c29e0d6c0 1 -- 10.20.193.96:0/2184191217 shutdown_connections 2026-02-13T03:32:22.712 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.710+0000 7f5c29e0d6c0 1 --2- 10.20.193.96:0/2184191217 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5c2410e780 0x7f5c2416f110 unknown :-1 s=CLOSED pgs=133 gs=2 cs=0 l=1 c_cookie=8838933564569277255 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.712 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.710+0000 7f5c29e0d6c0 1 --2- 10.20.193.96:0/2184191217 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5c2410ddd0 0x7f5c2410e240 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.712 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.710+0000 7f5c29e0d6c0 1 --2- 10.20.193.96:0/2184191217 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5c2410cc50 0x7f5c2410d040 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.712 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.710+0000 7f5c29e0d6c0 1 -- 10.20.193.96:0/2184191217 >> 10.20.193.96:0/2184191217 conn(0x7f5c240ea370 msgr2=0x7f5c2410a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.712 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.710+0000 7f5c29e0d6c0 1 -- 10.20.193.96:0/2184191217 shutdown_connections 2026-02-13T03:32:22.712 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.710+0000 7f5c29e0d6c0 1 -- 10.20.193.96:0/2184191217 wait complete. 2026-02-13T03:32:22.712 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.710+0000 7f5c29e0d6c0 1 Processor -- start 2026-02-13T03:32:22.712 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.710+0000 7f5c29e0d6c0 1 -- start start 2026-02-13T03:32:22.712 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.710+0000 7f5c29e0d6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5c2410cc50 0x7f5c24061ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.712 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.710+0000 7f5c29e0d6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5c2410ddd0 0x7f5c2416f0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.712 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.710+0000 7f5c29e0d6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5c2410e780 0x7f5c240607a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.712 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.710+0000 7f5c29e0d6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5c24060da0 con 0x7f5c2410cc50 2026-02-13T03:32:22.712 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.710+0000 7f5c29e0d6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5c24060f10 con 0x7f5c2410e780 2026-02-13T03:32:22.712 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.710+0000 7f5c29e0d6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5c240610d0 con 0x7f5c2410ddd0 2026-02-13T03:32:22.712 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.710+0000 7f5c237fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5c2410cc50 0x7f5c24061ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.712 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.710+0000 7f5c23fff6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5c2410e780 0x7f5c240607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.713 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.710+0000 7f5c23fff6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5c2410e780 0x7f5c240607a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.132:3300/0 says I am v2:10.20.193.96:47848/0 (socket says 10.20.193.96:47848) 2026-02-13T03:32:22.713 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.710+0000 7f5c23fff6c0 1 -- 10.20.193.96:0/1278782171 learned_addr learned my addr 10.20.193.96:0/1278782171 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:22.713 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.711+0000 7f5c23fff6c0 1 -- 10.20.193.96:0/1278782171 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5c2410e780 msgr2=0x7f5c240607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T03:32:22.713 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.711+0000 7f5c23fff6c0 1 -- 10.20.193.96:0/1278782171 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5c2410e780 msgr2=0x7f5c240607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:32:22.713 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.711+0000 7f5c23fff6c0 1 --2- 10.20.193.96:0/1278782171 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5c2410e780 0x7f5c240607a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:32:22.713 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.711+0000 7f5c23fff6c0 1 --2- 10.20.193.96:0/1278782171 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5c2410e780 0x7f5c240607a0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:32:22.713 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.711+0000 7f5c237fe6c0 1 -- 10.20.193.96:0/1278782171 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5c2410ddd0 msgr2=0x7f5c2416f0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:32:22.713 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.711+0000 7f5c237fe6c0 1 --2- 10.20.193.96:0/1278782171 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5c2410ddd0 0x7f5c2416f0f0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.713 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.711+0000 7f5c237fe6c0 1 -- 10.20.193.96:0/1278782171 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5c2410e780 msgr2=0x7f5c240607a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:32:22.713 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.711+0000 7f5c237fe6c0 1 --2- 10.20.193.96:0/1278782171 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5c2410e780 0x7f5c240607a0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.713 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.711+0000 7f5c237fe6c0 1 -- 10.20.193.96:0/1278782171 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1800a5b0 con 0x7f5c2410cc50 2026-02-13T03:32:22.713 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.711+0000 7f5c237fe6c0 1 --2- 10.20.193.96:0/1278782171 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5c2410cc50 0x7f5c24061ea0 secure :-1 s=READY pgs=134 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c10004750 tx=0x7f5c1000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.713 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.711+0000 7f5c20ff96c0 1 -- 10.20.193.96:0/1278782171 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5c10004250 con 0x7f5c2410cc50 2026-02-13T03:32:22.713 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.711+0000 7f5c20ff96c0 1 -- 10.20.193.96:0/1278782171 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f5c100043b0 con 0x7f5c2410cc50 2026-02-13T03:32:22.713 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.711+0000 7f5c29e0d6c0 1 -- 10.20.193.96:0/1278782171 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c240613b0 con 0x7f5c2410cc50 2026-02-13T03:32:22.713 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.711+0000 7f5c20ff96c0 1 -- 10.20.193.96:0/1278782171 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5c10011070 con 0x7f5c2410cc50 2026-02-13T03:32:22.713 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.711+0000 7f5c29e0d6c0 1 -- 10.20.193.96:0/1278782171 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c240fa4d0 con 0x7f5c2410cc50 2026-02-13T03:32:22.713 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.712+0000 7f5c29e0d6c0 1 -- 10.20.193.96:0/1278782171 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c241731f0 con 0x7f5c2410cc50 2026-02-13T03:32:22.713 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.712+0000 7f5c20ff96c0 1 -- 10.20.193.96:0/1278782171 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f5c10010070 con 0x7f5c2410cc50 2026-02-13T03:32:22.714 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.712+0000 7f5c20ff96c0 1 --2- 10.20.193.96:0/1278782171 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f5bf803f8f0 0x7f5bf805fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.714 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.712+0000 7f5c20ff96c0 1 -- 10.20.193.96:0/1278782171 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f5c10051130 con 0x7f5c2410cc50 2026-02-13T03:32:22.714 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.712+0000 7f5c22ffd6c0 1 --2- 10.20.193.96:0/1278782171 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f5bf803f8f0 0x7f5bf805fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.714 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.713+0000 7f5c22ffd6c0 1 --2- 10.20.193.96:0/1278782171 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f5bf803f8f0 0x7f5bf805fda0 secure :-1 s=READY pgs=70 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c14005980 tx=0x7f5c14005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.714 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.715 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.715+0000 7f5c20ff96c0 1 -- 10.20.193.96:0/1278782171 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5c1000f040 con 0x7f5c2410cc50 2026-02-13T03:32:22.719 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.721+0000 7f1984cf06c0 1 -- 10.20.193.96:0/3414336548 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f198010e760 msgr2=0x7f198016f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.719 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.721+0000 7f1984cf06c0 1 --2- 10.20.193.96:0/3414336548 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f198010e760 0x7f198016f0f0 secure :-1 s=READY pgs=135 gs=1 cs=0 l=1 c_cookie=11036489276827695458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f197000aa40 tx=0x7f197002fde0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.719 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.721+0000 7f1984cf06c0 1 -- 10.20.193.96:0/3414336548 shutdown_connections 2026-02-13T03:32:22.719 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.721+0000 7f1984cf06c0 1 --2- 10.20.193.96:0/3414336548 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f198010e760 0x7f198016f0f0 unknown :-1 s=CLOSED pgs=135 gs=1 cs=0 l=1 c_cookie=11036489276827695458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.719 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.721+0000 7f1984cf06c0 1 --2- 10.20.193.96:0/3414336548 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f198010ddb0 0x7f198010e220 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.719 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.721+0000 7f1984cf06c0 1 --2- 10.20.193.96:0/3414336548 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f198010cc30 0x7f198010d020 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.720 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.721+0000 7f1984cf06c0 1 -- 10.20.193.96:0/3414336548 >> 10.20.193.96:0/3414336548 conn(0x7f19800ea330 msgr2=0x7f198010a760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.720 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.721+0000 7f1984cf06c0 1 -- 10.20.193.96:0/3414336548 shutdown_connections 2026-02-13T03:32:22.720 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.721+0000 7f1984cf06c0 1 -- 10.20.193.96:0/3414336548 wait complete. 2026-02-13T03:32:22.720 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f1984cf06c0 1 Processor -- start 2026-02-13T03:32:22.720 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f1984cf06c0 1 -- start start 2026-02-13T03:32:22.722 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f1984cf06c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f198010cc30 0x7f19800fea20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.722 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f1984cf06c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f198010ddb0 0x7f198016f0d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.722 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f1984cf06c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f198010e760 0x7f19800ff260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.722 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f1984cf06c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f19800ffeb0 con 0x7f198010cc30 2026-02-13T03:32:22.722 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f1984cf06c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1980100020 con 0x7f198010e760 2026-02-13T03:32:22.722 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f1984cf06c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f19801001e0 con 0x7f198010ddb0 2026-02-13T03:32:22.722 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f197e5756c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f198010cc30 0x7f19800fea20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.722 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f197e5756c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f198010cc30 0x7f19800fea20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:59064/0 (socket says 10.20.193.96:59064) 2026-02-13T03:32:22.722 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f197e5756c0 1 -- 10.20.193.96:0/2457967432 learned_addr learned my addr 10.20.193.96:0/2457967432 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:22.722 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f197ed766c0 1 --2- 10.20.193.96:0/2457967432 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f198010e760 0x7f19800ff260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.722 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f197e5756c0 1 -- 10.20.193.96:0/2457967432 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f198010ddb0 msgr2=0x7f198016f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.722 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f197e5756c0 1 --2- 10.20.193.96:0/2457967432 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f198010ddb0 0x7f198016f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.722 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f197e5756c0 1 -- 10.20.193.96:0/2457967432 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f198010e760 msgr2=0x7f19800ff260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.722 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f197ed766c0 1 -- 10.20.193.96:0/2457967432 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f198010e760 msgr2=0x7f19800ff260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T03:32:22.722 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f197ed766c0 1 -- 10.20.193.96:0/2457967432 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f198010e760 msgr2=0x7f19800ff260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:32:22.723 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f197ed766c0 1 --2- 10.20.193.96:0/2457967432 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f198010e760 0x7f19800ff260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:32:22.723 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f197ed766c0 1 --2- 10.20.193.96:0/2457967432 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f198010e760 0x7f19800ff260 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:32:22.723 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f197e5756c0 1 --2- 10.20.193.96:0/2457967432 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f198010e760 0x7f19800ff260 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.723 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f197e5756c0 1 -- 10.20.193.96:0/2457967432 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f197000a660 con 0x7f198010cc30 2026-02-13T03:32:22.723 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f197e5756c0 1 --2- 10.20.193.96:0/2457967432 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f198010cc30 0x7f19800fea20 secure :-1 s=READY pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1974005dc0 tx=0x7f197400bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.723 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f19677fe6c0 1 -- 10.20.193.96:0/2457967432 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1974004250 con 0x7f198010cc30 2026-02-13T03:32:22.723 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f19677fe6c0 1 -- 10.20.193.96:0/2457967432 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f197400be30 con 0x7f198010cc30 2026-02-13T03:32:22.723 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f1984cf06c0 1 -- 10.20.193.96:0/2457967432 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1980100460 con 0x7f198010cc30 2026-02-13T03:32:22.723 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f19677fe6c0 1 -- 10.20.193.96:0/2457967432 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19740052a0 con 0x7f198010cc30 2026-02-13T03:32:22.723 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.722+0000 7f1984cf06c0 1 -- 10.20.193.96:0/2457967432 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1980100850 con 0x7f198010cc30 2026-02-13T03:32:22.723 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.723+0000 7f1984cf06c0 1 -- 10.20.193.96:0/2457967432 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19801731d0 con 0x7f198010cc30 2026-02-13T03:32:22.723 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.723+0000 7f19677fe6c0 1 -- 10.20.193.96:0/2457967432 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f1974004780 con 0x7f198010cc30 2026-02-13T03:32:22.723 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.724+0000 7f19677fe6c0 1 --2- 10.20.193.96:0/2457967432 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f1958048300 0x7f19580687b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.723 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.724+0000 7f19677fe6c0 1 -- 10.20.193.96:0/2457967432 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f1974051340 con 0x7f198010cc30 2026-02-13T03:32:22.723 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.724+0000 7f197dd746c0 1 --2- 10.20.193.96:0/2457967432 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f1958048300 0x7f19580687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.723 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.724+0000 7f197dd746c0 1 --2- 10.20.193.96:0/2457967432 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f1958048300 0x7f19580687b0 secure :-1 s=READY pgs=71 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1968004750 tx=0x7f1968007430 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.724 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.727+0000 7f19677fe6c0 1 -- 10.20.193.96:0/2457967432 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f19740043b0 con 0x7f198010cc30 2026-02-13T03:32:22.739 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.741+0000 7f2b461326c0 1 -- 10.20.193.96:0/1182099770 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f2b380b83a0 con 0x7f2b38008820 2026-02-13T03:32:22.742 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.744+0000 7f2b2e7fc6c0 1 -- 10.20.193.96:0/1182099770 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7f2b30008040 con 0x7f2b38008820 2026-02-13T03:32:22.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.747+0000 7f2b461326c0 1 -- 10.20.193.96:0/1182099770 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f2b1c03f870 msgr2=0x7f2b1c05fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.748+0000 7f2b461326c0 1 --2- 10.20.193.96:0/1182099770 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f2b1c03f870 0x7f2b1c05fd20 secure :-1 s=READY pgs=60 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b3c005830 tx=0x7f2b3c0069f0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.748+0000 7f2b461326c0 1 -- 10.20.193.96:0/1182099770 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2b38008820 msgr2=0x7f2b3809df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.748+0000 7f2b461326c0 1 --2- 10.20.193.96:0/1182099770 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2b38008820 0x7f2b3809df20 secure :-1 s=READY pgs=114 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b3000b6c0 tx=0x7f2b3000bb90 comp rx=0 tx=0).stop 2026-02-13T03:32:22.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.748+0000 7f2b461326c0 1 -- 10.20.193.96:0/1182099770 shutdown_connections 2026-02-13T03:32:22.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.748+0000 7f2b461326c0 1 --2- 10.20.193.96:0/1182099770 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f2b1c03f870 0x7f2b1c05fd20 unknown :-1 s=CLOSED pgs=60 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.748+0000 7f2b461326c0 1 --2- 10.20.193.96:0/1182099770 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2b380b4370 0x7f2b3809eb10 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.748+0000 7f2b461326c0 1 --2- 10.20.193.96:0/1182099770 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2b38008820 0x7f2b3809df20 unknown :-1 s=CLOSED pgs=114 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.748+0000 7f2b461326c0 1 --2- 10.20.193.96:0/1182099770 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2b380073e0 0x7f2b3809d8d0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.748+0000 7f2b461326c0 1 -- 10.20.193.96:0/1182099770 >> 10.20.193.96:0/1182099770 conn(0x7f2b38091f90 msgr2=0x7f2b38093c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.748+0000 7f2b461326c0 1 -- 10.20.193.96:0/1182099770 shutdown_connections 2026-02-13T03:32:22.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.748+0000 7f2b461326c0 1 -- 10.20.193.96:0/1182099770 wait complete. 2026-02-13T03:32:22.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.750+0000 7f9bef5a86c0 1 -- 10.20.193.96:0/3050932988 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9be8110a00 msgr2=0x7f9be8171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.750+0000 7f9bef5a86c0 1 --2- 10.20.193.96:0/3050932988 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9be8110a00 0x7f9be8171390 secure :-1 s=READY pgs=137 gs=1 cs=0 l=1 c_cookie=7004018752612121062 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9be400aa40 tx=0x7f9be402fde0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.750+0000 7f9bef5a86c0 1 -- 10.20.193.96:0/3050932988 shutdown_connections 2026-02-13T03:32:22.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.750+0000 7f9bef5a86c0 1 --2- 10.20.193.96:0/3050932988 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9be8110a00 0x7f9be8171390 unknown :-1 s=CLOSED pgs=137 gs=1 cs=0 l=1 c_cookie=7004018752612121062 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.750+0000 7f9bef5a86c0 1 --2- 10.20.193.96:0/3050932988 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9be8110050 0x7f9be81104c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.750+0000 7f9bef5a86c0 1 --2- 10.20.193.96:0/3050932988 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9be810eed0 0x7f9be810f2c0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.750+0000 7f9bef5a86c0 1 -- 10.20.193.96:0/3050932988 >> 10.20.193.96:0/3050932988 conn(0x7f9be80ec5f0 msgr2=0x7f9be810ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.751+0000 7f9bef5a86c0 1 -- 10.20.193.96:0/3050932988 shutdown_connections 2026-02-13T03:32:22.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.751+0000 7f9bef5a86c0 1 -- 10.20.193.96:0/3050932988 wait complete. 2026-02-13T03:32:22.751 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.751+0000 7f9bef5a86c0 1 Processor -- start 2026-02-13T03:32:22.751 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.751+0000 7f9bef5a86c0 1 -- start start 2026-02-13T03:32:22.751 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.751+0000 7f9bef5a86c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9be810eed0 0x7f9be80f84a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.751+0000 7f9bef5a86c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9be8110050 0x7f9be8171370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.751+0000 7f9bef5a86c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9be8110a00 0x7f9be80f8ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.751+0000 7f9bed31d6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9be810eed0 0x7f9be80f84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.752+0000 7f9bed31d6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9be810eed0 0x7f9be80f84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:59086/0 (socket says 10.20.193.96:59086) 2026-02-13T03:32:22.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.752+0000 7f9becb1c6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9be8110050 0x7f9be8171370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.752+0000 7f9bed31d6c0 1 -- 10.20.193.96:0/2418881508 learned_addr learned my addr 10.20.193.96:0/2418881508 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:22.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.752+0000 7f9bef5a86c0 1 -- 10.20.193.96:0/2418881508 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9be80f9930 con 0x7f9be810eed0 2026-02-13T03:32:22.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.752+0000 7f9bef5a86c0 1 -- 10.20.193.96:0/2418881508 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9be80f9aa0 con 0x7f9be8110050 2026-02-13T03:32:22.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.752+0000 7f9bef5a86c0 1 -- 10.20.193.96:0/2418881508 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9be80f9c60 con 0x7f9be8110a00 2026-02-13T03:32:22.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.752+0000 7f9bedb1e6c0 1 --2- 10.20.193.96:0/2418881508 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9be8110a00 0x7f9be80f8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.752+0000 7f9becb1c6c0 1 -- 10.20.193.96:0/2418881508 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9be8110050 msgr2=0x7f9be8171370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-13T03:32:22.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.752+0000 7f9becb1c6c0 1 -- 10.20.193.96:0/2418881508 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9be8110050 msgr2=0x7f9be8171370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:32:22.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.752+0000 7f9becb1c6c0 1 --2- 10.20.193.96:0/2418881508 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9be8110050 0x7f9be8171370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:32:22.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.752+0000 7f9becb1c6c0 1 --2- 10.20.193.96:0/2418881508 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9be8110050 0x7f9be8171370 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:32:22.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.752+0000 7f9bedb1e6c0 1 -- 10.20.193.96:0/2418881508 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9be8110a00 msgr2=0x7f9be80f8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T03:32:22.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.752+0000 7f9bedb1e6c0 1 -- 10.20.193.96:0/2418881508 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9be8110a00 msgr2=0x7f9be80f8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:32:22.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.752+0000 7f9bedb1e6c0 1 --2- 10.20.193.96:0/2418881508 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9be8110a00 0x7f9be80f8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:32:22.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.752+0000 7f9bedb1e6c0 1 --2- 10.20.193.96:0/2418881508 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9be8110a00 0x7f9be80f8ce0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:32:22.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.752+0000 7f9bed31d6c0 1 -- 10.20.193.96:0/2418881508 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9be8110a00 msgr2=0x7f9be80f8ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:32:22.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.752+0000 7f9bed31d6c0 1 --2- 10.20.193.96:0/2418881508 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9be8110a00 0x7f9be80f8ce0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.752+0000 7f9bed31d6c0 1 -- 10.20.193.96:0/2418881508 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9be8110050 msgr2=0x7f9be8171370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:32:22.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.752+0000 7f9bed31d6c0 1 --2- 10.20.193.96:0/2418881508 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9be8110050 0x7f9be8171370 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.752+0000 7f9bed31d6c0 1 -- 10.20.193.96:0/2418881508 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be400a660 con 0x7f9be810eed0 2026-02-13T03:32:22.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.752+0000 7f9bed31d6c0 1 --2- 10.20.193.96:0/2418881508 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9be810eed0 0x7f9be80f84a0 secure :-1 s=READY pgs=138 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bd8005dc0 tx=0x7f9bd800bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.753+0000 7f9bd67fc6c0 1 -- 10.20.193.96:0/2418881508 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9bd8004250 con 0x7f9be810eed0 2026-02-13T03:32:22.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.753+0000 7f9bd67fc6c0 1 -- 10.20.193.96:0/2418881508 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f9bd800be30 con 0x7f9be810eed0 2026-02-13T03:32:22.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.753+0000 7f9bd67fc6c0 1 -- 10.20.193.96:0/2418881508 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9bd80052a0 con 0x7f9be810eed0 2026-02-13T03:32:22.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.753+0000 7f9bef5a86c0 1 -- 10.20.193.96:0/2418881508 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9be80f9ee0 con 0x7f9be810eed0 2026-02-13T03:32:22.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.753+0000 7f9bef5a86c0 1 -- 10.20.193.96:0/2418881508 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9be80fa370 con 0x7f9be810eed0 2026-02-13T03:32:22.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.753+0000 7f80e17fa6c0 1 -- 10.20.193.96:0/915957713 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command([{prefix=config set, name=mds_use_global_snaprealm_seq_for_subvol}] v 0) -- 0x7f80c80055c0 con 0x7f80fc110050 2026-02-13T03:32:22.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.753+0000 7f9bef5a86c0 1 -- 10.20.193.96:0/2418881508 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9be8175450 con 0x7f9be810eed0 2026-02-13T03:32:22.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.754+0000 7f9bd67fc6c0 1 -- 10.20.193.96:0/2418881508 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f9bd8004780 con 0x7f9be810eed0 2026-02-13T03:32:22.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.754+0000 7f9bd67fc6c0 1 --2- 10.20.193.96:0/2418881508 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9bc403f8f0 0x7f9bc405fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.754+0000 7f9bd67fc6c0 1 -- 10.20.193.96:0/2418881508 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f9bd8051240 con 0x7f9be810eed0 2026-02-13T03:32:22.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.754+0000 7f9becb1c6c0 1 --2- 10.20.193.96:0/2418881508 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9bc403f8f0 0x7f9bc405fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.754+0000 7f9becb1c6c0 1 --2- 10.20.193.96:0/2418881508 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9bc403f8f0 0x7f9bc405fda0 secure :-1 s=READY pgs=72 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bdc005980 tx=0x7f9bdc005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.755+0000 7f80e37fe6c0 1 -- 10.20.193.96:0/915957713 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_use_global_snaprealm_seq_for_subvol}]=0 v23)=0 v23) ==== 141+0+0 (secure 0 0 0) 0x7f80f0005710 con 0x7f80fc110050 2026-02-13T03:32:22.756 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.758+0000 7f9bd67fc6c0 1 -- 10.20.193.96:0/2418881508 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9bd8013260 con 0x7f9be810eed0 2026-02-13T03:32:22.756 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.758+0000 7f80e17fa6c0 1 -- 10.20.193.96:0/915957713 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f80cc03f940 msgr2=0x7f80cc05fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.757 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.758+0000 7f80e17fa6c0 1 --2- 10.20.193.96:0/915957713 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f80cc03f940 0x7f80cc05fdf0 secure :-1 s=READY pgs=62 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80ec005980 tx=0x7f80ec005910 comp rx=0 tx=0).stop 2026-02-13T03:32:22.757 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.758+0000 7f80e17fa6c0 1 -- 10.20.193.96:0/915957713 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f80fc110050 msgr2=0x7f80fc171370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.757 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.758+0000 7f80e17fa6c0 1 --2- 10.20.193.96:0/915957713 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f80fc110050 0x7f80fc171370 secure :-1 s=READY pgs=117 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80f0005dc0 tx=0x7f80f000bed0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.757 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.759+0000 7f80e17fa6c0 1 -- 10.20.193.96:0/915957713 shutdown_connections 2026-02-13T03:32:22.757 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.759+0000 7f80e17fa6c0 1 --2- 10.20.193.96:0/915957713 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f80cc03f940 0x7f80cc05fdf0 unknown :-1 s=CLOSED pgs=62 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.757 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.759+0000 7f80e17fa6c0 1 --2- 10.20.193.96:0/915957713 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f80fc110a00 0x7f80fc0f8b00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.757 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.759+0000 7f80e17fa6c0 1 --2- 10.20.193.96:0/915957713 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f80fc110050 0x7f80fc171370 unknown :-1 s=CLOSED pgs=117 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.757 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.759+0000 7f80e17fa6c0 1 --2- 10.20.193.96:0/915957713 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f80fc10eed0 0x7f80fc0f82c0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.757 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.759+0000 7f80e17fa6c0 1 -- 10.20.193.96:0/915957713 >> 10.20.193.96:0/915957713 conn(0x7f80fc0ec5f0 msgr2=0x7f80fc0ee3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.757 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.759+0000 7f80e17fa6c0 1 -- 10.20.193.96:0/915957713 shutdown_connections 2026-02-13T03:32:22.757 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.759+0000 7f80e17fa6c0 1 -- 10.20.193.96:0/915957713 wait complete. 2026-02-13T03:32:22.760 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.762+0000 7fa2351c86c0 1 -- 10.20.193.96:0/2255798277 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fa23010bf00 con 0x7fa23010bb10 2026-02-13T03:32:22.761 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.763+0000 7fa20ffff6c0 1 -- 10.20.193.96:0/2255798277 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v24)=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7fa22400f540 con 0x7fa23010bb10 2026-02-13T03:32:22.763 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:22.578+0000 7f64a3aebfc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T03:32:22.764 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.766+0000 7fa2351c86c0 1 -- 10.20.193.96:0/2255798277 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa20403f8f0 msgr2=0x7fa20405fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.764 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.766+0000 7fa2351c86c0 1 --2- 10.20.193.96:0/2255798277 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa20403f8f0 0x7fa20405fda0 secure :-1 s=READY pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2180098c0 tx=0x7fa2180023a0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.764 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.766+0000 7fa2351c86c0 1 -- 10.20.193.96:0/2255798277 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa23010bb10 msgr2=0x7fa2300f5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.764 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.766+0000 7fa2351c86c0 1 --2- 10.20.193.96:0/2255798277 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa23010bb10 0x7fa2300f5110 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa22400b750 tx=0x7fa22400bc20 comp rx=0 tx=0).stop 2026-02-13T03:32:22.768 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.768 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.770+0000 7fa2351c86c0 1 -- 10.20.193.96:0/2255798277 shutdown_connections 2026-02-13T03:32:22.768 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.770+0000 7fa2351c86c0 1 --2- 10.20.193.96:0/2255798277 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa20403f8f0 0x7fa20405fda0 unknown :-1 s=CLOSED pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.769 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.770+0000 7fa2351c86c0 1 --2- 10.20.193.96:0/2255798277 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa23010d640 0x7fa2300f5970 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.769 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.770+0000 7fa2351c86c0 1 --2- 10.20.193.96:0/2255798277 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa23010cc90 0x7fa23016dfd0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.769 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.770+0000 7fa2351c86c0 1 --2- 10.20.193.96:0/2255798277 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa23010bb10 0x7fa2300f5110 unknown :-1 s=CLOSED pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.769 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.770+0000 7fa2351c86c0 1 -- 10.20.193.96:0/2255798277 >> 10.20.193.96:0/2255798277 conn(0x7fa2300e9230 msgr2=0x7fa2300eb770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.769 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.770+0000 7fa2351c86c0 1 -- 10.20.193.96:0/2255798277 shutdown_connections 2026-02-13T03:32:22.769 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.770+0000 7fa2351c86c0 1 -- 10.20.193.96:0/2255798277 wait complete. 2026-02-13T03:32:22.771 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.774+0000 7f97244016c0 1 -- 10.20.193.96:0/1589063580 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f971c066940 con 0x7f971c110a00 2026-02-13T03:32:22.774 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.776+0000 7f97037fe6c0 1 -- 10.20.193.96:0/1589063580 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v25)=0 v25) ==== 119+0+0 (secure 0 0 0) 0x7f9718035040 con 0x7f971c110a00 2026-02-13T03:32:22.777 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.780+0000 7f97244016c0 1 -- 10.20.193.96:0/1589063580 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f96f803f870 msgr2=0x7f96f805fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.778 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.780+0000 7f97244016c0 1 --2- 10.20.193.96:0/1589063580 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f96f803f870 0x7f96f805fd20 secure :-1 s=READY pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f970c005b40 tx=0x7f970c0073d0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.778 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.780+0000 7f97244016c0 1 -- 10.20.193.96:0/1589063580 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f971c110a00 msgr2=0x7f971c114ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.778 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.780+0000 7f97244016c0 1 --2- 10.20.193.96:0/1589063580 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f971c110a00 0x7f971c114ae0 secure :-1 s=READY pgs=122 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9718006fd0 tx=0x7f97180307b0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.778 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.780+0000 7f97244016c0 1 -- 10.20.193.96:0/1589063580 shutdown_connections 2026-02-13T03:32:22.778 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.780+0000 7f97244016c0 1 --2- 10.20.193.96:0/1589063580 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f96f803f870 0x7f96f805fd20 unknown :-1 s=CLOSED pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.778 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.780+0000 7f97244016c0 1 --2- 10.20.193.96:0/1589063580 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f971c110a00 0x7f971c114ae0 unknown :-1 s=CLOSED pgs=122 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.778 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.780+0000 7f97244016c0 1 --2- 10.20.193.96:0/1589063580 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f971c110050 0x7f971c113ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.778 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.780+0000 7f97244016c0 1 --2- 10.20.193.96:0/1589063580 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f971c10eed0 0x7f971c1138a0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.778 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.780+0000 7f97244016c0 1 -- 10.20.193.96:0/1589063580 >> 10.20.193.96:0/1589063580 conn(0x7f971c0ec5f0 msgr2=0x7f971c10c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.778 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.780+0000 7f97244016c0 1 -- 10.20.193.96:0/1589063580 shutdown_connections 2026-02-13T03:32:22.779 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.780+0000 7f97244016c0 1 -- 10.20.193.96:0/1589063580 wait complete. 2026-02-13T03:32:22.779 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.781+0000 7f22ddffb6c0 1 -- 10.20.193.96:0/3215187975 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f22c80055c0 con 0x7f230010cc50 2026-02-13T03:32:22.781 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.783+0000 7f22dffff6c0 1 -- 10.20.193.96:0/3215187975 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v26)=0 v26) ==== 121+0+0 (secure 0 0 0) 0x7f22f4004b40 con 0x7f230010cc50 2026-02-13T03:32:22.784 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.787+0000 7f22ddffb6c0 1 -- 10.20.193.96:0/3215187975 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f22d403f8f0 msgr2=0x7f22d405fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.784 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.787+0000 7f22ddffb6c0 1 --2- 10.20.193.96:0/3215187975 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f22d403f8f0 0x7f22d405fda0 secure :-1 s=READY pgs=63 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22e8005980 tx=0x7f22e8005910 comp rx=0 tx=0).stop 2026-02-13T03:32:22.784 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.787+0000 7f22ddffb6c0 1 -- 10.20.193.96:0/3215187975 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f230010cc50 msgr2=0x7f23000f6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.784 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.787+0000 7f22ddffb6c0 1 --2- 10.20.193.96:0/3215187975 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f230010cc50 0x7f23000f6020 secure :-1 s=READY pgs=120 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22f4005980 tx=0x7f22f400bbd0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.785 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.787+0000 7f22ddffb6c0 1 -- 10.20.193.96:0/3215187975 shutdown_connections 2026-02-13T03:32:22.785 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.787+0000 7f22ddffb6c0 1 --2- 10.20.193.96:0/3215187975 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f22d403f8f0 0x7f22d405fda0 unknown :-1 s=CLOSED pgs=63 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.785 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.787+0000 7f22ddffb6c0 1 --2- 10.20.193.96:0/3215187975 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f230010e780 0x7f23000f6880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.786 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.787+0000 7f22ddffb6c0 1 --2- 10.20.193.96:0/3215187975 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f230010ddd0 0x7f230016f110 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.786 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.787+0000 7f22ddffb6c0 1 --2- 10.20.193.96:0/3215187975 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f230010cc50 0x7f23000f6020 unknown :-1 s=CLOSED pgs=120 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.786 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.787+0000 7f22ddffb6c0 1 -- 10.20.193.96:0/3215187975 >> 10.20.193.96:0/3215187975 conn(0x7f23000ea370 msgr2=0x7f23000ec160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.786 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.787+0000 7f22ddffb6c0 1 -- 10.20.193.96:0/3215187975 shutdown_connections 2026-02-13T03:32:22.786 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.787+0000 7f22ddffb6c0 1 -- 10.20.193.96:0/3215187975 wait complete. 2026-02-13T03:32:22.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.794+0000 7fac6814b6c0 1 -- 10.20.193.96:0/1277925427 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fac6010eed0 msgr2=0x7fac6010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.794+0000 7fac6814b6c0 1 --2- 10.20.193.96:0/1277925427 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fac6010eed0 0x7fac6010f2c0 secure :-1 s=READY pgs=139 gs=3 cs=0 l=1 c_cookie=12951273483252641685 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac50009970 tx=0x7fac5002ed20 comp rx=0 tx=0).stop 2026-02-13T03:32:22.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.794+0000 7fac6814b6c0 1 -- 10.20.193.96:0/1277925427 shutdown_connections 2026-02-13T03:32:22.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.794+0000 7fac6814b6c0 1 --2- 10.20.193.96:0/1277925427 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fac60110a00 0x7fac60171390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.794+0000 7fac6814b6c0 1 --2- 10.20.193.96:0/1277925427 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fac60110050 0x7fac601104c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.794+0000 7fac6814b6c0 1 --2- 10.20.193.96:0/1277925427 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fac6010eed0 0x7fac6010f2c0 unknown :-1 s=CLOSED pgs=139 gs=3 cs=0 l=1 c_cookie=12951273483252641685 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.793 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.794+0000 7fac6814b6c0 1 -- 10.20.193.96:0/1277925427 >> 10.20.193.96:0/1277925427 conn(0x7fac600ec5f0 msgr2=0x7fac6010ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.793 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.794+0000 7fac6814b6c0 1 -- 10.20.193.96:0/1277925427 shutdown_connections 2026-02-13T03:32:22.793 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.794+0000 7fac6814b6c0 1 -- 10.20.193.96:0/1277925427 wait complete. 2026-02-13T03:32:22.794 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.795+0000 7fac6814b6c0 1 Processor -- start 2026-02-13T03:32:22.794 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.795+0000 7fac6814b6c0 1 -- start start 2026-02-13T03:32:22.794 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.795+0000 7fac6814b6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fac6010eed0 0x7fac60062c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.794 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.795+0000 7fac6814b6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fac60110050 0x7fac60171370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.794 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.795+0000 7fac6814b6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fac60110a00 0x7fac600634a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.794 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.795+0000 7fac6814b6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fac600640f0 con 0x7fac60110a00 2026-02-13T03:32:22.794 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.795+0000 7fac6814b6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fac60064260 con 0x7fac6010eed0 2026-02-13T03:32:22.794 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.795+0000 7fac6814b6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fac60064420 con 0x7fac60110050 2026-02-13T03:32:22.795 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.796+0000 7fac656bb6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fac60110050 0x7fac60171370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.795 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.796+0000 7fac656bb6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fac60110050 0x7fac60171370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.133:3300/0 says I am v2:10.20.193.96:33686/0 (socket says 10.20.193.96:33686) 2026-02-13T03:32:22.795 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.796+0000 7fac656bb6c0 1 -- 10.20.193.96:0/3505092893 learned_addr learned my addr 10.20.193.96:0/3505092893 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:22.795 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.796+0000 7fac656bb6c0 1 -- 10.20.193.96:0/3505092893 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fac60110050 msgr2=0x7fac60171370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-13T03:32:22.795 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.796+0000 7fac656bb6c0 1 -- 10.20.193.96:0/3505092893 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fac60110050 msgr2=0x7fac60171370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:32:22.795 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.796+0000 7fac656bb6c0 1 --2- 10.20.193.96:0/3505092893 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fac60110050 0x7fac60171370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:32:22.795 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.796+0000 7fac656bb6c0 1 --2- 10.20.193.96:0/3505092893 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fac60110050 0x7fac60171370 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:32:22.795 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.797+0000 7fac666bd6c0 1 --2- 10.20.193.96:0/3505092893 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fac60110a00 0x7fac600634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.796 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.798+0000 7fac65ebc6c0 1 --2- 10.20.193.96:0/3505092893 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fac6010eed0 0x7fac60062c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.796 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.798+0000 7fac65ebc6c0 1 -- 10.20.193.96:0/3505092893 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fac6010eed0 msgr2=0x7fac60062c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-13T03:32:22.796 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.798+0000 7fac65ebc6c0 1 -- 10.20.193.96:0/3505092893 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fac6010eed0 msgr2=0x7fac60062c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:32:22.796 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.798+0000 7fac65ebc6c0 1 --2- 10.20.193.96:0/3505092893 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fac6010eed0 0x7fac60062c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:32:22.796 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.798+0000 7fac65ebc6c0 1 --2- 10.20.193.96:0/3505092893 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fac6010eed0 0x7fac60062c60 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:32:22.796 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.798+0000 7fac666bd6c0 1 -- 10.20.193.96:0/3505092893 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fac60110050 msgr2=0x7fac60171370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:32:22.797 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.798+0000 7fac666bd6c0 1 --2- 10.20.193.96:0/3505092893 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fac60110050 0x7fac60171370 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.797 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.798+0000 7fac666bd6c0 1 -- 10.20.193.96:0/3505092893 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fac6010eed0 msgr2=0x7fac60062c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:32:22.797 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.798+0000 7fac666bd6c0 1 --2- 10.20.193.96:0/3505092893 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fac6010eed0 0x7fac60062c60 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.797 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.798+0000 7fac666bd6c0 1 -- 10.20.193.96:0/3505092893 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac50009590 con 0x7fac60110a00 2026-02-13T03:32:22.797 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.800+0000 7fac666bd6c0 1 --2- 10.20.193.96:0/3505092893 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fac60110a00 0x7fac600634a0 secure :-1 s=READY pgs=140 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac5c00c6c0 tx=0x7fac5c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.798 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.800+0000 7fac4effd6c0 1 -- 10.20.193.96:0/3505092893 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac5c005340 con 0x7fac60110a00 2026-02-13T03:32:22.798 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.800+0000 7fac4effd6c0 1 -- 10.20.193.96:0/3505092893 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fac5c003cf0 con 0x7fac60110a00 2026-02-13T03:32:22.798 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.800+0000 7fac6814b6c0 1 -- 10.20.193.96:0/3505092893 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac600646a0 con 0x7fac60110a00 2026-02-13T03:32:22.798 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.800+0000 7fac4effd6c0 1 -- 10.20.193.96:0/3505092893 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac5c00dd20 con 0x7fac60110a00 2026-02-13T03:32:22.798 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.800+0000 7fac6814b6c0 1 -- 10.20.193.96:0/3505092893 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac60064b80 con 0x7fac60110a00 2026-02-13T03:32:22.799 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.801+0000 7fac4cff96c0 1 -- 10.20.193.96:0/3505092893 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac2c005310 con 0x7fac60110a00 2026-02-13T03:32:22.799 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.801+0000 7fac4effd6c0 1 -- 10.20.193.96:0/3505092893 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7fac5c0082a0 con 0x7fac60110a00 2026-02-13T03:32:22.799 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.801+0000 7fac4effd6c0 1 --2- 10.20.193.96:0/3505092893 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fac3c03f8f0 0x7fac3c05fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:22.800 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.801+0000 7fac4effd6c0 1 -- 10.20.193.96:0/3505092893 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7fac5c052290 con 0x7fac60110a00 2026-02-13T03:32:22.800 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.801+0000 7fac65ebc6c0 1 --2- 10.20.193.96:0/3505092893 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fac3c03f8f0 0x7fac3c05fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:22.801 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.802+0000 7fac65ebc6c0 1 --2- 10.20.193.96:0/3505092893 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fac3c03f8f0 0x7fac3c05fda0 secure :-1 s=READY pgs=73 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac500098c0 tx=0x7fac500023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:22.802 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.805+0000 7fd91cb986c0 1 -- 10.20.193.96:0/3924985232 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7fd918172840 con 0x7fd91810e780 2026-02-13T03:32:22.806 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.808+0000 7fd8ff7fe6c0 1 -- 10.20.193.96:0/3924985232 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v27)=0 v27) ==== 119+0+0 (secure 0 0 0) 0x7fd90800f7c0 con 0x7fd91810e780 2026-02-13T03:32:22.806 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.809+0000 7fac4effd6c0 1 -- 10.20.193.96:0/3505092893 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fac5c009030 con 0x7fac60110a00 2026-02-13T03:32:22.808 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.810 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.812+0000 7fd91cb986c0 1 -- 10.20.193.96:0/3924985232 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd8f0043d80 msgr2=0x7fd8f0064230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.810 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.812+0000 7fd91cb986c0 1 --2- 10.20.193.96:0/3924985232 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd8f0043d80 0x7fd8f0064230 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd90c004750 tx=0x7fd90c005ac0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.810 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.812+0000 7fd91cb986c0 1 -- 10.20.193.96:0/3924985232 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd91810e780 msgr2=0x7fd9180f68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.810 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.812+0000 7fd91cb986c0 1 --2- 10.20.193.96:0/3924985232 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd91810e780 0x7fd9180f68b0 secure :-1 s=READY pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd908006ea0 tx=0x7fd908006530 comp rx=0 tx=0).stop 2026-02-13T03:32:22.811 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.812+0000 7fd91cb986c0 1 -- 10.20.193.96:0/3924985232 shutdown_connections 2026-02-13T03:32:22.811 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.812+0000 7fd91cb986c0 1 --2- 10.20.193.96:0/3924985232 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd8f0043d80 0x7fd8f0064230 unknown :-1 s=CLOSED pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.811 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.812+0000 7fd91cb986c0 1 --2- 10.20.193.96:0/3924985232 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd91810e780 0x7fd9180f68b0 unknown :-1 s=CLOSED pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.811 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.812+0000 7fd91cb986c0 1 --2- 10.20.193.96:0/3924985232 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd91810ddd0 0x7fd91816f0f0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.811 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.812+0000 7fd91cb986c0 1 --2- 10.20.193.96:0/3924985232 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd91810cc50 0x7fd9180f6070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.811 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.812+0000 7fd91cb986c0 1 -- 10.20.193.96:0/3924985232 >> 10.20.193.96:0/3924985232 conn(0x7fd9180ea370 msgr2=0x7fd9180ec120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.811 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.812+0000 7fd91cb986c0 1 -- 10.20.193.96:0/3924985232 shutdown_connections 2026-02-13T03:32:22.811 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.812+0000 7fd91cb986c0 1 -- 10.20.193.96:0/3924985232 wait complete. 2026-02-13T03:32:22.824 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_use_global_snaprealm_seq_for_subvol', 'False'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.824 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.825 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.826+0000 7f64282836c0 1 -- 10.20.193.96:0/1257702778 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f64200613d0 con 0x7f6420064800 2026-02-13T03:32:22.826 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.829+0000 7f640effd6c0 1 -- 10.20.193.96:0/1257702778 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v28)=0 v28) ==== 111+0+0 (secure 0 0 0) 0x7f641c0128a0 con 0x7f6420064800 2026-02-13T03:32:22.826 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.829+0000 7f7b0b7fe6c0 1 -- 10.20.193.96:0/270126815 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f7afc005b40 con 0x7f7b3c10cc50 2026-02-13T03:32:22.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.831+0000 7f60a4e8c6c0 1 -- 10.20.193.96:0/4150554553 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f60a01705d0 con 0x7f60a014d850 2026-02-13T03:32:22.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.831+0000 7f64282836c0 1 -- 10.20.193.96:0/1257702778 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f63fc03f8c0 msgr2=0x7f63fc05fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.831+0000 7f64282836c0 1 --2- 10.20.193.96:0/1257702778 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f63fc03f8c0 0x7f63fc05fd70 secure :-1 s=READY pgs=67 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64100098c0 tx=0x7f6410031f70 comp rx=0 tx=0).stop 2026-02-13T03:32:22.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.831+0000 7f64282836c0 1 -- 10.20.193.96:0/1257702778 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6420064800 msgr2=0x7f64201024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.831+0000 7f64282836c0 1 --2- 10.20.193.96:0/1257702778 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6420064800 0x7f64201024e0 secure :-1 s=READY pgs=130 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f641c006ea0 tx=0x7f641c00cca0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.831+0000 7f64282836c0 1 -- 10.20.193.96:0/1257702778 shutdown_connections 2026-02-13T03:32:22.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.831+0000 7f64282836c0 1 --2- 10.20.193.96:0/1257702778 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f63fc03f8c0 0x7f63fc05fd70 unknown :-1 s=CLOSED pgs=67 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.831+0000 7f64282836c0 1 --2- 10.20.193.96:0/1257702778 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6420064800 0x7f64201024e0 unknown :-1 s=CLOSED pgs=130 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.831+0000 7f64282836c0 1 --2- 10.20.193.96:0/1257702778 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6420063e50 0x7f64201018f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.831+0000 7f64282836c0 1 --2- 10.20.193.96:0/1257702778 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6420062cd0 0x7f64201012a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.831 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.831+0000 7f64282836c0 1 -- 10.20.193.96:0/1257702778 >> 10.20.193.96:0/1257702778 conn(0x7f64200ec5f0 msgr2=0x7f6420058790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.831 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.831+0000 7f7b31ffb6c0 1 -- 10.20.193.96:0/270126815 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v29)=0 v29) ==== 120+0+0 (secure 0 0 0) 0x7f7b2c00f550 con 0x7f7b3c10cc50 2026-02-13T03:32:22.831 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.831+0000 7f64282836c0 1 -- 10.20.193.96:0/1257702778 shutdown_connections 2026-02-13T03:32:22.831 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.831+0000 7f64282836c0 1 -- 10.20.193.96:0/1257702778 wait complete. 2026-02-13T03:32:22.832 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.834+0000 7f60877fe6c0 1 -- 10.20.193.96:0/4150554553 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v30)=0 v30) ==== 120+0+0 (secure 0 0 0) 0x7f6090010550 con 0x7f60a014d850 2026-02-13T03:32:22.834 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.835+0000 7f7b0b7fe6c0 1 -- 10.20.193.96:0/270126815 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7b1803f8f0 msgr2=0x7f7b1805fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.834 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.835+0000 7f7b0b7fe6c0 1 --2- 10.20.193.96:0/270126815 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7b1803f8f0 0x7f7b1805fda0 secure :-1 s=READY pgs=66 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b24005b40 tx=0x7f7b240072a0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.834 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.835+0000 7f7b0b7fe6c0 1 -- 10.20.193.96:0/270126815 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7b3c10cc50 msgr2=0x7f7b3c0f6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.834 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.835+0000 7f7b0b7fe6c0 1 --2- 10.20.193.96:0/270126815 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7b3c10cc50 0x7f7b3c0f6020 secure :-1 s=READY pgs=127 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b2c00b6c0 tx=0x7f7b2c00bb90 comp rx=0 tx=0).stop 2026-02-13T03:32:22.834 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.835+0000 7f7b0b7fe6c0 1 -- 10.20.193.96:0/270126815 shutdown_connections 2026-02-13T03:32:22.834 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.835+0000 7f7b0b7fe6c0 1 --2- 10.20.193.96:0/270126815 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7b1803f8f0 0x7f7b1805fda0 unknown :-1 s=CLOSED pgs=66 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.834 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.835+0000 7f7b0b7fe6c0 1 --2- 10.20.193.96:0/270126815 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7b3c10e780 0x7f7b3c0f6880 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.834 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.835+0000 7f7b0b7fe6c0 1 --2- 10.20.193.96:0/270126815 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7b3c10ddd0 0x7f7b3c16f110 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.834 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.835+0000 7f7b0b7fe6c0 1 --2- 10.20.193.96:0/270126815 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7b3c10cc50 0x7f7b3c0f6020 unknown :-1 s=CLOSED pgs=127 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.834 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.835+0000 7f7b0b7fe6c0 1 -- 10.20.193.96:0/270126815 >> 10.20.193.96:0/270126815 conn(0x7f7b3c0ea370 msgr2=0x7f7b3c0ec160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.835 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.835+0000 7f7b0b7fe6c0 1 -- 10.20.193.96:0/270126815 shutdown_connections 2026-02-13T03:32:22.835 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.835+0000 7f7b0b7fe6c0 1 -- 10.20.193.96:0/270126815 wait complete. 2026-02-13T03:32:22.836 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.837+0000 7f60a4e8c6c0 1 -- 10.20.193.96:0/4150554553 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f606c03f8f0 msgr2=0x7f606c05fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.836 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.837+0000 7f60a4e8c6c0 1 --2- 10.20.193.96:0/4150554553 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f606c03f8f0 0x7f606c05fda0 secure :-1 s=READY pgs=68 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60940023e0 tx=0x7f6094002ee0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.836 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.837+0000 7f60a4e8c6c0 1 -- 10.20.193.96:0/4150554553 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f60a014d850 msgr2=0x7f60a0159f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.836 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.837+0000 7f60a4e8c6c0 1 --2- 10.20.193.96:0/4150554553 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f60a014d850 0x7f60a0159f30 secure :-1 s=READY pgs=131 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6090006090 tx=0x7f6090006560 comp rx=0 tx=0).stop 2026-02-13T03:32:22.836 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.837+0000 7f60a4e8c6c0 1 -- 10.20.193.96:0/4150554553 shutdown_connections 2026-02-13T03:32:22.836 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.837+0000 7f60a4e8c6c0 1 --2- 10.20.193.96:0/4150554553 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f606c03f8f0 0x7f606c05fda0 unknown :-1 s=CLOSED pgs=68 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.836 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.837+0000 7f60a4e8c6c0 1 --2- 10.20.193.96:0/4150554553 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f60a014d850 0x7f60a0159f30 unknown :-1 s=CLOSED pgs=131 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.836 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.837+0000 7f60a4e8c6c0 1 --2- 10.20.193.96:0/4150554553 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f60a012cc90 0x7f60a01088f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.836 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.837+0000 7f60a4e8c6c0 1 --2- 10.20.193.96:0/4150554553 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f60a010c250 0x7f60a014d110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.836 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.837+0000 7f60a4e8c6c0 1 -- 10.20.193.96:0/4150554553 >> 10.20.193.96:0/4150554553 conn(0x7f60a00e8510 msgr2=0x7f60a01509e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.837 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.837+0000 7f60a4e8c6c0 1 -- 10.20.193.96:0/4150554553 shutdown_connections 2026-02-13T03:32:22.837 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.837+0000 7f60a4e8c6c0 1 -- 10.20.193.96:0/4150554553 wait complete. 2026-02-13T03:32:22.838 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.839+0000 7fd02106f6c0 1 -- 10.20.193.96:0/2044308504 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fd01c0f8500 con 0x7fd01c10cc50 2026-02-13T03:32:22.838 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.840+0000 7fcffbfff6c0 1 -- 10.20.193.96:0/2044308504 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v30)=0 v30) ==== 106+0+0 (secure 0 0 0) 0x7fd01003c060 con 0x7fd01c10cc50 2026-02-13T03:32:22.839 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.841 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.842+0000 7fd02106f6c0 1 -- 10.20.193.96:0/2044308504 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcfe803f8f0 msgr2=0x7fcfe805fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.841 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.842+0000 7fd02106f6c0 1 --2- 10.20.193.96:0/2044308504 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcfe803f8f0 0x7fcfe805fda0 secure :-1 s=READY pgs=69 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd004004750 tx=0x7fd004005ac0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.842 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.842+0000 7fd02106f6c0 1 -- 10.20.193.96:0/2044308504 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd01c10cc50 msgr2=0x7fd01c0f6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.842 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.842+0000 7fd02106f6c0 1 --2- 10.20.193.96:0/2044308504 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd01c10cc50 0x7fd01c0f6250 secure :-1 s=READY pgs=132 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd010005980 tx=0x7fd010003bf0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.842 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.842+0000 7fd02106f6c0 1 -- 10.20.193.96:0/2044308504 shutdown_connections 2026-02-13T03:32:22.842 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.842+0000 7fd02106f6c0 1 --2- 10.20.193.96:0/2044308504 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcfe803f8f0 0x7fcfe805fda0 unknown :-1 s=CLOSED pgs=69 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.842 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.842+0000 7fd02106f6c0 1 --2- 10.20.193.96:0/2044308504 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd01c10e780 0x7fd01c0f6ab0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.842 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.842+0000 7fd02106f6c0 1 --2- 10.20.193.96:0/2044308504 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd01c10ddd0 0x7fd01c16f110 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.842 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.842+0000 7fd02106f6c0 1 --2- 10.20.193.96:0/2044308504 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd01c10cc50 0x7fd01c0f6250 unknown :-1 s=CLOSED pgs=132 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.842 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.843+0000 7fd02106f6c0 1 -- 10.20.193.96:0/2044308504 >> 10.20.193.96:0/2044308504 conn(0x7fd01c0ea370 msgr2=0x7fd01c0ec3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.842 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.843+0000 7fd02106f6c0 1 -- 10.20.193.96:0/2044308504 shutdown_connections 2026-02-13T03:32:22.842 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.843+0000 7fd02106f6c0 1 -- 10.20.193.96:0/2044308504 wait complete. 2026-02-13T03:32:22.843 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.843+0000 7f5c29e0d6c0 1 -- 10.20.193.96:0/1278782171 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f5c2410d040 con 0x7f5c2410cc50 2026-02-13T03:32:22.843 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.843+0000 7f5c20ff96c0 1 -- 10.20.193.96:0/1278782171 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v30)=0 v30) ==== 108+0+0 (secure 0 0 0) 0x7f5c10014540 con 0x7f5c2410cc50 2026-02-13T03:32:22.844 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.846+0000 7f5c29e0d6c0 1 -- 10.20.193.96:0/1278782171 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f5bf803f8f0 msgr2=0x7f5bf805fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.845 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.846+0000 7f5c29e0d6c0 1 --2- 10.20.193.96:0/1278782171 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f5bf803f8f0 0x7f5bf805fda0 secure :-1 s=READY pgs=70 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c14005980 tx=0x7f5c14005910 comp rx=0 tx=0).stop 2026-02-13T03:32:22.845 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.846+0000 7f5c29e0d6c0 1 -- 10.20.193.96:0/1278782171 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5c2410cc50 msgr2=0x7f5c24061ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.845 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.846+0000 7f5c29e0d6c0 1 --2- 10.20.193.96:0/1278782171 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5c2410cc50 0x7f5c24061ea0 secure :-1 s=READY pgs=134 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c10004750 tx=0x7f5c1000bed0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.845 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.846+0000 7f5c29e0d6c0 1 -- 10.20.193.96:0/1278782171 shutdown_connections 2026-02-13T03:32:22.845 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.846+0000 7f5c29e0d6c0 1 --2- 10.20.193.96:0/1278782171 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f5bf803f8f0 0x7f5bf805fda0 unknown :-1 s=CLOSED pgs=70 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.845 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.846+0000 7f5c29e0d6c0 1 --2- 10.20.193.96:0/1278782171 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5c2410e780 0x7f5c240607a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.845 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.846+0000 7f5c29e0d6c0 1 --2- 10.20.193.96:0/1278782171 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5c2410ddd0 0x7f5c2416f0f0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.845 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.846+0000 7f5c29e0d6c0 1 --2- 10.20.193.96:0/1278782171 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5c2410cc50 0x7f5c24061ea0 unknown :-1 s=CLOSED pgs=134 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.845 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.846+0000 7f5c29e0d6c0 1 -- 10.20.193.96:0/1278782171 >> 10.20.193.96:0/1278782171 conn(0x7f5c240ea370 msgr2=0x7f5c240ec2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.845 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.846+0000 7f5c29e0d6c0 1 -- 10.20.193.96:0/1278782171 shutdown_connections 2026-02-13T03:32:22.846 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.846+0000 7f5c29e0d6c0 1 -- 10.20.193.96:0/1278782171 wait complete. 2026-02-13T03:32:22.848 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.861 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.863+0000 7f1984cf06c0 1 -- 10.20.193.96:0/2457967432 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f1980172820 con 0x7f198010cc30 2026-02-13T03:32:22.865 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.867+0000 7f19677fe6c0 1 -- 10.20.193.96:0/2457967432 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v31)=0 v31) ==== 121+0+0 (secure 0 0 0) 0x7f197400e890 con 0x7f198010cc30 2026-02-13T03:32:22.869 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.870+0000 7f1984cf06c0 1 -- 10.20.193.96:0/2457967432 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f1958048300 msgr2=0x7f19580687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.869 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.870+0000 7f1984cf06c0 1 --2- 10.20.193.96:0/2457967432 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f1958048300 0x7f19580687b0 secure :-1 s=READY pgs=71 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1968004750 tx=0x7f1968007430 comp rx=0 tx=0).stop 2026-02-13T03:32:22.869 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.870+0000 7f1984cf06c0 1 -- 10.20.193.96:0/2457967432 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f198010cc30 msgr2=0x7f19800fea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.869 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.870+0000 7f1984cf06c0 1 --2- 10.20.193.96:0/2457967432 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f198010cc30 0x7f19800fea20 secure :-1 s=READY pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1974005dc0 tx=0x7f197400bbd0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.869 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.871+0000 7f1984cf06c0 1 -- 10.20.193.96:0/2457967432 shutdown_connections 2026-02-13T03:32:22.869 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.871+0000 7f1984cf06c0 1 --2- 10.20.193.96:0/2457967432 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f1958048300 0x7f19580687b0 unknown :-1 s=CLOSED pgs=71 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.869 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.871+0000 7f1984cf06c0 1 --2- 10.20.193.96:0/2457967432 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f198010e760 0x7f19800ff260 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.869 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.871+0000 7f1984cf06c0 1 --2- 10.20.193.96:0/2457967432 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f198010ddb0 0x7f198016f0d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.869 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.871+0000 7f1984cf06c0 1 --2- 10.20.193.96:0/2457967432 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f198010cc30 0x7f19800fea20 unknown :-1 s=CLOSED pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.869 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.871+0000 7f1984cf06c0 1 -- 10.20.193.96:0/2457967432 >> 10.20.193.96:0/2457967432 conn(0x7f19800ea330 msgr2=0x7f19800562d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.869 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.871+0000 7f1984cf06c0 1 -- 10.20.193.96:0/2457967432 shutdown_connections 2026-02-13T03:32:22.869 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.871+0000 7f1984cf06c0 1 -- 10.20.193.96:0/2457967432 wait complete. 2026-02-13T03:32:22.887 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.889+0000 7f9bef5a86c0 1 -- 10.20.193.96:0/2418881508 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f9be810f2c0 con 0x7f9be810eed0 2026-02-13T03:32:22.890 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.890 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.890 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.890 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.890 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.892+0000 7f9bd67fc6c0 1 -- 10.20.193.96:0/2418881508 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v32)=0 v32) ==== 125+0+0 (secure 0 0 0) 0x7f9bd8013260 con 0x7f9be810eed0 2026-02-13T03:32:22.893 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.895+0000 7f9bef5a86c0 1 -- 10.20.193.96:0/2418881508 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9bc403f8f0 msgr2=0x7f9bc405fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.893 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.895+0000 7f9bef5a86c0 1 --2- 10.20.193.96:0/2418881508 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9bc403f8f0 0x7f9bc405fda0 secure :-1 s=READY pgs=72 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bdc005980 tx=0x7f9bdc005910 comp rx=0 tx=0).stop 2026-02-13T03:32:22.893 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.895+0000 7f9bef5a86c0 1 -- 10.20.193.96:0/2418881508 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9be810eed0 msgr2=0x7f9be80f84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.893 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.895+0000 7f9bef5a86c0 1 --2- 10.20.193.96:0/2418881508 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9be810eed0 0x7f9be80f84a0 secure :-1 s=READY pgs=138 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bd8005dc0 tx=0x7f9bd800bbd0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.893 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.895+0000 7f9bef5a86c0 1 -- 10.20.193.96:0/2418881508 shutdown_connections 2026-02-13T03:32:22.893 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.895+0000 7f9bef5a86c0 1 --2- 10.20.193.96:0/2418881508 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9bc403f8f0 0x7f9bc405fda0 unknown :-1 s=CLOSED pgs=72 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.893 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.895+0000 7f9bef5a86c0 1 --2- 10.20.193.96:0/2418881508 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9be8110a00 0x7f9be80f8ce0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.893 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.895+0000 7f9bef5a86c0 1 --2- 10.20.193.96:0/2418881508 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9be8110050 0x7f9be8171370 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.893 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.895+0000 7f9bef5a86c0 1 --2- 10.20.193.96:0/2418881508 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9be810eed0 0x7f9be80f84a0 unknown :-1 s=CLOSED pgs=138 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.893 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.895+0000 7f9bef5a86c0 1 -- 10.20.193.96:0/2418881508 >> 10.20.193.96:0/2418881508 conn(0x7f9be80ec5f0 msgr2=0x7f9be80ee5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.893 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.895+0000 7f9bef5a86c0 1 -- 10.20.193.96:0/2418881508 shutdown_connections 2026-02-13T03:32:22.893 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.895+0000 7f9bef5a86c0 1 -- 10.20.193.96:0/2418881508 wait complete. 2026-02-13T03:32:22.904 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.904 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.915 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.917+0000 7fac4cff96c0 1 -- 10.20.193.96:0/3505092893 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7fac2c005b40 con 0x7fac60110a00 2026-02-13T03:32:22.918 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.920+0000 7fac4effd6c0 1 -- 10.20.193.96:0/3505092893 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v33)=0 v33) ==== 121+0+0 (secure 0 0 0) 0x7fac5c012030 con 0x7fac60110a00 2026-02-13T03:32:22.920 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.922+0000 7fac4cff96c0 1 -- 10.20.193.96:0/3505092893 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fac3c03f8f0 msgr2=0x7fac3c05fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.920 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.922+0000 7fac4cff96c0 1 --2- 10.20.193.96:0/3505092893 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fac3c03f8f0 0x7fac3c05fda0 secure :-1 s=READY pgs=73 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac500098c0 tx=0x7fac500023a0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.920 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.922+0000 7fac4cff96c0 1 -- 10.20.193.96:0/3505092893 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fac60110a00 msgr2=0x7fac600634a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:22.920 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.922+0000 7fac4cff96c0 1 --2- 10.20.193.96:0/3505092893 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fac60110a00 0x7fac600634a0 secure :-1 s=READY pgs=140 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac5c00c6c0 tx=0x7fac5c00cb90 comp rx=0 tx=0).stop 2026-02-13T03:32:22.920 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.922+0000 7fac4cff96c0 1 -- 10.20.193.96:0/3505092893 shutdown_connections 2026-02-13T03:32:22.921 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.922+0000 7fac4cff96c0 1 --2- 10.20.193.96:0/3505092893 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fac3c03f8f0 0x7fac3c05fda0 unknown :-1 s=CLOSED pgs=73 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.921 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.922+0000 7fac4cff96c0 1 --2- 10.20.193.96:0/3505092893 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fac60110a00 0x7fac600634a0 unknown :-1 s=CLOSED pgs=140 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.921 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.922+0000 7fac4cff96c0 1 --2- 10.20.193.96:0/3505092893 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fac60110050 0x7fac60171370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.921 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.922+0000 7fac4cff96c0 1 --2- 10.20.193.96:0/3505092893 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fac6010eed0 0x7fac60062c60 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:22.921 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.922+0000 7fac4cff96c0 1 -- 10.20.193.96:0/3505092893 >> 10.20.193.96:0/3505092893 conn(0x7fac600ec5f0 msgr2=0x7fac600ee6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:22.921 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.922+0000 7fac4cff96c0 1 -- 10.20.193.96:0/3505092893 shutdown_connections 2026-02-13T03:32:22.921 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:22.922+0000 7fac4cff96c0 1 -- 10.20.193.96:0/3505092893 wait complete. 2026-02-13T03:32:22.935 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.959 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7c123de8-088c-11f1-84f7-d404e6e7d460', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial096') 2026-02-13T03:32:22.960 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config dump 2026-02-13T03:32:23.117 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:23.140 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.14187 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial096=x;trial132=y;trial133=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:32:23.140 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:23.140 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1874172542' entity='client.admin' 2026-02-13T03:32:23.140 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3587560053' entity='client.admin' 2026-02-13T03:32:23.140 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/676079490' entity='client.admin' 2026-02-13T03:32:23.140 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2792439199' entity='client.admin' 2026-02-13T03:32:23.140 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/4118340054' entity='client.admin' 2026-02-13T03:32:23.140 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/4142347136' entity='client.admin' 2026-02-13T03:32:23.141 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2171758879' entity='client.admin' 2026-02-13T03:32:23.141 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/133051141' entity='client.admin' 2026-02-13T03:32:23.141 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1129437695' entity='client.admin' 2026-02-13T03:32:23.141 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1783222492' entity='client.admin' 2026-02-13T03:32:23.141 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:23.141 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:23.141 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:23.141 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:32:23.141 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T03:32:23.141 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:32:23.141 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:23.141 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/640931609' entity='client.admin' 2026-02-13T03:32:23.142 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:23.142 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1668050570' entity='client.admin' 2026-02-13T03:32:23.142 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/4273568872' entity='client.admin' 2026-02-13T03:32:23.142 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1182099770' entity='client.admin' 2026-02-13T03:32:23.142 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/915957713' entity='client.admin' 2026-02-13T03:32:23.142 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2255798277' entity='client.admin' 2026-02-13T03:32:23.142 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1589063580' entity='client.admin' 2026-02-13T03:32:23.142 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3215187975' entity='client.admin' 2026-02-13T03:32:23.142 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3924985232' entity='client.admin' 2026-02-13T03:32:23.142 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1257702778' entity='client.admin' 2026-02-13T03:32:23.142 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/270126815' entity='client.admin' 2026-02-13T03:32:23.142 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/4150554553' entity='client.admin' 2026-02-13T03:32:23.142 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2457967432' entity='client.admin' 2026-02-13T03:32:23.143 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2418881508' entity='client.admin' 2026-02-13T03:32:23.143 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3505092893' entity='client.admin' 2026-02-13T03:32:23.143 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.14187 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial096=x;trial132=y;trial133=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:32:23.143 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:23.144 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1874172542' entity='client.admin' 2026-02-13T03:32:23.144 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3587560053' entity='client.admin' 2026-02-13T03:32:23.144 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/676079490' entity='client.admin' 2026-02-13T03:32:23.144 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2792439199' entity='client.admin' 2026-02-13T03:32:23.144 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/4118340054' entity='client.admin' 2026-02-13T03:32:23.144 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/4142347136' entity='client.admin' 2026-02-13T03:32:23.144 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2171758879' entity='client.admin' 2026-02-13T03:32:23.144 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/133051141' entity='client.admin' 2026-02-13T03:32:23.144 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1129437695' entity='client.admin' 2026-02-13T03:32:23.144 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1783222492' entity='client.admin' 2026-02-13T03:32:23.144 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:23.144 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:23.145 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:23.145 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:32:23.145 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T03:32:23.145 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:32:23.145 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:23.145 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/640931609' entity='client.admin' 2026-02-13T03:32:23.145 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:23.145 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1668050570' entity='client.admin' 2026-02-13T03:32:23.145 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/4273568872' entity='client.admin' 2026-02-13T03:32:23.145 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1182099770' entity='client.admin' 2026-02-13T03:32:23.145 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/915957713' entity='client.admin' 2026-02-13T03:32:23.145 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2255798277' entity='client.admin' 2026-02-13T03:32:23.145 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1589063580' entity='client.admin' 2026-02-13T03:32:23.146 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3215187975' entity='client.admin' 2026-02-13T03:32:23.146 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3924985232' entity='client.admin' 2026-02-13T03:32:23.146 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1257702778' entity='client.admin' 2026-02-13T03:32:23.146 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/270126815' entity='client.admin' 2026-02-13T03:32:23.146 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/4150554553' entity='client.admin' 2026-02-13T03:32:23.146 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2457967432' entity='client.admin' 2026-02-13T03:32:23.146 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2418881508' entity='client.admin' 2026-02-13T03:32:23.146 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3505092893' entity='client.admin' 2026-02-13T03:32:23.146 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:22.835+0000 7f64a3aebfc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T03:32:23.147 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:22.845+0000 7f64a3aebfc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T03:32:23.147 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:22.851+0000 7f64a3aebfc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T03:32:23.147 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:22.857+0000 7f64a3aebfc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T03:32:23.147 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:22.863+0000 7f64a3aebfc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T03:32:23.147 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:22.875+0000 7f64a3aebfc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T03:32:23.147 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:22.900+0000 7f64a3aebfc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T03:32:23.147 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:22.903+0000 7f64a3aebfc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T03:32:23.147 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:22.905+0000 7f64a3aebfc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T03:32:23.147 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:22.911+0000 7f64a3aebfc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T03:32:23.147 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:22.949+0000 7f64a3aebfc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T03:32:23.147 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:22.951+0000 7f64a3aebfc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T03:32:23.147 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:22.955+0000 7f64a3aebfc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T03:32:23.148 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:22.957+0000 7f64a3aebfc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T03:32:23.148 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:22.958+0000 7f64a3aebfc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T03:32:23.148 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:22.961+0000 7f64a3aebfc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T03:32:23.148 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:22.962+0000 7f64a3aebfc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T03:32:23.148 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:22.964+0000 7f64a3aebfc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T03:32:23.148 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:22.967+0000 7f64a3aebfc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T03:32:23.148 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:23 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:23.140+0000 7f64a3aebfc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T03:32:23.148 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:23 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:23.140+0000 7f64a3aebfc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T03:32:23.227 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 systemd[1]: Starting Ceph mgr.y for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:32:23.227 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.14187 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial096=x;trial132=y;trial133=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:32:23.227 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:23.227 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1874172542' entity='client.admin' 2026-02-13T03:32:23.227 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3587560053' entity='client.admin' 2026-02-13T03:32:23.227 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/676079490' entity='client.admin' 2026-02-13T03:32:23.227 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2792439199' entity='client.admin' 2026-02-13T03:32:23.228 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/4118340054' entity='client.admin' 2026-02-13T03:32:23.228 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/4142347136' entity='client.admin' 2026-02-13T03:32:23.228 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2171758879' entity='client.admin' 2026-02-13T03:32:23.228 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/133051141' entity='client.admin' 2026-02-13T03:32:23.228 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1129437695' entity='client.admin' 2026-02-13T03:32:23.228 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1783222492' entity='client.admin' 2026-02-13T03:32:23.228 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:23.228 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:23.228 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:23.228 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:32:23.228 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T03:32:23.229 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:32:23.229 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:23.229 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/640931609' entity='client.admin' 2026-02-13T03:32:23.229 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:23.229 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1668050570' entity='client.admin' 2026-02-13T03:32:23.229 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/4273568872' entity='client.admin' 2026-02-13T03:32:23.229 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1182099770' entity='client.admin' 2026-02-13T03:32:23.229 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/915957713' entity='client.admin' 2026-02-13T03:32:23.229 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2255798277' entity='client.admin' 2026-02-13T03:32:23.229 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1589063580' entity='client.admin' 2026-02-13T03:32:23.229 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3215187975' entity='client.admin' 2026-02-13T03:32:23.229 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3924985232' entity='client.admin' 2026-02-13T03:32:23.229 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1257702778' entity='client.admin' 2026-02-13T03:32:23.230 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/270126815' entity='client.admin' 2026-02-13T03:32:23.230 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/4150554553' entity='client.admin' 2026-02-13T03:32:23.230 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2457967432' entity='client.admin' 2026-02-13T03:32:23.230 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2418881508' entity='client.admin' 2026-02-13T03:32:23.230 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3505092893' entity='client.admin' 2026-02-13T03:32:23.238 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.237+0000 7f4d3a8776c0 1 -- 10.20.193.96:0/676057253 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4d34110a00 msgr2=0x7f4d34171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:23.239 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.237+0000 7f4d3a8776c0 1 --2- 10.20.193.96:0/676057253 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4d34110a00 0x7f4d34171390 secure :-1 s=READY pgs=141 gs=1 cs=0 l=1 c_cookie=7869236065789070295 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d2800aa40 tx=0x7f4d2802fde0 comp rx=0 tx=0).stop 2026-02-13T03:32:23.239 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.237+0000 7f4d3a8776c0 1 -- 10.20.193.96:0/676057253 shutdown_connections 2026-02-13T03:32:23.239 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.237+0000 7f4d3a8776c0 1 --2- 10.20.193.96:0/676057253 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4d34110a00 0x7f4d34171390 unknown :-1 s=CLOSED pgs=141 gs=1 cs=0 l=1 c_cookie=7869236065789070295 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:23.239 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.237+0000 7f4d3a8776c0 1 --2- 10.20.193.96:0/676057253 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4d34110050 0x7f4d341104c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:23.239 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.237+0000 7f4d3a8776c0 1 --2- 10.20.193.96:0/676057253 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4d3410eed0 0x7f4d3410f2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:23.239 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.237+0000 7f4d3a8776c0 1 -- 10.20.193.96:0/676057253 >> 10.20.193.96:0/676057253 conn(0x7f4d340ec5f0 msgr2=0x7f4d3410ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:23.239 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.237+0000 7f4d3a8776c0 1 -- 10.20.193.96:0/676057253 shutdown_connections 2026-02-13T03:32:23.239 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.237+0000 7f4d3a8776c0 1 -- 10.20.193.96:0/676057253 wait complete. 2026-02-13T03:32:23.239 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.238+0000 7f4d3a8776c0 1 Processor -- start 2026-02-13T03:32:23.239 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.238+0000 7f4d3a8776c0 1 -- start start 2026-02-13T03:32:23.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.238+0000 7f4d3a8776c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4d3410eed0 0x7f4d340f84d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:23.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.238+0000 7f4d3a8776c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4d34110050 0x7f4d34171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:23.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.238+0000 7f4d3a8776c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4d34110a00 0x7f4d340f8d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:23.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.238+0000 7f4d3a8776c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4d340f9960 con 0x7f4d34110050 2026-02-13T03:32:23.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.238+0000 7f4d3a8776c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4d340f9ad0 con 0x7f4d34110a00 2026-02-13T03:32:23.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.238+0000 7f4d3a8776c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4d340f9c90 con 0x7f4d3410eed0 2026-02-13T03:32:23.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.238+0000 7f4d337fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4d34110050 0x7f4d34171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:23.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.238+0000 7f4d337fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4d34110050 0x7f4d34171390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:43922/0 (socket says 10.20.193.96:43922) 2026-02-13T03:32:23.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.238+0000 7f4d337fe6c0 1 -- 10.20.193.96:0/3596833676 learned_addr learned my addr 10.20.193.96:0/3596833676 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:23.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.238+0000 7f4d33fff6c0 1 --2- 10.20.193.96:0/3596833676 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4d3410eed0 0x7f4d340f84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:23.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.238+0000 7f4d337fe6c0 1 -- 10.20.193.96:0/3596833676 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4d3410eed0 msgr2=0x7f4d340f84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:23.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.238+0000 7f4d337fe6c0 1 --2- 10.20.193.96:0/3596833676 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4d3410eed0 0x7f4d340f84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:23.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.238+0000 7f4d337fe6c0 1 -- 10.20.193.96:0/3596833676 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4d34110a00 msgr2=0x7f4d340f8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:23.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.238+0000 7f4d337fe6c0 1 --2- 10.20.193.96:0/3596833676 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4d34110a00 0x7f4d340f8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:23.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.238+0000 7f4d337fe6c0 1 -- 10.20.193.96:0/3596833676 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d2800a660 con 0x7f4d34110050 2026-02-13T03:32:23.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.238+0000 7f4d337fe6c0 1 --2- 10.20.193.96:0/3596833676 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4d34110050 0x7f4d34171390 secure :-1 s=READY pgs=142 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d2400b6c0 tx=0x7f4d2400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:23.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.238+0000 7f4d317fa6c0 1 -- 10.20.193.96:0/3596833676 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d240044a0 con 0x7f4d34110050 2026-02-13T03:32:23.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.238+0000 7f4d317fa6c0 1 -- 10.20.193.96:0/3596833676 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f4d2400be50 con 0x7f4d34110050 2026-02-13T03:32:23.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.238+0000 7f4d3a8776c0 1 -- 10.20.193.96:0/3596833676 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d340f9f70 con 0x7f4d34110050 2026-02-13T03:32:23.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.238+0000 7f4d317fa6c0 1 -- 10.20.193.96:0/3596833676 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d2400cdc0 con 0x7f4d34110050 2026-02-13T03:32:23.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.238+0000 7f4d3a8776c0 1 -- 10.20.193.96:0/3596833676 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d340fa450 con 0x7f4d34110050 2026-02-13T03:32:23.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.239+0000 7f4d3a8776c0 1 -- 10.20.193.96:0/3596833676 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d34175460 con 0x7f4d34110050 2026-02-13T03:32:23.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.239+0000 7f4d317fa6c0 1 -- 10.20.193.96:0/3596833676 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f4d2400e070 con 0x7f4d34110050 2026-02-13T03:32:23.242 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.239+0000 7f4d317fa6c0 1 --2- 10.20.193.96:0/3596833676 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4d0803f8f0 0x7f4d0805fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:23.242 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.239+0000 7f4d317fa6c0 1 -- 10.20.193.96:0/3596833676 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f4d240512b0 con 0x7f4d34110050 2026-02-13T03:32:23.242 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.239+0000 7f4d33fff6c0 1 --2- 10.20.193.96:0/3596833676 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4d0803f8f0 0x7f4d0805fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:23.242 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.239+0000 7f4d33fff6c0 1 --2- 10.20.193.96:0/3596833676 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4d0803f8f0 0x7f4d0805fda0 secure :-1 s=READY pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d20005dc0 tx=0x7f4d20005d10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:23.242 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.241+0000 7f4d317fa6c0 1 -- 10.20.193.96:0/3596833676 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4d24002c70 con 0x7f4d34110050 2026-02-13T03:32:23.331 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.332+0000 7f4d3a8776c0 1 -- 10.20.193.96:0/3596833676 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f4d34174ab0 con 0x7f4d34110050 2026-02-13T03:32:23.332 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.333+0000 7f4d317fa6c0 1 -- 10.20.193.96:0/3596833676 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+19224 (secure 0 0 0) 0x7f4d2400f660 con 0x7f4d34110050 2026-02-13T03:32:23.332 INFO:teuthology.orchestra.run.trial096.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-13T03:32:23.332 INFO:teuthology.orchestra.run.trial096.stdout:global dev auth_debug true 2026-02-13T03:32:23.333 INFO:teuthology.orchestra.run.trial096.stdout:global basic container_image quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 * 2026-02-13T03:32:23.333 INFO:teuthology.orchestra.run.trial096.stdout:global dev debug_asserts_on_shutdown true 2026-02-13T03:32:23.333 INFO:teuthology.orchestra.run.trial096.stdout:global basic log_to_file true 2026-02-13T03:32:23.333 INFO:teuthology.orchestra.run.trial096.stdout:global basic log_to_journald false 2026-02-13T03:32:23.333 INFO:teuthology.orchestra.run.trial096.stdout:global basic log_to_stderr false 2026-02-13T03:32:23.333 INFO:teuthology.orchestra.run.trial096.stdout:global advanced mon_allow_pool_delete true 2026-02-13T03:32:23.333 INFO:teuthology.orchestra.run.trial096.stdout:global advanced mon_clock_drift_allowed 1.000000 2026-02-13T03:32:23.333 INFO:teuthology.orchestra.run.trial096.stdout:global advanced mon_cluster_log_to_file true 2026-02-13T03:32:23.333 INFO:teuthology.orchestra.run.trial096.stdout:global advanced mon_max_pg_per_osd 10000 2026-02-13T03:32:23.333 INFO:teuthology.orchestra.run.trial096.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2026-02-13T03:32:23.333 INFO:teuthology.orchestra.run.trial096.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2026-02-13T03:32:23.334 INFO:teuthology.orchestra.run.trial096.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2026-02-13T03:32:23.334 INFO:teuthology.orchestra.run.trial096.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2026-02-13T03:32:23.334 INFO:teuthology.orchestra.run.trial096.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2026-02-13T03:32:23.334 INFO:teuthology.orchestra.run.trial096.stdout:global advanced mon_warn_on_too_few_osds false 2026-02-13T03:32:23.334 INFO:teuthology.orchestra.run.trial096.stdout:global dev ms_die_on_bug true 2026-02-13T03:32:23.334 INFO:teuthology.orchestra.run.trial096.stdout:global dev ms_die_on_old_message true 2026-02-13T03:32:23.334 INFO:teuthology.orchestra.run.trial096.stdout:global advanced osd_pool_default_erasure_code_profile plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-13T03:32:23.334 INFO:teuthology.orchestra.run.trial096.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2026-02-13T03:32:23.334 INFO:teuthology.orchestra.run.trial096.stdout:global advanced public_network 10.20.192.0/20 * 2026-02-13T03:32:23.334 INFO:teuthology.orchestra.run.trial096.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2026-02-13T03:32:23.334 INFO:teuthology.orchestra.run.trial096.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2026-02-13T03:32:23.334 INFO:teuthology.orchestra.run.trial096.stdout:mon advanced auth_service_ticket_ttl 240.000000 2026-02-13T03:32:23.335 INFO:teuthology.orchestra.run.trial096.stdout:mon advanced debug_mon 20/20 2026-02-13T03:32:23.335 INFO:teuthology.orchestra.run.trial096.stdout:mon advanced debug_ms 1/1 2026-02-13T03:32:23.335 INFO:teuthology.orchestra.run.trial096.stdout:mon advanced debug_paxos 20/20 2026-02-13T03:32:23.335 INFO:teuthology.orchestra.run.trial096.stdout:mon advanced mon_data_avail_warn 5 2026-02-13T03:32:23.335 INFO:teuthology.orchestra.run.trial096.stdout:mon advanced mon_down_mkfs_grace 300 2026-02-13T03:32:23.335 INFO:teuthology.orchestra.run.trial096.stdout:mon advanced mon_mgr_mkfs_grace 240 2026-02-13T03:32:23.335 INFO:teuthology.orchestra.run.trial096.stdout:mon advanced mon_op_complaint_time 120 2026-02-13T03:32:23.335 INFO:teuthology.orchestra.run.trial096.stdout:mon dev mon_osd_prime_pg_temp true 2026-02-13T03:32:23.335 INFO:teuthology.orchestra.run.trial096.stdout:mon advanced mon_osd_reporter_subtree_level osd 2026-02-13T03:32:23.335 INFO:teuthology.orchestra.run.trial096.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2026-02-13T03:32:23.335 INFO:teuthology.orchestra.run.trial096.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2026-02-13T03:32:23.335 INFO:teuthology.orchestra.run.trial096.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2026-02-13T03:32:23.336 INFO:teuthology.orchestra.run.trial096.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2026-02-13T03:32:23.336 INFO:teuthology.orchestra.run.trial096.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2026-02-13T03:32:23.336 INFO:teuthology.orchestra.run.trial096.stdout:mgr advanced client_mount_timeout 30 2026-02-13T03:32:23.336 INFO:teuthology.orchestra.run.trial096.stdout:mgr advanced debug_client 20/20 2026-02-13T03:32:23.336 INFO:teuthology.orchestra.run.trial096.stdout:mgr advanced debug_mgr 20/20 2026-02-13T03:32:23.336 INFO:teuthology.orchestra.run.trial096.stdout:mgr advanced debug_ms 1/1 2026-02-13T03:32:23.336 INFO:teuthology.orchestra.run.trial096.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2026-02-13T03:32:23.336 INFO:teuthology.orchestra.run.trial096.stdout:mgr advanced mgr/cephadm/container_init True * 2026-02-13T03:32:23.336 INFO:teuthology.orchestra.run.trial096.stdout:mgr advanced mgr/cephadm/migration_current 8 * 2026-02-13T03:32:23.336 INFO:teuthology.orchestra.run.trial096.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2026-02-13T03:32:23.336 INFO:teuthology.orchestra.run.trial096.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2026-02-13T03:32:23.336 INFO:teuthology.orchestra.run.trial096.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2026-02-13T03:32:23.337 INFO:teuthology.orchestra.run.trial096.stdout:mgr dev mon_warn_on_pool_no_app false 2026-02-13T03:32:23.337 INFO:teuthology.orchestra.run.trial096.stdout:osd dev bdev_debug_aio true 2026-02-13T03:32:23.337 INFO:teuthology.orchestra.run.trial096.stdout:osd dev bluestore_block_size 96636764160 * 2026-02-13T03:32:23.337 INFO:teuthology.orchestra.run.trial096.stdout:osd advanced bluestore_compression_mode aggressive 2026-02-13T03:32:23.337 INFO:teuthology.orchestra.run.trial096.stdout:osd dev bluestore_fsck_on_mount true 2026-02-13T03:32:23.337 INFO:teuthology.orchestra.run.trial096.stdout:osd advanced debug_bluefs 20/20 2026-02-13T03:32:23.337 INFO:teuthology.orchestra.run.trial096.stdout:osd advanced debug_bluestore 20/20 2026-02-13T03:32:23.337 INFO:teuthology.orchestra.run.trial096.stdout:osd advanced debug_ms 1/1 2026-02-13T03:32:23.337 INFO:teuthology.orchestra.run.trial096.stdout:osd advanced debug_osd 20/20 2026-02-13T03:32:23.337 INFO:teuthology.orchestra.run.trial096.stdout:osd advanced debug_rocksdb 10/10 2026-02-13T03:32:23.337 INFO:teuthology.orchestra.run.trial096.stdout:osd dev osd_debug_misdirected_ops true 2026-02-13T03:32:23.337 INFO:teuthology.orchestra.run.trial096.stdout:osd dev osd_debug_op_order true 2026-02-13T03:32:23.338 INFO:teuthology.orchestra.run.trial096.stdout:osd dev osd_debug_pg_log_writeout true 2026-02-13T03:32:23.338 INFO:teuthology.orchestra.run.trial096.stdout:osd dev osd_debug_shutdown true 2026-02-13T03:32:23.338 INFO:teuthology.orchestra.run.trial096.stdout:osd dev osd_debug_verify_cached_snaps true 2026-02-13T03:32:23.338 INFO:teuthology.orchestra.run.trial096.stdout:osd dev osd_debug_verify_missing_on_start true 2026-02-13T03:32:23.338 INFO:teuthology.orchestra.run.trial096.stdout:osd dev osd_debug_verify_stray_on_activate true 2026-02-13T03:32:23.338 INFO:teuthology.orchestra.run.trial096.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2026-02-13T03:32:23.338 INFO:teuthology.orchestra.run.trial096.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2026-02-13T03:32:23.338 INFO:teuthology.orchestra.run.trial096.stdout:osd advanced osd_max_omap_entries_per_request 10000 2026-02-13T03:32:23.338 INFO:teuthology.orchestra.run.trial096.stdout:osd advanced osd_mclock_profile high_recovery_ops 2026-02-13T03:32:23.338 INFO:teuthology.orchestra.run.trial096.stdout:osd dev osd_mclock_skip_benchmark true 2026-02-13T03:32:23.338 INFO:teuthology.orchestra.run.trial096.stdout:osd advanced osd_memory_target_autotune true 2026-02-13T03:32:23.338 INFO:teuthology.orchestra.run.trial096.stdout:osd advanced osd_objectstore bluestore * 2026-02-13T03:32:23.338 INFO:teuthology.orchestra.run.trial096.stdout:osd advanced osd_op_complaint_time 180.000000 2026-02-13T03:32:23.339 INFO:teuthology.orchestra.run.trial096.stdout:osd advanced osd_op_queue debug_random * 2026-02-13T03:32:23.339 INFO:teuthology.orchestra.run.trial096.stdout:osd advanced osd_op_queue_cut_off debug_random * 2026-02-13T03:32:23.339 INFO:teuthology.orchestra.run.trial096.stdout:osd advanced osd_recover_clone_overlap true 2026-02-13T03:32:23.339 INFO:teuthology.orchestra.run.trial096.stdout:osd advanced osd_recovery_max_chunk 1048576 2026-02-13T03:32:23.339 INFO:teuthology.orchestra.run.trial096.stdout:osd advanced osd_scrub_load_threshold 5.000000 2026-02-13T03:32:23.339 INFO:teuthology.orchestra.run.trial096.stdout:osd advanced osd_scrub_max_interval 600.000000 2026-02-13T03:32:23.339 INFO:teuthology.orchestra.run.trial096.stdout:osd advanced osd_shutdown_pgref_assert true 2026-02-13T03:32:23.339 INFO:teuthology.orchestra.run.trial096.stdout:mds advanced debug_mds 20/20 2026-02-13T03:32:23.339 INFO:teuthology.orchestra.run.trial096.stdout:mds advanced debug_mds_balancer 20/20 2026-02-13T03:32:23.339 INFO:teuthology.orchestra.run.trial096.stdout:mds advanced debug_ms 2/2 2026-02-13T03:32:23.339 INFO:teuthology.orchestra.run.trial096.stdout:mds advanced mds_bal_fragment_size_max 10000 2026-02-13T03:32:23.339 INFO:teuthology.orchestra.run.trial096.stdout:mds advanced mds_bal_merge_size 5 2026-02-13T03:32:23.340 INFO:teuthology.orchestra.run.trial096.stdout:mds advanced mds_bal_replicate_threshold 1.000000 2026-02-13T03:32:23.340 INFO:teuthology.orchestra.run.trial096.stdout:mds advanced mds_bal_split_bits 3 2026-02-13T03:32:23.340 INFO:teuthology.orchestra.run.trial096.stdout:mds advanced mds_bal_split_size 100 2026-02-13T03:32:23.340 INFO:teuthology.orchestra.run.trial096.stdout:mds dev mds_debug_frag true 2026-02-13T03:32:23.340 INFO:teuthology.orchestra.run.trial096.stdout:mds dev mds_debug_scatterstat true 2026-02-13T03:32:23.340 INFO:teuthology.orchestra.run.trial096.stdout:mds advanced mds_export_ephemeral_random_max 0.200000 2026-02-13T03:32:23.340 INFO:teuthology.orchestra.run.trial096.stdout:mds advanced mds_op_complaint_time 180.000000 2026-02-13T03:32:23.340 INFO:teuthology.orchestra.run.trial096.stdout:mds advanced mds_use_global_snaprealm_seq_for_subvol false 2026-02-13T03:32:23.340 INFO:teuthology.orchestra.run.trial096.stdout:mds dev mds_verify_scatter true 2026-02-13T03:32:23.340 INFO:teuthology.orchestra.run.trial096.stdout:mds advanced osd_op_complaint_time 180.000000 2026-02-13T03:32:23.340 INFO:teuthology.orchestra.run.trial096.stdout:mds advanced rados_mon_op_timeout 900 2026-02-13T03:32:23.340 INFO:teuthology.orchestra.run.trial096.stdout:mds advanced rados_osd_op_timeout 900 2026-02-13T03:32:23.341 INFO:teuthology.orchestra.run.trial096.stdout:client advanced client_dirsize_rbytes false * 2026-02-13T03:32:23.341 INFO:teuthology.orchestra.run.trial096.stdout:client dev client_fscrypt_dummy_encryption true 2026-02-13T03:32:23.341 INFO:teuthology.orchestra.run.trial096.stdout:client advanced client_mount_timeout 600 2026-02-13T03:32:23.341 INFO:teuthology.orchestra.run.trial096.stdout:client advanced debug_client 20/20 2026-02-13T03:32:23.341 INFO:teuthology.orchestra.run.trial096.stdout:client advanced debug_ms 1/1 2026-02-13T03:32:23.341 INFO:teuthology.orchestra.run.trial096.stdout:client advanced rados_mon_op_timeout 900 2026-02-13T03:32:23.341 INFO:teuthology.orchestra.run.trial096.stdout:client advanced rados_osd_op_timeout 900 2026-02-13T03:32:23.341 INFO:teuthology.orchestra.run.trial096.stdout:client.rgw advanced rgw_cache_enabled true 2026-02-13T03:32:23.341 INFO:teuthology.orchestra.run.trial096.stdout:client.rgw advanced rgw_enable_ops_log true 2026-02-13T03:32:23.341 INFO:teuthology.orchestra.run.trial096.stdout:client.rgw advanced rgw_enable_usage_log true 2026-02-13T03:32:23.342 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.334+0000 7f4d3a8776c0 1 -- 10.20.193.96:0/3596833676 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4d0803f8f0 msgr2=0x7f4d0805fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:23.342 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.334+0000 7f4d3a8776c0 1 --2- 10.20.193.96:0/3596833676 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4d0803f8f0 0x7f4d0805fda0 secure :-1 s=READY pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d20005dc0 tx=0x7f4d20005d10 comp rx=0 tx=0).stop 2026-02-13T03:32:23.342 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.334+0000 7f4d3a8776c0 1 -- 10.20.193.96:0/3596833676 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4d34110050 msgr2=0x7f4d34171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:23.343 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.334+0000 7f4d3a8776c0 1 --2- 10.20.193.96:0/3596833676 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4d34110050 0x7f4d34171390 secure :-1 s=READY pgs=142 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d2400b6c0 tx=0x7f4d2400bb90 comp rx=0 tx=0).stop 2026-02-13T03:32:23.343 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.334+0000 7f4d3a8776c0 1 -- 10.20.193.96:0/3596833676 shutdown_connections 2026-02-13T03:32:23.343 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.334+0000 7f4d3a8776c0 1 --2- 10.20.193.96:0/3596833676 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4d0803f8f0 0x7f4d0805fda0 unknown :-1 s=CLOSED pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:23.343 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.334+0000 7f4d3a8776c0 1 --2- 10.20.193.96:0/3596833676 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4d34110a00 0x7f4d340f8d30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:23.343 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.334+0000 7f4d3a8776c0 1 --2- 10.20.193.96:0/3596833676 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4d34110050 0x7f4d34171390 unknown :-1 s=CLOSED pgs=142 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:23.343 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.334+0000 7f4d3a8776c0 1 --2- 10.20.193.96:0/3596833676 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4d3410eed0 0x7f4d340f84d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:23.343 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.334+0000 7f4d3a8776c0 1 -- 10.20.193.96:0/3596833676 >> 10.20.193.96:0/3596833676 conn(0x7f4d340ec5f0 msgr2=0x7f4d340ee5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:23.343 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.334+0000 7f4d3a8776c0 1 -- 10.20.193.96:0/3596833676 shutdown_connections 2026-02-13T03:32:23.343 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:23.334+0000 7f4d3a8776c0 1 -- 10.20.193.96:0/3596833676 wait complete. 2026-02-13T03:32:23.371 INFO:tasks.cephadm:Deploying OSDs... 2026-02-13T03:32:23.371 DEBUG:teuthology.orchestra.run.trial096:> set -ex 2026-02-13T03:32:23.372 DEBUG:teuthology.orchestra.run.trial096:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T03:32:23.389 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T03:32:23.389 DEBUG:teuthology.orchestra.run.trial096:> stat /dev/vg_nvme/lv_1 2026-02-13T03:32:23.446 INFO:teuthology.orchestra.run.trial096.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T03:32:23.446 INFO:teuthology.orchestra.run.trial096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:32:23.446 INFO:teuthology.orchestra.run.trial096.stdout:Device: 6h/6d Inode: 1304 Links: 1 2026-02-13T03:32:23.446 INFO:teuthology.orchestra.run.trial096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:32:23.446 INFO:teuthology.orchestra.run.trial096.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:32:23.446 INFO:teuthology.orchestra.run.trial096.stdout:Access: 2026-02-13 03:31:59.518401494 +0000 2026-02-13T03:32:23.446 INFO:teuthology.orchestra.run.trial096.stdout:Modify: 2026-02-13 03:30:32.157223929 +0000 2026-02-13T03:32:23.446 INFO:teuthology.orchestra.run.trial096.stdout:Change: 2026-02-13 03:30:32.157223929 +0000 2026-02-13T03:32:23.446 INFO:teuthology.orchestra.run.trial096.stdout: Birth: 2026-02-13 03:30:32.157223929 +0000 2026-02-13T03:32:23.447 DEBUG:teuthology.orchestra.run.trial096:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T03:32:23.483 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 podman[27938]: 2026-02-13 03:32:23.318662472 +0000 UTC m=+0.016387973 container create c80e7868cb07a69ffca52e37a462998e323809bfc21582a3c4de05858f6e3e80 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, name=rockylinux, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, summary=Rocky Linux Base image, io.buildah.version=1.33.7, ceph=True, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T03:32:23.483 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 podman[27938]: 2026-02-13 03:32:23.346537122 +0000 UTC m=+0.044262623 container init c80e7868cb07a69ffca52e37a462998e323809bfc21582a3c4de05858f6e3e80 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y, name=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, io.buildah.version=1.33.7, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, version=10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T03:32:23.483 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 podman[27938]: 2026-02-13 03:32:23.348773975 +0000 UTC m=+0.046499476 container start c80e7868cb07a69ffca52e37a462998e323809bfc21582a3c4de05858f6e3e80 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y, summary=Rocky Linux Base image, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, OSD_FLAVOR=default) 2026-02-13T03:32:23.483 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 bash[27938]: c80e7868cb07a69ffca52e37a462998e323809bfc21582a3c4de05858f6e3e80 2026-02-13T03:32:23.483 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 podman[27938]: 2026-02-13 03:32:23.311854622 +0000 UTC m=+0.009580133 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T03:32:23.483 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 systemd[1]: Started Ceph mgr.y for 7c123de8-088c-11f1-84f7-d404e6e7d460. 2026-02-13T03:32:23.484 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-mgr[27965]: -- 10.20.193.132:0/4084332535 <== mon.2 v2:10.20.193.132:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ecf7caba00 con 0x55ecf7d7f400 2026-02-13T03:32:23.484 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.373+0000 7fda733f0fc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T03:32:23.484 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.416+0000 7fda733f0fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T03:32:23.510 INFO:teuthology.orchestra.run.trial096.stderr:1+0 records in 2026-02-13T03:32:23.510 INFO:teuthology.orchestra.run.trial096.stderr:1+0 records out 2026-02-13T03:32:23.510 INFO:teuthology.orchestra.run.trial096.stderr:512 bytes copied, 0.000161201 s, 3.2 MB/s 2026-02-13T03:32:23.512 DEBUG:teuthology.orchestra.run.trial096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T03:32:23.513 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:23 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:23.142+0000 7f64a3aebfc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T03:32:23.513 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:23 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:23.144+0000 7f64a3aebfc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T03:32:23.513 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:23 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:23.146+0000 7f64a3aebfc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T03:32:23.513 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:23 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:23.146+0000 7f64a3aebfc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T03:32:23.513 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:23 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:23.146+0000 7f64a3aebfc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T03:32:23.513 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:23 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:23.288+0000 7f64a3aebfc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T03:32:23.513 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:23 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:23.316+0000 7f64a3aebfc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T03:32:23.513 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:23 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:23.320+0000 7f64a3aebfc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T03:32:23.513 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:23 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:23.321+0000 7f64a3aebfc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T03:32:23.514 INFO:journalctl@ceph.mgr.z.trial133.stdout:Feb 13 03:32:23 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-z[28357]: 2026-02-13T03:32:23.322+0000 7f64a3aebfc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T03:32:23.568 DEBUG:teuthology.orchestra.run.trial096:> stat /dev/vg_nvme/lv_2 2026-02-13T03:32:23.625 INFO:teuthology.orchestra.run.trial096.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T03:32:23.625 INFO:teuthology.orchestra.run.trial096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:32:23.625 INFO:teuthology.orchestra.run.trial096.stdout:Device: 6h/6d Inode: 1316 Links: 1 2026-02-13T03:32:23.625 INFO:teuthology.orchestra.run.trial096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:32:23.625 INFO:teuthology.orchestra.run.trial096.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:32:23.625 INFO:teuthology.orchestra.run.trial096.stdout:Access: 2026-02-13 03:31:59.518401494 +0000 2026-02-13T03:32:23.625 INFO:teuthology.orchestra.run.trial096.stdout:Modify: 2026-02-13 03:30:32.158223912 +0000 2026-02-13T03:32:23.625 INFO:teuthology.orchestra.run.trial096.stdout:Change: 2026-02-13 03:30:32.158223912 +0000 2026-02-13T03:32:23.625 INFO:teuthology.orchestra.run.trial096.stdout: Birth: 2026-02-13 03:30:32.158223912 +0000 2026-02-13T03:32:23.626 DEBUG:teuthology.orchestra.run.trial096:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T03:32:23.686 INFO:teuthology.orchestra.run.trial096.stderr:1+0 records in 2026-02-13T03:32:23.686 INFO:teuthology.orchestra.run.trial096.stderr:1+0 records out 2026-02-13T03:32:23.686 INFO:teuthology.orchestra.run.trial096.stderr:512 bytes copied, 0.000135532 s, 3.8 MB/s 2026-02-13T03:32:23.688 DEBUG:teuthology.orchestra.run.trial096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T03:32:23.746 DEBUG:teuthology.orchestra.run.trial096:> stat /dev/vg_nvme/lv_3 2026-02-13T03:32:23.804 INFO:teuthology.orchestra.run.trial096.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T03:32:23.804 INFO:teuthology.orchestra.run.trial096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:32:23.804 INFO:teuthology.orchestra.run.trial096.stdout:Device: 6h/6d Inode: 1290 Links: 1 2026-02-13T03:32:23.804 INFO:teuthology.orchestra.run.trial096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:32:23.805 INFO:teuthology.orchestra.run.trial096.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:32:23.805 INFO:teuthology.orchestra.run.trial096.stdout:Access: 2026-02-13 03:31:59.518401494 +0000 2026-02-13T03:32:23.805 INFO:teuthology.orchestra.run.trial096.stdout:Modify: 2026-02-13 03:30:32.157223929 +0000 2026-02-13T03:32:23.805 INFO:teuthology.orchestra.run.trial096.stdout:Change: 2026-02-13 03:30:32.157223929 +0000 2026-02-13T03:32:23.805 INFO:teuthology.orchestra.run.trial096.stdout: Birth: 2026-02-13 03:30:32.157223929 +0000 2026-02-13T03:32:23.805 DEBUG:teuthology.orchestra.run.trial096:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T03:32:23.867 INFO:teuthology.orchestra.run.trial096.stderr:1+0 records in 2026-02-13T03:32:23.867 INFO:teuthology.orchestra.run.trial096.stderr:1+0 records out 2026-02-13T03:32:23.868 INFO:teuthology.orchestra.run.trial096.stderr:512 bytes copied, 0.000153697 s, 3.3 MB/s 2026-02-13T03:32:23.869 DEBUG:teuthology.orchestra.run.trial096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T03:32:23.926 DEBUG:teuthology.orchestra.run.trial096:> stat /dev/vg_nvme/lv_4 2026-02-13T03:32:23.982 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.675+0000 7fda733f0fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T03:32:23.982 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.684+0000 7fda733f0fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T03:32:23.982 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.690+0000 7fda733f0fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T03:32:23.983 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.697+0000 7fda733f0fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T03:32:23.983 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.703+0000 7fda733f0fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T03:32:23.983 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.715+0000 7fda733f0fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T03:32:23.983 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.740+0000 7fda733f0fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T03:32:23.983 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.743+0000 7fda733f0fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T03:32:23.983 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.745+0000 7fda733f0fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T03:32:23.983 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.751+0000 7fda733f0fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T03:32:23.983 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.790+0000 7fda733f0fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T03:32:23.983 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.792+0000 7fda733f0fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T03:32:23.984 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.796+0000 7fda733f0fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T03:32:23.984 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.798+0000 7fda733f0fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T03:32:23.984 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.799+0000 7fda733f0fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T03:32:23.984 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.802+0000 7fda733f0fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T03:32:23.984 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.803+0000 7fda733f0fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T03:32:23.984 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.806+0000 7fda733f0fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T03:32:23.984 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.808+0000 7fda733f0fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T03:32:23.984 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.989+0000 7fda733f0fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T03:32:23.984 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.989+0000 7fda733f0fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T03:32:23.986 INFO:teuthology.orchestra.run.trial096.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T03:32:23.986 INFO:teuthology.orchestra.run.trial096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:32:23.986 INFO:teuthology.orchestra.run.trial096.stdout:Device: 6h/6d Inode: 1303 Links: 1 2026-02-13T03:32:23.986 INFO:teuthology.orchestra.run.trial096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:32:23.986 INFO:teuthology.orchestra.run.trial096.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:32:23.986 INFO:teuthology.orchestra.run.trial096.stdout:Access: 2026-02-13 03:31:59.518401494 +0000 2026-02-13T03:32:23.986 INFO:teuthology.orchestra.run.trial096.stdout:Modify: 2026-02-13 03:30:32.157223929 +0000 2026-02-13T03:32:23.986 INFO:teuthology.orchestra.run.trial096.stdout:Change: 2026-02-13 03:30:32.157223929 +0000 2026-02-13T03:32:23.986 INFO:teuthology.orchestra.run.trial096.stdout: Birth: 2026-02-13 03:30:32.157223929 +0000 2026-02-13T03:32:23.987 DEBUG:teuthology.orchestra.run.trial096:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T03:32:24.049 INFO:teuthology.orchestra.run.trial096.stderr:1+0 records in 2026-02-13T03:32:24.049 INFO:teuthology.orchestra.run.trial096.stderr:1+0 records out 2026-02-13T03:32:24.049 INFO:teuthology.orchestra.run.trial096.stderr:512 bytes copied, 0.000153947 s, 3.3 MB/s 2026-02-13T03:32:24.051 DEBUG:teuthology.orchestra.run.trial096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T03:32:24.107 DEBUG:teuthology.orchestra.run.trial132:> set -ex 2026-02-13T03:32:24.108 DEBUG:teuthology.orchestra.run.trial132:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T03:32:24.124 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T03:32:24.124 DEBUG:teuthology.orchestra.run.trial132:> stat /dev/vg_nvme/lv_1 2026-02-13T03:32:24.169 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:24 trial096 ceph-mon[24671]: Standby manager daemon z started 2026-02-13T03:32:24.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:24 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3596833676' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T03:32:24.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:24.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:24 trial096 ceph-mon[24671]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:24.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.171 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:24.171 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:24.171 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.171 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:32:24.171 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:32:24.171 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:24.181 INFO:teuthology.orchestra.run.trial132.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T03:32:24.181 INFO:teuthology.orchestra.run.trial132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:32:24.181 INFO:teuthology.orchestra.run.trial132.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-13T03:32:24.181 INFO:teuthology.orchestra.run.trial132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:32:24.181 INFO:teuthology.orchestra.run.trial132.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:32:24.182 INFO:teuthology.orchestra.run.trial132.stdout:Access: 2026-02-13 03:32:23.187309799 +0000 2026-02-13T03:32:24.182 INFO:teuthology.orchestra.run.trial132.stdout:Modify: 2026-02-13 03:30:32.414911835 +0000 2026-02-13T03:32:24.182 INFO:teuthology.orchestra.run.trial132.stdout:Change: 2026-02-13 03:30:32.414911835 +0000 2026-02-13T03:32:24.182 INFO:teuthology.orchestra.run.trial132.stdout: Birth: 2026-02-13 03:30:32.414911835 +0000 2026-02-13T03:32:24.182 DEBUG:teuthology.orchestra.run.trial132:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T03:32:24.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:24 trial132 ceph-mon[26888]: Standby manager daemon z started 2026-02-13T03:32:24.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:24 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3596833676' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T03:32:24.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:24.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:24 trial132 ceph-mon[26888]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:24.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:24.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:24.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:32:24.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:32:24.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:24.234 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.992+0000 7fda733f0fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T03:32:24.235 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.994+0000 7fda733f0fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T03:32:24.235 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.996+0000 7fda733f0fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T03:32:24.235 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.996+0000 7fda733f0fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T03:32:24.235 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:23.996+0000 7fda733f0fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T03:32:24.235 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:24 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:24.139+0000 7fda733f0fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T03:32:24.235 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:24 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:24.168+0000 7fda733f0fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T03:32:24.235 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:24 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:24.172+0000 7fda733f0fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T03:32:24.235 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:24 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:24.173+0000 7fda733f0fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T03:32:24.235 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:32:24 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-y[27961]: 2026-02-13T03:32:24.173+0000 7fda733f0fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T03:32:24.246 INFO:teuthology.orchestra.run.trial132.stderr:1+0 records in 2026-02-13T03:32:24.246 INFO:teuthology.orchestra.run.trial132.stderr:1+0 records out 2026-02-13T03:32:24.247 INFO:teuthology.orchestra.run.trial132.stderr:512 bytes copied, 0.000160619 s, 3.2 MB/s 2026-02-13T03:32:24.248 DEBUG:teuthology.orchestra.run.trial132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T03:32:24.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:24 trial133 ceph-mon[26943]: Standby manager daemon z started 2026-02-13T03:32:24.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:24 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3596833676' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T03:32:24.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:24.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:24 trial133 ceph-mon[26943]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:24.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:24.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:24.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:24.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:32:24.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:32:24.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:24.307 DEBUG:teuthology.orchestra.run.trial132:> stat /dev/vg_nvme/lv_2 2026-02-13T03:32:24.364 INFO:teuthology.orchestra.run.trial132.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T03:32:24.364 INFO:teuthology.orchestra.run.trial132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:32:24.365 INFO:teuthology.orchestra.run.trial132.stdout:Device: 6h/6d Inode: 1314 Links: 1 2026-02-13T03:32:24.365 INFO:teuthology.orchestra.run.trial132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:32:24.365 INFO:teuthology.orchestra.run.trial132.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:32:24.365 INFO:teuthology.orchestra.run.trial132.stdout:Access: 2026-02-13 03:32:23.188309792 +0000 2026-02-13T03:32:24.365 INFO:teuthology.orchestra.run.trial132.stdout:Modify: 2026-02-13 03:30:32.414911835 +0000 2026-02-13T03:32:24.365 INFO:teuthology.orchestra.run.trial132.stdout:Change: 2026-02-13 03:30:32.414911835 +0000 2026-02-13T03:32:24.365 INFO:teuthology.orchestra.run.trial132.stdout: Birth: 2026-02-13 03:30:32.414911835 +0000 2026-02-13T03:32:24.365 DEBUG:teuthology.orchestra.run.trial132:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T03:32:24.427 INFO:teuthology.orchestra.run.trial132.stderr:1+0 records in 2026-02-13T03:32:24.427 INFO:teuthology.orchestra.run.trial132.stderr:1+0 records out 2026-02-13T03:32:24.427 INFO:teuthology.orchestra.run.trial132.stderr:512 bytes copied, 0.000157063 s, 3.3 MB/s 2026-02-13T03:32:24.428 DEBUG:teuthology.orchestra.run.trial132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T03:32:24.485 DEBUG:teuthology.orchestra.run.trial132:> stat /dev/vg_nvme/lv_3 2026-02-13T03:32:24.541 INFO:teuthology.orchestra.run.trial132.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T03:32:24.541 INFO:teuthology.orchestra.run.trial132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:32:24.542 INFO:teuthology.orchestra.run.trial132.stdout:Device: 6h/6d Inode: 1297 Links: 1 2026-02-13T03:32:24.542 INFO:teuthology.orchestra.run.trial132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:32:24.542 INFO:teuthology.orchestra.run.trial132.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:32:24.542 INFO:teuthology.orchestra.run.trial132.stdout:Access: 2026-02-13 03:32:23.188309792 +0000 2026-02-13T03:32:24.542 INFO:teuthology.orchestra.run.trial132.stdout:Modify: 2026-02-13 03:30:32.414911835 +0000 2026-02-13T03:32:24.542 INFO:teuthology.orchestra.run.trial132.stdout:Change: 2026-02-13 03:30:32.414911835 +0000 2026-02-13T03:32:24.542 INFO:teuthology.orchestra.run.trial132.stdout: Birth: 2026-02-13 03:30:32.414911835 +0000 2026-02-13T03:32:24.542 DEBUG:teuthology.orchestra.run.trial132:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T03:32:24.605 INFO:teuthology.orchestra.run.trial132.stderr:1+0 records in 2026-02-13T03:32:24.605 INFO:teuthology.orchestra.run.trial132.stderr:1+0 records out 2026-02-13T03:32:24.605 INFO:teuthology.orchestra.run.trial132.stderr:512 bytes copied, 0.000162894 s, 3.1 MB/s 2026-02-13T03:32:24.606 DEBUG:teuthology.orchestra.run.trial132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T03:32:24.663 DEBUG:teuthology.orchestra.run.trial132:> stat /dev/vg_nvme/lv_4 2026-02-13T03:32:24.720 INFO:teuthology.orchestra.run.trial132.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T03:32:24.720 INFO:teuthology.orchestra.run.trial132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:32:24.720 INFO:teuthology.orchestra.run.trial132.stdout:Device: 6h/6d Inode: 1299 Links: 1 2026-02-13T03:32:24.720 INFO:teuthology.orchestra.run.trial132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:32:24.720 INFO:teuthology.orchestra.run.trial132.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:32:24.720 INFO:teuthology.orchestra.run.trial132.stdout:Access: 2026-02-13 03:32:23.188309792 +0000 2026-02-13T03:32:24.720 INFO:teuthology.orchestra.run.trial132.stdout:Modify: 2026-02-13 03:30:32.414911835 +0000 2026-02-13T03:32:24.721 INFO:teuthology.orchestra.run.trial132.stdout:Change: 2026-02-13 03:30:32.414911835 +0000 2026-02-13T03:32:24.721 INFO:teuthology.orchestra.run.trial132.stdout: Birth: 2026-02-13 03:30:32.414911835 +0000 2026-02-13T03:32:24.721 DEBUG:teuthology.orchestra.run.trial132:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T03:32:24.783 INFO:teuthology.orchestra.run.trial132.stderr:1+0 records in 2026-02-13T03:32:24.783 INFO:teuthology.orchestra.run.trial132.stderr:1+0 records out 2026-02-13T03:32:24.783 INFO:teuthology.orchestra.run.trial132.stderr:512 bytes copied, 0.000149288 s, 3.4 MB/s 2026-02-13T03:32:24.784 DEBUG:teuthology.orchestra.run.trial132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T03:32:24.841 DEBUG:teuthology.orchestra.run.trial133:> set -ex 2026-02-13T03:32:24.841 DEBUG:teuthology.orchestra.run.trial133:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T03:32:24.860 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T03:32:24.860 DEBUG:teuthology.orchestra.run.trial133:> stat /dev/vg_nvme/lv_1 2026-02-13T03:32:24.917 INFO:teuthology.orchestra.run.trial133.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T03:32:24.918 INFO:teuthology.orchestra.run.trial133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:32:24.918 INFO:teuthology.orchestra.run.trial133.stdout:Device: 6h/6d Inode: 1294 Links: 1 2026-02-13T03:32:24.918 INFO:teuthology.orchestra.run.trial133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:32:24.918 INFO:teuthology.orchestra.run.trial133.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:32:24.918 INFO:teuthology.orchestra.run.trial133.stdout:Access: 2026-02-13 03:32:22.353637989 +0000 2026-02-13T03:32:24.918 INFO:teuthology.orchestra.run.trial133.stdout:Modify: 2026-02-13 03:30:33.875060379 +0000 2026-02-13T03:32:24.918 INFO:teuthology.orchestra.run.trial133.stdout:Change: 2026-02-13 03:30:33.875060379 +0000 2026-02-13T03:32:24.918 INFO:teuthology.orchestra.run.trial133.stdout: Birth: 2026-02-13 03:30:33.875060379 +0000 2026-02-13T03:32:24.919 DEBUG:teuthology.orchestra.run.trial133:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T03:32:24.984 INFO:teuthology.orchestra.run.trial133.stderr:1+0 records in 2026-02-13T03:32:24.984 INFO:teuthology.orchestra.run.trial133.stderr:1+0 records out 2026-02-13T03:32:24.985 INFO:teuthology.orchestra.run.trial133.stderr:512 bytes copied, 0.000170838 s, 3.0 MB/s 2026-02-13T03:32:24.986 DEBUG:teuthology.orchestra.run.trial133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T03:32:25.043 DEBUG:teuthology.orchestra.run.trial133:> stat /dev/vg_nvme/lv_2 2026-02-13T03:32:25.099 INFO:teuthology.orchestra.run.trial133.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T03:32:25.099 INFO:teuthology.orchestra.run.trial133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:32:25.099 INFO:teuthology.orchestra.run.trial133.stdout:Device: 6h/6d Inode: 1316 Links: 1 2026-02-13T03:32:25.099 INFO:teuthology.orchestra.run.trial133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:32:25.099 INFO:teuthology.orchestra.run.trial133.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:32:25.099 INFO:teuthology.orchestra.run.trial133.stdout:Access: 2026-02-13 03:32:22.354637971 +0000 2026-02-13T03:32:25.100 INFO:teuthology.orchestra.run.trial133.stdout:Modify: 2026-02-13 03:30:33.876060362 +0000 2026-02-13T03:32:25.100 INFO:teuthology.orchestra.run.trial133.stdout:Change: 2026-02-13 03:30:33.876060362 +0000 2026-02-13T03:32:25.100 INFO:teuthology.orchestra.run.trial133.stdout: Birth: 2026-02-13 03:30:33.876060362 +0000 2026-02-13T03:32:25.100 DEBUG:teuthology.orchestra.run.trial133:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T03:32:25.162 INFO:teuthology.orchestra.run.trial133.stderr:1+0 records in 2026-02-13T03:32:25.162 INFO:teuthology.orchestra.run.trial133.stderr:1+0 records out 2026-02-13T03:32:25.163 INFO:teuthology.orchestra.run.trial133.stderr:512 bytes copied, 0.000155389 s, 3.3 MB/s 2026-02-13T03:32:25.164 DEBUG:teuthology.orchestra.run.trial133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T03:32:25.221 DEBUG:teuthology.orchestra.run.trial133:> stat /dev/vg_nvme/lv_3 2026-02-13T03:32:25.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:25 trial133 ceph-mon[26943]: mgrmap e9: x(active, since 32s), standbys: z 2026-02-13T03:32:25.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:25 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-13T03:32:25.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:25 trial133 ceph-mon[26943]: Standby manager daemon y started 2026-02-13T03:32:25.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:25 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:25.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:25 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:25.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:25 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:25.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:25 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:25.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:25 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:25.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:25 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:25.278 INFO:teuthology.orchestra.run.trial133.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T03:32:25.278 INFO:teuthology.orchestra.run.trial133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:32:25.278 INFO:teuthology.orchestra.run.trial133.stdout:Device: 6h/6d Inode: 1303 Links: 1 2026-02-13T03:32:25.278 INFO:teuthology.orchestra.run.trial133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:32:25.278 INFO:teuthology.orchestra.run.trial133.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:32:25.278 INFO:teuthology.orchestra.run.trial133.stdout:Access: 2026-02-13 03:32:22.354637971 +0000 2026-02-13T03:32:25.278 INFO:teuthology.orchestra.run.trial133.stdout:Modify: 2026-02-13 03:30:33.875060379 +0000 2026-02-13T03:32:25.278 INFO:teuthology.orchestra.run.trial133.stdout:Change: 2026-02-13 03:30:33.875060379 +0000 2026-02-13T03:32:25.279 INFO:teuthology.orchestra.run.trial133.stdout: Birth: 2026-02-13 03:30:33.875060379 +0000 2026-02-13T03:32:25.279 DEBUG:teuthology.orchestra.run.trial133:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T03:32:25.341 INFO:teuthology.orchestra.run.trial133.stderr:1+0 records in 2026-02-13T03:32:25.341 INFO:teuthology.orchestra.run.trial133.stderr:1+0 records out 2026-02-13T03:32:25.341 INFO:teuthology.orchestra.run.trial133.stderr:512 bytes copied, 0.000167181 s, 3.1 MB/s 2026-02-13T03:32:25.342 DEBUG:teuthology.orchestra.run.trial133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T03:32:25.400 DEBUG:teuthology.orchestra.run.trial133:> stat /dev/vg_nvme/lv_4 2026-02-13T03:32:25.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:25 trial096 ceph-mon[24671]: mgrmap e9: x(active, since 32s), standbys: z 2026-02-13T03:32:25.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:25 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-13T03:32:25.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:25 trial096 ceph-mon[24671]: Standby manager daemon y started 2026-02-13T03:32:25.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:25 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:25.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:25 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:25.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:25 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:25.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:25 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:25.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:25 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:25.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:25 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:25.456 INFO:teuthology.orchestra.run.trial133.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T03:32:25.456 INFO:teuthology.orchestra.run.trial133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:32:25.456 INFO:teuthology.orchestra.run.trial133.stdout:Device: 6h/6d Inode: 1296 Links: 1 2026-02-13T03:32:25.456 INFO:teuthology.orchestra.run.trial133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:32:25.457 INFO:teuthology.orchestra.run.trial133.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:32:25.457 INFO:teuthology.orchestra.run.trial133.stdout:Access: 2026-02-13 03:32:22.354637971 +0000 2026-02-13T03:32:25.457 INFO:teuthology.orchestra.run.trial133.stdout:Modify: 2026-02-13 03:30:33.875060379 +0000 2026-02-13T03:32:25.457 INFO:teuthology.orchestra.run.trial133.stdout:Change: 2026-02-13 03:30:33.875060379 +0000 2026-02-13T03:32:25.457 INFO:teuthology.orchestra.run.trial133.stdout: Birth: 2026-02-13 03:30:33.875060379 +0000 2026-02-13T03:32:25.457 DEBUG:teuthology.orchestra.run.trial133:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T03:32:25.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:25 trial132 ceph-mon[26888]: mgrmap e9: x(active, since 32s), standbys: z 2026-02-13T03:32:25.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:25 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-13T03:32:25.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:25 trial132 ceph-mon[26888]: Standby manager daemon y started 2026-02-13T03:32:25.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:25 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:25.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:25 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:25.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:25 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:25.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:25 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:25.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:25 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:25.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:25 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:25.520 INFO:teuthology.orchestra.run.trial133.stderr:1+0 records in 2026-02-13T03:32:25.520 INFO:teuthology.orchestra.run.trial133.stderr:1+0 records out 2026-02-13T03:32:25.520 INFO:teuthology.orchestra.run.trial133.stderr:512 bytes copied, 0.000151842 s, 3.4 MB/s 2026-02-13T03:32:25.521 DEBUG:teuthology.orchestra.run.trial133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T03:32:25.579 INFO:tasks.cephadm:Deploying osd.0 on trial096 with /dev/vg_nvme/lv_4... 2026-02-13T03:32:25.579 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T03:32:25.698 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:26.114 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:32:26.132 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph orch daemon add osd trial096:vg_nvme/lv_4 --skip-validation 2026-02-13T03:32:26.169 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:26 trial096 ceph-mon[24671]: mgrmap e10: x(active, since 33s), standbys: z, y 2026-02-13T03:32:26.169 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:26 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-13T03:32:26.170 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:26 trial096 ceph-mon[24671]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:26.250 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:26.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.371+0000 7f1aa01686c0 1 -- 10.20.193.96:0/484124864 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1a98110a00 msgr2=0x7f1a98171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:26.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.371+0000 7f1aa01686c0 1 --2- 10.20.193.96:0/484124864 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1a98110a00 0x7f1a98171390 secure :-1 s=READY pgs=143 gs=1 cs=0 l=1 c_cookie=1669626282698095231 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a9400aa40 tx=0x7f1a9402fde0 comp rx=0 tx=0).stop 2026-02-13T03:32:26.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.371+0000 7f1aa01686c0 1 -- 10.20.193.96:0/484124864 shutdown_connections 2026-02-13T03:32:26.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.371+0000 7f1aa01686c0 1 --2- 10.20.193.96:0/484124864 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1a98110a00 0x7f1a98171390 unknown :-1 s=CLOSED pgs=143 gs=1 cs=0 l=1 c_cookie=1669626282698095231 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:26.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.371+0000 7f1aa01686c0 1 --2- 10.20.193.96:0/484124864 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1a98110050 0x7f1a981104c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:26.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.371+0000 7f1aa01686c0 1 --2- 10.20.193.96:0/484124864 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1a9810eed0 0x7f1a9810f2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:26.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.371+0000 7f1aa01686c0 1 -- 10.20.193.96:0/484124864 >> 10.20.193.96:0/484124864 conn(0x7f1a980ec5f0 msgr2=0x7f1a9810ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:26.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.371+0000 7f1aa01686c0 1 -- 10.20.193.96:0/484124864 shutdown_connections 2026-02-13T03:32:26.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.371+0000 7f1aa01686c0 1 -- 10.20.193.96:0/484124864 wait complete. 2026-02-13T03:32:26.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.372+0000 7f1aa01686c0 1 Processor -- start 2026-02-13T03:32:26.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.372+0000 7f1aa01686c0 1 -- start start 2026-02-13T03:32:26.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.372+0000 7f1aa01686c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1a9810eed0 0x7f1a980f8ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:26.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.372+0000 7f1aa01686c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1a98110050 0x7f1a98171370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:26.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.372+0000 7f1aa01686c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1a98110a00 0x7f1a980f9720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:26.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.372+0000 7f1aa01686c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1a980fa370 con 0x7f1a98110050 2026-02-13T03:32:26.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.372+0000 7f1aa01686c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1a980fa4e0 con 0x7f1a9810eed0 2026-02-13T03:32:26.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.372+0000 7f1aa01686c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1a980fa6a0 con 0x7f1a98110a00 2026-02-13T03:32:26.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.372+0000 7f1a9d6d86c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1a98110050 0x7f1a98171370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:26.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.372+0000 7f1a9d6d86c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1a98110050 0x7f1a98171370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:43940/0 (socket says 10.20.193.96:43940) 2026-02-13T03:32:26.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.372+0000 7f1a9d6d86c0 1 -- 10.20.193.96:0/717551602 learned_addr learned my addr 10.20.193.96:0/717551602 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:26.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.372+0000 7f1a9e6da6c0 1 --2- 10.20.193.96:0/717551602 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1a98110a00 0x7f1a980f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:26.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.372+0000 7f1a9ded96c0 1 --2- 10.20.193.96:0/717551602 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1a9810eed0 0x7f1a980f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:26.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.372+0000 7f1a9d6d86c0 1 -- 10.20.193.96:0/717551602 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1a98110a00 msgr2=0x7f1a980f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:26.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.372+0000 7f1a9d6d86c0 1 --2- 10.20.193.96:0/717551602 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1a98110a00 0x7f1a980f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:26.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.372+0000 7f1a9d6d86c0 1 -- 10.20.193.96:0/717551602 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1a9810eed0 msgr2=0x7f1a980f8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:26.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.372+0000 7f1a9d6d86c0 1 --2- 10.20.193.96:0/717551602 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1a9810eed0 0x7f1a980f8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:26.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.372+0000 7f1a9d6d86c0 1 -- 10.20.193.96:0/717551602 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9400a660 con 0x7f1a98110050 2026-02-13T03:32:26.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.372+0000 7f1a9d6d86c0 1 --2- 10.20.193.96:0/717551602 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1a98110050 0x7f1a98171370 secure :-1 s=READY pgs=144 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a8c00b710 tx=0x7f1a8c00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:26.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.372+0000 7f1a86ffd6c0 1 -- 10.20.193.96:0/717551602 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1a8c004250 con 0x7f1a98110050 2026-02-13T03:32:26.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.372+0000 7f1a86ffd6c0 1 -- 10.20.193.96:0/717551602 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f1a8c002da0 con 0x7f1a98110050 2026-02-13T03:32:26.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.372+0000 7f1aa01686c0 1 -- 10.20.193.96:0/717551602 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a980fa920 con 0x7f1a98110050 2026-02-13T03:32:26.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.372+0000 7f1a86ffd6c0 1 -- 10.20.193.96:0/717551602 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1a8c00ce30 con 0x7f1a98110050 2026-02-13T03:32:26.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.372+0000 7f1aa01686c0 1 -- 10.20.193.96:0/717551602 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a980fae50 con 0x7f1a98110050 2026-02-13T03:32:26.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.373+0000 7f1aa01686c0 1 -- 10.20.193.96:0/717551602 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a98175400 con 0x7f1a98110050 2026-02-13T03:32:26.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.374+0000 7f1a86ffd6c0 1 -- 10.20.193.96:0/717551602 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 10) ==== 157010+0+0 (secure 0 0 0) 0x7f1a8c0028c0 con 0x7f1a98110050 2026-02-13T03:32:26.376 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.375+0000 7f1a86ffd6c0 1 --2- 10.20.193.96:0/717551602 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f1a740b55f0 0x7f1a740d5aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:26.377 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.375+0000 7f1a9ded96c0 1 --2- 10.20.193.96:0/717551602 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f1a740b55f0 0x7f1a740d5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:26.377 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.375+0000 7f1a86ffd6c0 1 -- 10.20.193.96:0/717551602 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f1a8c0e1ec0 con 0x7f1a98110050 2026-02-13T03:32:26.377 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.375+0000 7f1a9ded96c0 1 --2- 10.20.193.96:0/717551602 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f1a740b55f0 0x7f1a740d5aa0 secure :-1 s=READY pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a88005980 tx=0x7f1a88005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:26.377 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.375+0000 7f1a86ffd6c0 1 -- 10.20.193.96:0/717551602 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1a8c0a65d0 con 0x7f1a98110050 2026-02-13T03:32:26.472 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:26.473+0000 7f1aa01686c0 1 -- 10.20.193.96:0/717551602 --> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial096:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f1a980efb60 con 0x7f1a740b55f0 2026-02-13T03:32:26.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:26 trial132 ceph-mon[26888]: mgrmap e10: x(active, since 33s), standbys: z, y 2026-02-13T03:32:26.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:26 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-13T03:32:26.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:26 trial132 ceph-mon[26888]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:26.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:26 trial133 ceph-mon[26943]: mgrmap e10: x(active, since 33s), standbys: z, y 2026-02-13T03:32:26.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:26 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-13T03:32:26.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:26 trial133 ceph-mon[26943]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:27.666 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:27 trial096 ceph-mon[24671]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial096:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:32:27.666 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:27 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:27.666 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:27 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:27.666 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:27 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:27.666 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:27 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:27.666 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:27 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:27.666 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:27 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:27.666 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:27 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:27.667 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:27 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:27.667 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:27 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:27.667 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:27 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:27.667 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:27 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:27.667 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:27 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:27.667 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:27 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:27.667 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:27 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:27.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:27 trial132 ceph-mon[26888]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial096:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:32:27.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:27 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:27.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:27 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:27.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:27 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:27.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:27 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:27.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:27 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:27.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:27 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:27.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:27 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:27.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:27 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:27.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:27 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:27.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:27 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:27.734 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:27 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:27.734 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:27 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:27.734 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:27 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:27.734 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:27 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:27.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:27 trial133 ceph-mon[26943]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial096:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:32:27.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:27 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:27.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:27 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:27.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:27 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:27.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:27 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:27.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:27 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:27.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:27 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:27.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:27 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:27.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:27 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:27.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:27 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:27.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:27 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:27.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:27 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:27.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:27 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:27.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:27 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:27.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:27 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:28.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:28 trial132 ceph-mon[26888]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:28.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:28 trial132 ceph-mon[26888]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:32:28.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:28 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2362899324' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4b4f15df-2bc8-4596-a5de-6b2c54cdf01c"} : dispatch 2026-02-13T03:32:28.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:28 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2362899324' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b4f15df-2bc8-4596-a5de-6b2c54cdf01c"}]': finished 2026-02-13T03:32:28.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:28 trial132 ceph-mon[26888]: osdmap e4: 1 total, 0 up, 1 in 2026-02-13T03:32:28.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:28 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:32:28.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:28 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:28.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:28 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1695803163' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:32:28.762 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:28 trial133 ceph-mon[26943]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:28.762 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:28 trial133 ceph-mon[26943]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:32:28.762 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:28 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2362899324' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4b4f15df-2bc8-4596-a5de-6b2c54cdf01c"} : dispatch 2026-02-13T03:32:28.762 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:28 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2362899324' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b4f15df-2bc8-4596-a5de-6b2c54cdf01c"}]': finished 2026-02-13T03:32:28.762 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:28 trial133 ceph-mon[26943]: osdmap e4: 1 total, 0 up, 1 in 2026-02-13T03:32:28.762 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:28 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:32:28.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:28 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:28.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:28 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1695803163' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:32:28.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:28 trial096 ceph-mon[24671]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:28.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:28 trial096 ceph-mon[24671]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:32:28.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:28 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2362899324' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4b4f15df-2bc8-4596-a5de-6b2c54cdf01c"} : dispatch 2026-02-13T03:32:28.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:28 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2362899324' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b4f15df-2bc8-4596-a5de-6b2c54cdf01c"}]': finished 2026-02-13T03:32:28.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:28 trial096 ceph-mon[24671]: osdmap e4: 1 total, 0 up, 1 in 2026-02-13T03:32:28.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:28 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:32:28.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:28 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:28.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:28 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1695803163' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:32:30.669 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:30 trial096 ceph-mon[24671]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:30.669 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:30 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T03:32:30.669 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:30 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:30.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:30 trial132 ceph-mon[26888]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:30.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:30 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T03:32:30.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:30 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:30.762 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:30 trial133 ceph-mon[26943]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:30.762 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:30 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T03:32:30.762 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:30 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:32.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:32 trial132 ceph-mon[26888]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:32.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:32 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:32.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:32 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:32.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:32 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:32.762 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:32 trial133 ceph-mon[26943]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:32.762 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:32 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:32.762 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:32 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:32.762 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:32 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:32.892 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:32 trial096 ceph-mon[24671]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:32.892 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:32 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:32.892 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:32 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:32.892 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:32 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:33.083 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:33.085+0000 7f1a86ffd6c0 1 -- 10.20.193.96:0/717551602 <== mgr.14116 v2:10.20.193.96:6800/1736050816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f1a980efb60 con 0x7f1a740b55f0 2026-02-13T03:32:33.083 INFO:teuthology.orchestra.run.trial096.stdout:Created osd(s) 0 on host 'trial096' 2026-02-13T03:32:33.086 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:33.087+0000 7f1aa01686c0 1 -- 10.20.193.96:0/717551602 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f1a740b55f0 msgr2=0x7f1a740d5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:33.086 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:33.087+0000 7f1aa01686c0 1 --2- 10.20.193.96:0/717551602 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f1a740b55f0 0x7f1a740d5aa0 secure :-1 s=READY pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a88005980 tx=0x7f1a88005910 comp rx=0 tx=0).stop 2026-02-13T03:32:33.086 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:33.088+0000 7f1aa01686c0 1 -- 10.20.193.96:0/717551602 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1a98110050 msgr2=0x7f1a98171370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:33.086 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:33.088+0000 7f1aa01686c0 1 --2- 10.20.193.96:0/717551602 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1a98110050 0x7f1a98171370 secure :-1 s=READY pgs=144 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a8c00b710 tx=0x7f1a8c00bbe0 comp rx=0 tx=0).stop 2026-02-13T03:32:33.086 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:33.088+0000 7f1aa01686c0 1 -- 10.20.193.96:0/717551602 shutdown_connections 2026-02-13T03:32:33.086 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:33.088+0000 7f1aa01686c0 1 --2- 10.20.193.96:0/717551602 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f1a740b55f0 0x7f1a740d5aa0 unknown :-1 s=CLOSED pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:33.086 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:33.088+0000 7f1aa01686c0 1 --2- 10.20.193.96:0/717551602 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1a98110a00 0x7f1a980f9720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:33.086 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:33.088+0000 7f1aa01686c0 1 --2- 10.20.193.96:0/717551602 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1a98110050 0x7f1a98171370 unknown :-1 s=CLOSED pgs=144 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:33.086 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:33.088+0000 7f1aa01686c0 1 --2- 10.20.193.96:0/717551602 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1a9810eed0 0x7f1a980f8ee0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:33.086 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:33.088+0000 7f1aa01686c0 1 -- 10.20.193.96:0/717551602 >> 10.20.193.96:0/717551602 conn(0x7f1a980ec5f0 msgr2=0x7f1a980ef450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:33.086 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:33.088+0000 7f1aa01686c0 1 -- 10.20.193.96:0/717551602 shutdown_connections 2026-02-13T03:32:33.086 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:33.088+0000 7f1aa01686c0 1 -- 10.20.193.96:0/717551602 wait complete. 2026-02-13T03:32:33.131 DEBUG:teuthology.orchestra.run.trial096:osd.0> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.0.service 2026-02-13T03:32:33.173 INFO:tasks.cephadm:Deploying osd.1 on trial132 with /dev/vg_nvme/lv_4... 2026-02-13T03:32:33.173 DEBUG:teuthology.orchestra.run.trial132:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T03:32:33.288 INFO:teuthology.orchestra.run.trial132.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.b/config 2026-02-13T03:32:33.703 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:33.703 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:33.703 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:33.703 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:33.703 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:33.703 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:33 trial132 ceph-mon[26888]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:33.703 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:33.704 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:33.704 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:33.704 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:33 trial132 ceph-mon[26888]: from='osd.0 [v2:10.20.193.96:6802/1861813169,v1:10.20.193.96:6803/1861813169]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T03:32:33.704 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:33.704 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:33.704 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:33.727 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:32:33.744 DEBUG:teuthology.orchestra.run.trial132:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph orch daemon add osd trial132:vg_nvme/lv_4 --skip-validation 2026-02-13T03:32:33.839 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:33.839 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:33.839 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:33.839 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:33.839 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:33.839 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:33 trial096 ceph-mon[24671]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:33.839 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:33.839 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:33.839 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:33.839 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:33 trial096 ceph-mon[24671]: from='osd.0 [v2:10.20.193.96:6802/1861813169,v1:10.20.193.96:6803/1861813169]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T03:32:33.839 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:33.839 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:33.839 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:33.861 INFO:teuthology.orchestra.run.trial132.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.b/config 2026-02-13T03:32:33.981 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.989+0000 7f398c1996c0 1 -- 10.20.193.132:0/1530879229 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3984110a00 msgr2=0x7f3984171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:33.981 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.989+0000 7f398c1996c0 1 --2- 10.20.193.132:0/1530879229 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3984110a00 0x7f3984171390 secure :-1 s=READY pgs=7 gs=1 cs=0 l=1 c_cookie=34846995927861173 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f398000aa40 tx=0x7f398002fde0 comp rx=0 tx=0).stop 2026-02-13T03:32:33.981 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.989+0000 7f398c1996c0 1 -- 10.20.193.132:0/1530879229 shutdown_connections 2026-02-13T03:32:33.981 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.989+0000 7f398c1996c0 1 --2- 10.20.193.132:0/1530879229 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3984110a00 0x7f3984171390 unknown :-1 s=CLOSED pgs=7 gs=1 cs=0 l=1 c_cookie=34846995927861173 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:33.981 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.989+0000 7f398c1996c0 1 --2- 10.20.193.132:0/1530879229 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3984110050 0x7f39841104c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:33.981 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.989+0000 7f398c1996c0 1 --2- 10.20.193.132:0/1530879229 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f398410eed0 0x7f398410f2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:33.981 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.989+0000 7f398c1996c0 1 -- 10.20.193.132:0/1530879229 >> 10.20.193.132:0/1530879229 conn(0x7f39840ec5f0 msgr2=0x7f398410ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:33.981 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.989+0000 7f398c1996c0 1 -- 10.20.193.132:0/1530879229 shutdown_connections 2026-02-13T03:32:33.981 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.989+0000 7f398c1996c0 1 -- 10.20.193.132:0/1530879229 wait complete. 2026-02-13T03:32:33.982 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.989+0000 7f398c1996c0 1 Processor -- start 2026-02-13T03:32:33.982 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.989+0000 7f398c1996c0 1 -- start start 2026-02-13T03:32:33.982 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.989+0000 7f398c1996c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f398410eed0 0x7f39840f8ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:33.982 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.989+0000 7f398c1996c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3984110050 0x7f3984171370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:33.982 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.989+0000 7f398c1996c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3984110a00 0x7f39840f9730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:33.982 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.989+0000 7f398c1996c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f39840fa380 con 0x7f3984110050 2026-02-13T03:32:33.982 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.989+0000 7f398c1996c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f39840fa4f0 con 0x7f398410eed0 2026-02-13T03:32:33.982 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.989+0000 7f398c1996c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f39840fa6b0 con 0x7f3984110a00 2026-02-13T03:32:33.982 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.989+0000 7f3989f0a6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f398410eed0 0x7f39840f8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:33.982 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.989+0000 7f3989f0a6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f398410eed0 0x7f39840f8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.132:3300/0 says I am v2:10.20.193.132:37260/0 (socket says 10.20.193.132:37260) 2026-02-13T03:32:33.982 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.989+0000 7f3989f0a6c0 1 -- 10.20.193.132:0/1152333545 learned_addr learned my addr 10.20.193.132:0/1152333545 (peer_addr_for_me v2:10.20.193.132:0/0) 2026-02-13T03:32:33.982 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.989+0000 7f398a70b6c0 1 --2- 10.20.193.132:0/1152333545 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3984110a00 0x7f39840f9730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:33.982 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.989+0000 7f3989f0a6c0 1 -- 10.20.193.132:0/1152333545 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3984110a00 msgr2=0x7f39840f9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:33.982 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.989+0000 7f3989f0a6c0 1 --2- 10.20.193.132:0/1152333545 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3984110a00 0x7f39840f9730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:33.982 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.989+0000 7f3989f0a6c0 1 -- 10.20.193.132:0/1152333545 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3984110050 msgr2=0x7f3984171370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:33.982 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.990+0000 7f3989f0a6c0 1 --2- 10.20.193.132:0/1152333545 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3984110050 0x7f3984171370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:33.982 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.990+0000 7f3989f0a6c0 1 -- 10.20.193.132:0/1152333545 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f398000a660 con 0x7f398410eed0 2026-02-13T03:32:33.982 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.990+0000 7f398a70b6c0 1 --2- 10.20.193.132:0/1152333545 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3984110a00 0x7f39840f9730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:32:33.982 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.990+0000 7f3989f0a6c0 1 --2- 10.20.193.132:0/1152333545 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f398410eed0 0x7f39840f8ef0 secure :-1 s=READY pgs=8 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f397400b710 tx=0x7f397400bbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:33.983 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.990+0000 7f3972ffd6c0 1 -- 10.20.193.132:0/1152333545 <== mon.2 v2:10.20.193.132:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3974004250 con 0x7f398410eed0 2026-02-13T03:32:33.983 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.990+0000 7f3972ffd6c0 1 -- 10.20.193.132:0/1152333545 <== mon.2 v2:10.20.193.132:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f3974002da0 con 0x7f398410eed0 2026-02-13T03:32:33.983 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.990+0000 7f398c1996c0 1 -- 10.20.193.132:0/1152333545 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39840fa930 con 0x7f398410eed0 2026-02-13T03:32:33.983 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.990+0000 7f3972ffd6c0 1 -- 10.20.193.132:0/1152333545 <== mon.2 v2:10.20.193.132:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f397400ce30 con 0x7f398410eed0 2026-02-13T03:32:33.983 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.990+0000 7f398c1996c0 1 -- 10.20.193.132:0/1152333545 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39840fae60 con 0x7f398410eed0 2026-02-13T03:32:33.983 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.990+0000 7f398c1996c0 1 -- 10.20.193.132:0/1152333545 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39841753e0 con 0x7f398410eed0 2026-02-13T03:32:33.983 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.991+0000 7f3972ffd6c0 1 -- 10.20.193.132:0/1152333545 <== mon.2 v2:10.20.193.132:3300/0 4 ==== mgrmap(e 10) ==== 157010+0+0 (secure 0 0 0) 0x7f39740028c0 con 0x7f398410eed0 2026-02-13T03:32:33.985 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.993+0000 7f3972ffd6c0 1 --2- 10.20.193.132:0/1152333545 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f39600b55f0 0x7f39600d5aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:33.985 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.993+0000 7f39897096c0 1 --2- 10.20.193.132:0/1152333545 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f39600b55f0 0x7f39600d5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:33.985 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.993+0000 7f3972ffd6c0 1 -- 10.20.193.132:0/1152333545 <== mon.2 v2:10.20.193.132:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1141+0+0 (secure 0 0 0) 0x7f39740e1f50 con 0x7f398410eed0 2026-02-13T03:32:33.985 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.993+0000 7f3972ffd6c0 1 -- 10.20.193.132:0/1152333545 <== mon.2 v2:10.20.193.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f39740aa030 con 0x7f398410eed0 2026-02-13T03:32:33.985 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:33.993+0000 7f39897096c0 1 --2- 10.20.193.132:0/1152333545 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f39600b55f0 0x7f39600d5aa0 secure :-1 s=READY pgs=82 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3978005980 tx=0x7f3978005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:34.012 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:34.012 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:34.012 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:34.012 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:34.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:34.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:33 trial133 ceph-mon[26943]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:34.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:34.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:34.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:34.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:33 trial133 ceph-mon[26943]: from='osd.0 [v2:10.20.193.96:6802/1861813169,v1:10.20.193.96:6803/1861813169]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T03:32:34.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:34.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:34.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:34.082 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:34.090+0000 7f398c1996c0 1 -- 10.20.193.132:0/1152333545 --> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial132:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f39840f1e60 con 0x7f39600b55f0 2026-02-13T03:32:34.712 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:34 trial132 ceph-mon[26888]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:34.712 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:34 trial132 ceph-mon[26888]: from='osd.0 [v2:10.20.193.96:6802/1861813169,v1:10.20.193.96:6803/1861813169]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T03:32:34.712 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:34 trial132 ceph-mon[26888]: osdmap e5: 1 total, 0 up, 1 in 2026-02-13T03:32:34.712 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:34 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:32:34.712 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:34 trial132 ceph-mon[26888]: from='osd.0 [v2:10.20.193.96:6802/1861813169,v1:10.20.193.96:6803/1861813169]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial096", "root=default"]} : dispatch 2026-02-13T03:32:34.712 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:34 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:34.712 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:34 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:34.712 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:34 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:34.712 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:34 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:34.712 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:34 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:34.712 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:34 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:34.712 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:34 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:34.712 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:34 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:32:34.712 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:34 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:34.712 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:34 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:34.712 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:34 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:34.712 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:34 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:34.712 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:34 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:34.712 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:34 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:34.712 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:34 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:34.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:34 trial096 ceph-mon[24671]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:34.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:34 trial096 ceph-mon[24671]: from='osd.0 [v2:10.20.193.96:6802/1861813169,v1:10.20.193.96:6803/1861813169]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T03:32:34.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:34 trial096 ceph-mon[24671]: osdmap e5: 1 total, 0 up, 1 in 2026-02-13T03:32:34.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:34 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:32:34.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:34 trial096 ceph-mon[24671]: from='osd.0 [v2:10.20.193.96:6802/1861813169,v1:10.20.193.96:6803/1861813169]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial096", "root=default"]} : dispatch 2026-02-13T03:32:34.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:34 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:34.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:34 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:34.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:34 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:34.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:34 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:34.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:34 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:34.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:34 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:34.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:34 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:34.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:34 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:32:34.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:34 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:34.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:34 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:34.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:34 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:34.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:34 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:34.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:34 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:34.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:34 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:34.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:34 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:34.920 INFO:journalctl@ceph.osd.0.trial096.stdout:Feb 13 03:32:34 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-0[36795]: 2026-02-13T03:32:34.598+0000 7f7c11a876c0 -1 osd.0 0 waiting for initial osdmap 2026-02-13T03:32:34.920 INFO:journalctl@ceph.osd.0.trial096.stdout:Feb 13 03:32:34 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-0[36795]: 2026-02-13T03:32:34.600+0000 7f7c099436c0 -1 osd.0 6 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:32:35.012 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:34 trial133 ceph-mon[26943]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:34 trial133 ceph-mon[26943]: from='osd.0 [v2:10.20.193.96:6802/1861813169,v1:10.20.193.96:6803/1861813169]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T03:32:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:34 trial133 ceph-mon[26943]: osdmap e5: 1 total, 0 up, 1 in 2026-02-13T03:32:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:34 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:32:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:34 trial133 ceph-mon[26943]: from='osd.0 [v2:10.20.193.96:6802/1861813169,v1:10.20.193.96:6803/1861813169]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial096", "root=default"]} : dispatch 2026-02-13T03:32:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:34 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:34 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:34 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:34 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:34 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:34 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:34 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:34 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:32:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:34 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:34 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:34 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:34 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:34 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:34 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:34 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:35.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:35 trial096 ceph-mon[24671]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial132:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:32:35.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:35 trial096 ceph-mon[24671]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:35.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:35 trial096 ceph-mon[24671]: from='osd.0 [v2:10.20.193.96:6802/1861813169,v1:10.20.193.96:6803/1861813169]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial096", "root=default"]}]': finished 2026-02-13T03:32:35.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:35 trial096 ceph-mon[24671]: osdmap e6: 1 total, 0 up, 1 in 2026-02-13T03:32:35.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:35 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:32:35.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:35 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:32:35.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:35 trial096 ceph-mon[24671]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4238865b-e38e-494d-b2cd-4ee08715f004"} : dispatch 2026-02-13T03:32:35.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:35 trial096 ceph-mon[24671]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4238865b-e38e-494d-b2cd-4ee08715f004"}]': finished 2026-02-13T03:32:35.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:35 trial096 ceph-mon[24671]: osd.0 [v2:10.20.193.96:6802/1861813169,v1:10.20.193.96:6803/1861813169] boot 2026-02-13T03:32:35.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:35 trial096 ceph-mon[24671]: osdmap e7: 2 total, 1 up, 2 in 2026-02-13T03:32:35.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:35 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:32:35.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:35 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:32:35.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:35 trial096 ceph-mon[24671]: from='client.? 10.20.193.132:0/1956185423' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4238865b-e38e-494d-b2cd-4ee08715f004"} : dispatch 2026-02-13T03:32:35.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:35 trial096 ceph-mon[24671]: from='client.? 10.20.193.132:0/2903876362' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:32:35.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:35 trial096 ceph-mon[24671]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:32:35.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:35 trial096 ceph-mon[24671]: Cluster is now healthy 2026-02-13T03:32:35.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:35 trial132 ceph-mon[26888]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial132:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:32:35.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:35 trial132 ceph-mon[26888]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:35.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:35 trial132 ceph-mon[26888]: from='osd.0 [v2:10.20.193.96:6802/1861813169,v1:10.20.193.96:6803/1861813169]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial096", "root=default"]}]': finished 2026-02-13T03:32:35.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:35 trial132 ceph-mon[26888]: osdmap e6: 1 total, 0 up, 1 in 2026-02-13T03:32:35.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:35 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:32:35.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:35 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:32:35.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:35 trial132 ceph-mon[26888]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4238865b-e38e-494d-b2cd-4ee08715f004"} : dispatch 2026-02-13T03:32:35.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:35 trial132 ceph-mon[26888]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4238865b-e38e-494d-b2cd-4ee08715f004"}]': finished 2026-02-13T03:32:35.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:35 trial132 ceph-mon[26888]: osd.0 [v2:10.20.193.96:6802/1861813169,v1:10.20.193.96:6803/1861813169] boot 2026-02-13T03:32:35.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:35 trial132 ceph-mon[26888]: osdmap e7: 2 total, 1 up, 2 in 2026-02-13T03:32:35.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:35 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:32:35.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:35 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:32:35.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:35 trial132 ceph-mon[26888]: from='client.? 10.20.193.132:0/1956185423' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4238865b-e38e-494d-b2cd-4ee08715f004"} : dispatch 2026-02-13T03:32:35.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:35 trial132 ceph-mon[26888]: from='client.? 10.20.193.132:0/2903876362' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:32:35.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:35 trial132 ceph-mon[26888]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:32:35.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:35 trial132 ceph-mon[26888]: Cluster is now healthy 2026-02-13T03:32:36.012 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:35 trial133 ceph-mon[26943]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial132:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:32:36.012 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:35 trial133 ceph-mon[26943]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:32:36.012 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:35 trial133 ceph-mon[26943]: from='osd.0 [v2:10.20.193.96:6802/1861813169,v1:10.20.193.96:6803/1861813169]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial096", "root=default"]}]': finished 2026-02-13T03:32:36.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:35 trial133 ceph-mon[26943]: osdmap e6: 1 total, 0 up, 1 in 2026-02-13T03:32:36.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:35 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:32:36.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:35 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:32:36.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:35 trial133 ceph-mon[26943]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4238865b-e38e-494d-b2cd-4ee08715f004"} : dispatch 2026-02-13T03:32:36.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:35 trial133 ceph-mon[26943]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4238865b-e38e-494d-b2cd-4ee08715f004"}]': finished 2026-02-13T03:32:36.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:35 trial133 ceph-mon[26943]: osd.0 [v2:10.20.193.96:6802/1861813169,v1:10.20.193.96:6803/1861813169] boot 2026-02-13T03:32:36.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:35 trial133 ceph-mon[26943]: osdmap e7: 2 total, 1 up, 2 in 2026-02-13T03:32:36.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:35 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:32:36.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:35 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:32:36.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:35 trial133 ceph-mon[26943]: from='client.? 10.20.193.132:0/1956185423' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4238865b-e38e-494d-b2cd-4ee08715f004"} : dispatch 2026-02-13T03:32:36.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:35 trial133 ceph-mon[26943]: from='client.? 10.20.193.132:0/2903876362' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:32:36.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:35 trial133 ceph-mon[26943]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:32:36.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:35 trial133 ceph-mon[26943]: Cluster is now healthy 2026-02-13T03:32:36.760 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:36 trial132 ceph-mon[26888]: purged_snaps scrub starts 2026-02-13T03:32:36.760 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:36 trial132 ceph-mon[26888]: purged_snaps scrub ok 2026-02-13T03:32:36.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:36 trial096 ceph-mon[24671]: purged_snaps scrub starts 2026-02-13T03:32:36.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:36 trial096 ceph-mon[24671]: purged_snaps scrub ok 2026-02-13T03:32:37.012 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:36 trial133 ceph-mon[26943]: purged_snaps scrub starts 2026-02-13T03:32:37.012 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:36 trial133 ceph-mon[26943]: purged_snaps scrub ok 2026-02-13T03:32:37.685 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:37 trial132 ceph-mon[26888]: pgmap v22: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:32:37.685 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:37 trial132 ceph-mon[26888]: pgmap v23: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:32:37.685 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:37 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:37.685 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:37 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:37.685 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:37 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:37.685 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:37 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:37.685 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:37 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:37.685 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:37 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:37.685 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:37 trial132 ceph-mon[26888]: pgmap v24: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:32:37.685 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:37 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:37.685 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:37 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:37.685 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:37 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:37.685 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:37 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T03:32:37.685 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:37 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:37.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:37 trial096 ceph-mon[24671]: pgmap v22: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:32:37.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:37 trial096 ceph-mon[24671]: pgmap v23: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:32:37.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:37 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:37.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:37 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:37.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:37 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:37.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:37 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:37.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:37 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:37.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:37 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:37.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:37 trial096 ceph-mon[24671]: pgmap v24: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:32:37.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:37 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:37.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:37 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:37.921 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:37 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:37.921 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:37 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T03:32:37.921 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:37 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:38.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:37 trial133 ceph-mon[26943]: pgmap v22: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:32:38.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:37 trial133 ceph-mon[26943]: pgmap v23: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:32:38.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:37 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:38.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:37 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:38.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:37 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:38.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:37 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:38.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:37 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:38.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:37 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:38.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:37 trial133 ceph-mon[26943]: pgmap v24: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:32:38.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:37 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:38.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:37 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:38.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:37 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:38.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:37 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T03:32:38.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:37 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:38.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:38 trial096 ceph-mon[24671]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:32:38.920 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:38 trial096 ceph-mon[24671]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:32:38.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:38 trial132 ceph-mon[26888]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:32:38.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:38 trial132 ceph-mon[26888]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:32:39.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:38 trial133 ceph-mon[26943]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:32:39.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:38 trial133 ceph-mon[26943]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:32:39.844 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:39 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:39.844 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:39 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:39.844 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:39 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:39.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:39 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:39.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:39 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:39.919 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:39 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:40.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:39 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:40.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:39 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:40.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:39 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:40.496 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:40.504+0000 7f3972ffd6c0 1 -- 10.20.193.132:0/1152333545 <== mgr.14116 v2:10.20.193.96:6800/1736050816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f39840f1e60 con 0x7f39600b55f0 2026-02-13T03:32:40.497 INFO:teuthology.orchestra.run.trial132.stdout:Created osd(s) 1 on host 'trial132' 2026-02-13T03:32:40.499 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:40.507+0000 7f398c1996c0 1 -- 10.20.193.132:0/1152333545 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f39600b55f0 msgr2=0x7f39600d5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:40.499 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:40.507+0000 7f398c1996c0 1 --2- 10.20.193.132:0/1152333545 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f39600b55f0 0x7f39600d5aa0 secure :-1 s=READY pgs=82 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3978005980 tx=0x7f3978005910 comp rx=0 tx=0).stop 2026-02-13T03:32:40.499 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:40.507+0000 7f398c1996c0 1 -- 10.20.193.132:0/1152333545 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f398410eed0 msgr2=0x7f39840f8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:40.499 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:40.507+0000 7f398c1996c0 1 --2- 10.20.193.132:0/1152333545 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f398410eed0 0x7f39840f8ef0 secure :-1 s=READY pgs=8 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f397400b710 tx=0x7f397400bbe0 comp rx=0 tx=0).stop 2026-02-13T03:32:40.499 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:40.507+0000 7f398c1996c0 1 -- 10.20.193.132:0/1152333545 shutdown_connections 2026-02-13T03:32:40.499 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:40.507+0000 7f398c1996c0 1 --2- 10.20.193.132:0/1152333545 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f39600b55f0 0x7f39600d5aa0 unknown :-1 s=CLOSED pgs=82 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:40.500 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:40.507+0000 7f398c1996c0 1 --2- 10.20.193.132:0/1152333545 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3984110a00 0x7f39840f9730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:40.500 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:40.507+0000 7f398c1996c0 1 --2- 10.20.193.132:0/1152333545 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3984110050 0x7f3984171370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:40.500 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:40.507+0000 7f398c1996c0 1 --2- 10.20.193.132:0/1152333545 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f398410eed0 0x7f39840f8ef0 unknown :-1 s=CLOSED pgs=8 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:40.500 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:40.507+0000 7f398c1996c0 1 -- 10.20.193.132:0/1152333545 >> 10.20.193.132:0/1152333545 conn(0x7f39840ec5f0 msgr2=0x7f39840ef4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:40.500 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:40.507+0000 7f398c1996c0 1 -- 10.20.193.132:0/1152333545 shutdown_connections 2026-02-13T03:32:40.500 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:40.507+0000 7f398c1996c0 1 -- 10.20.193.132:0/1152333545 wait complete. 2026-02-13T03:32:40.539 DEBUG:teuthology.orchestra.run.trial132:osd.1> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.1.service 2026-02-13T03:32:40.541 INFO:tasks.cephadm:Deploying osd.2 on trial133 with /dev/vg_nvme/lv_4... 2026-02-13T03:32:40.541 DEBUG:teuthology.orchestra.run.trial133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T03:32:40.661 INFO:teuthology.orchestra.run.trial133.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.c/config 2026-02-13T03:32:41.074 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:40 trial133 ceph-mon[26943]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:32:41.074 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:41.074 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:41.074 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:41.074 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:41.074 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:41.074 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:40 trial133 ceph-mon[26943]: pgmap v27: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:32:41.074 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:41.075 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:41.075 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:41.075 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:40 trial133 ceph-mon[26943]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T03:32:41.075 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:40 trial133 ceph-mon[26943]: from='osd.1 [v2:10.20.193.132:6800/3550689941,v1:10.20.193.132:6801/3550689941]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T03:32:41.075 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:40 trial133 ceph-mon[26943]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:32:41.075 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:40 trial133 ceph-mon[26943]: Cluster is now healthy 2026-02-13T03:32:41.075 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:41.075 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:41.075 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:41.088 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:32:41.107 DEBUG:teuthology.orchestra.run.trial133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph orch daemon add osd trial133:vg_nvme/lv_4 --skip-validation 2026-02-13T03:32:41.226 INFO:teuthology.orchestra.run.trial133.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.c/config 2026-02-13T03:32:41.241 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:40 trial132 ceph-mon[26888]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:32:41.241 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:41.241 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:41.241 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:41.241 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:41.241 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:41.241 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:40 trial132 ceph-mon[26888]: pgmap v27: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:32:41.241 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:41.241 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:41.241 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:41.242 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:40 trial132 ceph-mon[26888]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T03:32:41.242 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:40 trial132 ceph-mon[26888]: from='osd.1 [v2:10.20.193.132:6800/3550689941,v1:10.20.193.132:6801/3550689941]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T03:32:41.242 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:40 trial132 ceph-mon[26888]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:32:41.242 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:40 trial132 ceph-mon[26888]: Cluster is now healthy 2026-02-13T03:32:41.242 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:41.242 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:41.242 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:41.346 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.341+0000 7f684874d6c0 1 -- 10.20.193.133:0/1371303334 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f684010eec0 msgr2=0x7f684010f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:41.347 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.341+0000 7f684874d6c0 1 --2- 10.20.193.133:0/1371303334 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f684010eec0 0x7f684010f2b0 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=11303801734359232819 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6830009970 tx=0x7f683002ed20 comp rx=0 tx=0).stop 2026-02-13T03:32:41.347 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.342+0000 7f684874d6c0 1 -- 10.20.193.133:0/1371303334 shutdown_connections 2026-02-13T03:32:41.347 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.342+0000 7f684874d6c0 1 --2- 10.20.193.133:0/1371303334 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f68401109f0 0x7f6840171380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:41.347 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.342+0000 7f684874d6c0 1 --2- 10.20.193.133:0/1371303334 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6840110040 0x7f68401104b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:41.347 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.342+0000 7f684874d6c0 1 --2- 10.20.193.133:0/1371303334 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f684010eec0 0x7f684010f2b0 unknown :-1 s=CLOSED pgs=6 gs=1 cs=0 l=1 c_cookie=11303801734359232819 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:41.347 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.342+0000 7f684874d6c0 1 -- 10.20.193.133:0/1371303334 >> 10.20.193.133:0/1371303334 conn(0x7f68400ec5c0 msgr2=0x7f684010c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:41.347 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.342+0000 7f684874d6c0 1 -- 10.20.193.133:0/1371303334 shutdown_connections 2026-02-13T03:32:41.347 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.342+0000 7f684874d6c0 1 -- 10.20.193.133:0/1371303334 wait complete. 2026-02-13T03:32:41.348 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.342+0000 7f684874d6c0 1 Processor -- start 2026-02-13T03:32:41.348 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.342+0000 7f684874d6c0 1 -- start start 2026-02-13T03:32:41.348 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.342+0000 7f684874d6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f684010eec0 0x7f68400f9020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:41.348 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.342+0000 7f684874d6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6840110040 0x7f6840171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:41.348 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.342+0000 7f684874d6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f68401109f0 0x7f68400f9880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:41.348 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.342+0000 7f684874d6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f68400fa4b0 con 0x7f6840110040 2026-02-13T03:32:41.348 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.342+0000 7f684874d6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f68400fa620 con 0x7f684010eec0 2026-02-13T03:32:41.348 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.342+0000 7f684874d6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f68400fa7e0 con 0x7f68401109f0 2026-02-13T03:32:41.348 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.342+0000 7f6846cbf6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f68401109f0 0x7f68400f9880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:41.348 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.342+0000 7f6846cbf6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f68401109f0 0x7f68400f9880 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.133:3300/0 says I am v2:10.20.193.133:50552/0 (socket says 10.20.193.133:50552) 2026-02-13T03:32:41.348 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.342+0000 7f6846cbf6c0 1 -- 10.20.193.133:0/2057590078 learned_addr learned my addr 10.20.193.133:0/2057590078 (peer_addr_for_me v2:10.20.193.133:0/0) 2026-02-13T03:32:41.349 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.342+0000 7f68464be6c0 1 --2- 10.20.193.133:0/2057590078 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f684010eec0 0x7f68400f9020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:41.349 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.342+0000 7f6845cbd6c0 1 --2- 10.20.193.133:0/2057590078 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6840110040 0x7f6840171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:41.349 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.343+0000 7f6846cbf6c0 1 -- 10.20.193.133:0/2057590078 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f684010eec0 msgr2=0x7f68400f9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:41.349 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.343+0000 7f6846cbf6c0 1 --2- 10.20.193.133:0/2057590078 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f684010eec0 0x7f68400f9020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:41.349 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.343+0000 7f6846cbf6c0 1 -- 10.20.193.133:0/2057590078 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6840110040 msgr2=0x7f6840171380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:41.349 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.343+0000 7f6846cbf6c0 1 --2- 10.20.193.133:0/2057590078 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6840110040 0x7f6840171380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:41.349 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.343+0000 7f6846cbf6c0 1 -- 10.20.193.133:0/2057590078 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6830009590 con 0x7f68401109f0 2026-02-13T03:32:41.349 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.343+0000 7f6846cbf6c0 1 --2- 10.20.193.133:0/2057590078 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f68401109f0 0x7f68400f9880 secure :-1 s=READY pgs=7 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f683c006ea0 tx=0x7f683c00cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:41.349 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.343+0000 7f68277fe6c0 1 -- 10.20.193.133:0/2057590078 <== mon.1 v2:10.20.193.133:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f683c003a30 con 0x7f68401109f0 2026-02-13T03:32:41.349 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.343+0000 7f68277fe6c0 1 -- 10.20.193.133:0/2057590078 <== mon.1 v2:10.20.193.133:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f683c005510 con 0x7f68401109f0 2026-02-13T03:32:41.349 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.343+0000 7f68277fe6c0 1 -- 10.20.193.133:0/2057590078 <== mon.1 v2:10.20.193.133:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f683c00dd70 con 0x7f68401109f0 2026-02-13T03:32:41.350 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.343+0000 7f684874d6c0 1 -- 10.20.193.133:0/2057590078 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68400faac0 con 0x7f68401109f0 2026-02-13T03:32:41.350 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.343+0000 7f684874d6c0 1 -- 10.20.193.133:0/2057590078 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68400faf50 con 0x7f68401109f0 2026-02-13T03:32:41.350 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.343+0000 7f684874d6c0 1 -- 10.20.193.133:0/2057590078 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68401753f0 con 0x7f68401109f0 2026-02-13T03:32:41.351 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.344+0000 7f68277fe6c0 1 -- 10.20.193.133:0/2057590078 <== mon.1 v2:10.20.193.133:3300/0 4 ==== mgrmap(e 10) ==== 157010+0+0 (secure 0 0 0) 0x7f683c003b90 con 0x7f68401109f0 2026-02-13T03:32:41.351 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.345+0000 7f68277fe6c0 1 --2- 10.20.193.133:0/2057590078 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f681c0b55f0 0x7f681c0d5aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:41.351 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.345+0000 7f68277fe6c0 1 -- 10.20.193.133:0/2057590078 <== mon.1 v2:10.20.193.133:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1681+0+0 (secure 0 0 0) 0x7f683c0e2f70 con 0x7f68401109f0 2026-02-13T03:32:41.351 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.345+0000 7f68464be6c0 1 --2- 10.20.193.133:0/2057590078 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f681c0b55f0 0x7f681c0d5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:41.351 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.345+0000 7f68464be6c0 1 --2- 10.20.193.133:0/2057590078 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f681c0b55f0 0x7f681c0d5aa0 secure :-1 s=READY pgs=87 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6830005b40 tx=0x7f68300023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:41.351 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.346+0000 7f68277fe6c0 1 -- 10.20.193.133:0/2057590078 <== mon.1 v2:10.20.193.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f683c0a7390 con 0x7f68401109f0 2026-02-13T03:32:41.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:40 trial096 ceph-mon[24671]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:32:41.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:41.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:41.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:41.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:41.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:41.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:40 trial096 ceph-mon[24671]: pgmap v27: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:32:41.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:41.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:41.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:41.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:40 trial096 ceph-mon[24671]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T03:32:41.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:40 trial096 ceph-mon[24671]: from='osd.1 [v2:10.20.193.132:6800/3550689941,v1:10.20.193.132:6801/3550689941]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T03:32:41.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:40 trial096 ceph-mon[24671]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:32:41.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:40 trial096 ceph-mon[24671]: Cluster is now healthy 2026-02-13T03:32:41.421 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:41.421 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:41.421 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:41.444 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:41.442+0000 7f684874d6c0 1 -- 10.20.193.133:0/2057590078 --> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial133:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f684004ca20 con 0x7f681c0b55f0 2026-02-13T03:32:42.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:41 trial133 ceph-mon[26943]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:32:42.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:41 trial133 ceph-mon[26943]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T03:32:42.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:41 trial133 ceph-mon[26943]: osdmap e8: 2 total, 1 up, 2 in 2026-02-13T03:32:42.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:41 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:32:42.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:41 trial133 ceph-mon[26943]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial132", "root=default"]} : dispatch 2026-02-13T03:32:42.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:41 trial133 ceph-mon[26943]: from='osd.1 [v2:10.20.193.132:6800/3550689941,v1:10.20.193.132:6801/3550689941]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial132", "root=default"]} : dispatch 2026-02-13T03:32:42.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:41 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:42.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:41 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:42.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:41 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:42.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:41 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:42.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:41 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:42.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:41 trial133 ceph-mon[26943]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:32:42.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:41 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:42.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:41 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:42.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:41 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:32:42.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:41 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:42.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:41 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:42.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:41 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:42.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:41 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:42.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:41 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:42.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:41 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:42.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:41 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:42.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:42 trial096 ceph-mon[24671]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:32:42.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:42 trial096 ceph-mon[24671]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T03:32:42.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:42 trial096 ceph-mon[24671]: osdmap e8: 2 total, 1 up, 2 in 2026-02-13T03:32:42.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:42 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:32:42.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:42 trial096 ceph-mon[24671]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial132", "root=default"]} : dispatch 2026-02-13T03:32:42.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:42 trial096 ceph-mon[24671]: from='osd.1 [v2:10.20.193.132:6800/3550689941,v1:10.20.193.132:6801/3550689941]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial132", "root=default"]} : dispatch 2026-02-13T03:32:42.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:42 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:42.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:42 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:42.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:42 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:42.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:42 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:42.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:42 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:42.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:42 trial096 ceph-mon[24671]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:32:42.421 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:42 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:42.421 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:42 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:42.421 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:42 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:32:42.421 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:42 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:42.421 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:42 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:42.421 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:42 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:42.421 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:42 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:42.421 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:42 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:42.421 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:42 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:42.421 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:42 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:42.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:42 trial132 ceph-mon[26888]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:32:42.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:42 trial132 ceph-mon[26888]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T03:32:42.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:42 trial132 ceph-mon[26888]: osdmap e8: 2 total, 1 up, 2 in 2026-02-13T03:32:42.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:42 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:32:42.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:42 trial132 ceph-mon[26888]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial132", "root=default"]} : dispatch 2026-02-13T03:32:42.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:42 trial132 ceph-mon[26888]: from='osd.1 [v2:10.20.193.132:6800/3550689941,v1:10.20.193.132:6801/3550689941]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial132", "root=default"]} : dispatch 2026-02-13T03:32:42.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:42 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:42.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:42 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:42.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:42 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:42.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:42 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:42.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:42 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:42.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:42 trial132 ceph-mon[26888]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:32:42.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:42 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:42.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:42 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:42.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:42 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:32:42.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:42 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:42.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:42 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:42.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:42 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:42.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:42 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:42.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:42 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:42.485 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:42 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:42.485 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:42 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:42.485 INFO:journalctl@ceph.osd.1.trial132.stdout:Feb 13 03:32:42 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-1[31703]: 2026-02-13T03:32:42.009+0000 7f4e430386c0 -1 osd.1 0 waiting for initial osdmap 2026-02-13T03:32:42.485 INFO:journalctl@ceph.osd.1.trial132.stdout:Feb 13 03:32:42 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-1[31703]: 2026-02-13T03:32:42.011+0000 7f4e3aef46c0 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:32:43.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:42 trial133 ceph-mon[26943]: from='client.24148 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial133:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:32:43.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:42 trial133 ceph-mon[26943]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:32:43.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:42 trial133 ceph-mon[26943]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial132", "root=default"]}]': finished 2026-02-13T03:32:43.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:42 trial133 ceph-mon[26943]: osdmap e9: 2 total, 1 up, 2 in 2026-02-13T03:32:43.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:42 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:32:43.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:42 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:32:43.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:42 trial133 ceph-mon[26943]: from='client.? 10.20.193.133:0/1947458693' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "85769516-916b-43ce-aec8-36a3011ae085"} : dispatch 2026-02-13T03:32:43.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:42 trial133 ceph-mon[26943]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "85769516-916b-43ce-aec8-36a3011ae085"} : dispatch 2026-02-13T03:32:43.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:42 trial133 ceph-mon[26943]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85769516-916b-43ce-aec8-36a3011ae085"}]': finished 2026-02-13T03:32:43.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:42 trial133 ceph-mon[26943]: osd.1 [v2:10.20.193.132:6800/3550689941,v1:10.20.193.132:6801/3550689941] boot 2026-02-13T03:32:43.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:42 trial133 ceph-mon[26943]: osdmap e10: 3 total, 2 up, 3 in 2026-02-13T03:32:43.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:42 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:32:43.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:42 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:32:43.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:42 trial133 ceph-mon[26943]: from='client.? 10.20.193.133:0/3179101200' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:32:43.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:42 trial133 ceph-mon[26943]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:32:43.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:42 trial133 ceph-mon[26943]: Cluster is now healthy 2026-02-13T03:32:43.384 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:43 trial132 ceph-mon[26888]: from='client.24148 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial133:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:32:43.384 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:43 trial132 ceph-mon[26888]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:32:43.384 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:43 trial132 ceph-mon[26888]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial132", "root=default"]}]': finished 2026-02-13T03:32:43.384 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:43 trial132 ceph-mon[26888]: osdmap e9: 2 total, 1 up, 2 in 2026-02-13T03:32:43.384 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:43 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:32:43.384 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:43 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:32:43.384 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:43 trial132 ceph-mon[26888]: from='client.? 10.20.193.133:0/1947458693' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "85769516-916b-43ce-aec8-36a3011ae085"} : dispatch 2026-02-13T03:32:43.385 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:43 trial132 ceph-mon[26888]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "85769516-916b-43ce-aec8-36a3011ae085"} : dispatch 2026-02-13T03:32:43.385 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:43 trial132 ceph-mon[26888]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85769516-916b-43ce-aec8-36a3011ae085"}]': finished 2026-02-13T03:32:43.385 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:43 trial132 ceph-mon[26888]: osd.1 [v2:10.20.193.132:6800/3550689941,v1:10.20.193.132:6801/3550689941] boot 2026-02-13T03:32:43.385 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:43 trial132 ceph-mon[26888]: osdmap e10: 3 total, 2 up, 3 in 2026-02-13T03:32:43.385 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:43 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:32:43.385 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:43 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:32:43.385 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:43 trial132 ceph-mon[26888]: from='client.? 10.20.193.133:0/3179101200' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:32:43.385 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:43 trial132 ceph-mon[26888]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:32:43.385 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:43 trial132 ceph-mon[26888]: Cluster is now healthy 2026-02-13T03:32:43.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:43 trial096 ceph-mon[24671]: from='client.24148 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial133:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:32:43.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:43 trial096 ceph-mon[24671]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:32:43.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:43 trial096 ceph-mon[24671]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial132", "root=default"]}]': finished 2026-02-13T03:32:43.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:43 trial096 ceph-mon[24671]: osdmap e9: 2 total, 1 up, 2 in 2026-02-13T03:32:43.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:43 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:32:43.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:43 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:32:43.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:43 trial096 ceph-mon[24671]: from='client.? 10.20.193.133:0/1947458693' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "85769516-916b-43ce-aec8-36a3011ae085"} : dispatch 2026-02-13T03:32:43.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:43 trial096 ceph-mon[24671]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "85769516-916b-43ce-aec8-36a3011ae085"} : dispatch 2026-02-13T03:32:43.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:43 trial096 ceph-mon[24671]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85769516-916b-43ce-aec8-36a3011ae085"}]': finished 2026-02-13T03:32:43.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:43 trial096 ceph-mon[24671]: osd.1 [v2:10.20.193.132:6800/3550689941,v1:10.20.193.132:6801/3550689941] boot 2026-02-13T03:32:43.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:43 trial096 ceph-mon[24671]: osdmap e10: 3 total, 2 up, 3 in 2026-02-13T03:32:43.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:43 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:32:43.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:43 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:32:43.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:43 trial096 ceph-mon[24671]: from='client.? 10.20.193.133:0/3179101200' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:32:43.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:43 trial096 ceph-mon[24671]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:32:43.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:43 trial096 ceph-mon[24671]: Cluster is now healthy 2026-02-13T03:32:44.195 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:43 trial133 ceph-mon[26943]: purged_snaps scrub starts 2026-02-13T03:32:44.195 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:43 trial133 ceph-mon[26943]: purged_snaps scrub ok 2026-02-13T03:32:44.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:44 trial096 ceph-mon[24671]: purged_snaps scrub starts 2026-02-13T03:32:44.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:44 trial096 ceph-mon[24671]: purged_snaps scrub ok 2026-02-13T03:32:44.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:44 trial132 ceph-mon[26888]: purged_snaps scrub starts 2026-02-13T03:32:44.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:44 trial132 ceph-mon[26888]: purged_snaps scrub ok 2026-02-13T03:32:45.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:45 trial133 ceph-mon[26943]: pgmap v33: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:32:45.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:45 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:45.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:45 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:45.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:45 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:45.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:45 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:45.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:45 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:45.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:45 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:45.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:45 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:45.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:45 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:45.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:45 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:45.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:45 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T03:32:45.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:45 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:45.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:45 trial096 ceph-mon[24671]: pgmap v33: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:32:45.419 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:45 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:45.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:45 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:45.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:45 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:45.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:45 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:45.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:45 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:45.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:45 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:45.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:45 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:45.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:45 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:45.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:45 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:45.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:45 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T03:32:45.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:45 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:45.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:45 trial132 ceph-mon[26888]: pgmap v33: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:32:45.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:45 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:45.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:45 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:45.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:45 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:45.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:45 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:45.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:45 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:45.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:45 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:45.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:45 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:45.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:45 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:45.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:45 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:45.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:45 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T03:32:45.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:45 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:46.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:46 trial133 ceph-mon[26943]: pgmap v34: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:32:46.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:46 trial133 ceph-mon[26943]: pgmap v35: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:32:46.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:46 trial133 ceph-mon[26943]: pgmap v36: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:32:46.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:46 trial133 ceph-mon[26943]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:32:46.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:46 trial096 ceph-mon[24671]: pgmap v34: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:32:46.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:46 trial096 ceph-mon[24671]: pgmap v35: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:32:46.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:46 trial096 ceph-mon[24671]: pgmap v36: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:32:46.420 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:46 trial096 ceph-mon[24671]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:32:46.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:46 trial132 ceph-mon[26888]: pgmap v34: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:32:46.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:46 trial132 ceph-mon[26888]: pgmap v35: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:32:46.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:46 trial132 ceph-mon[26888]: pgmap v36: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:32:46.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:46 trial132 ceph-mon[26888]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:32:47.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:47 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:47.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:47 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:47.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:47 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:47.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:47 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:47.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:47 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:47.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:47 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:47.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:47 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:47.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:47 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:47.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:47 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:47.773 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:47.770+0000 7f68277fe6c0 1 -- 10.20.193.133:0/2057590078 <== mgr.14116 v2:10.20.193.96:6800/1736050816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f684004ca20 con 0x7f681c0b55f0 2026-02-13T03:32:47.773 INFO:teuthology.orchestra.run.trial133.stdout:Created osd(s) 2 on host 'trial133' 2026-02-13T03:32:47.775 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:47.773+0000 7f684874d6c0 1 -- 10.20.193.133:0/2057590078 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f681c0b55f0 msgr2=0x7f681c0d5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:47.776 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:47.773+0000 7f684874d6c0 1 --2- 10.20.193.133:0/2057590078 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f681c0b55f0 0x7f681c0d5aa0 secure :-1 s=READY pgs=87 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6830005b40 tx=0x7f68300023a0 comp rx=0 tx=0).stop 2026-02-13T03:32:47.776 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:47.773+0000 7f684874d6c0 1 -- 10.20.193.133:0/2057590078 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f68401109f0 msgr2=0x7f68400f9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:47.776 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:47.773+0000 7f684874d6c0 1 --2- 10.20.193.133:0/2057590078 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f68401109f0 0x7f68400f9880 secure :-1 s=READY pgs=7 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f683c006ea0 tx=0x7f683c00cca0 comp rx=0 tx=0).stop 2026-02-13T03:32:47.776 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:47.773+0000 7f684874d6c0 1 -- 10.20.193.133:0/2057590078 shutdown_connections 2026-02-13T03:32:47.776 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:47.773+0000 7f684874d6c0 1 --2- 10.20.193.133:0/2057590078 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f681c0b55f0 0x7f681c0d5aa0 unknown :-1 s=CLOSED pgs=87 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:47.776 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:47.773+0000 7f684874d6c0 1 --2- 10.20.193.133:0/2057590078 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f68401109f0 0x7f68400f9880 unknown :-1 s=CLOSED pgs=7 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:47.776 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:47.773+0000 7f684874d6c0 1 --2- 10.20.193.133:0/2057590078 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6840110040 0x7f6840171380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:47.776 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:47.773+0000 7f684874d6c0 1 --2- 10.20.193.133:0/2057590078 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f684010eec0 0x7f68400f9020 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:47.776 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:47.773+0000 7f684874d6c0 1 -- 10.20.193.133:0/2057590078 >> 10.20.193.133:0/2057590078 conn(0x7f68400ec5c0 msgr2=0x7f68400ef530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:47.776 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:47.773+0000 7f684874d6c0 1 -- 10.20.193.133:0/2057590078 shutdown_connections 2026-02-13T03:32:47.776 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:32:47.773+0000 7f684874d6c0 1 -- 10.20.193.133:0/2057590078 wait complete. 2026-02-13T03:32:47.817 DEBUG:teuthology.orchestra.run.trial133:osd.2> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.2.service 2026-02-13T03:32:47.818 INFO:tasks.cephadm:Deploying osd.3 on trial096 with /dev/vg_nvme/lv_3... 2026-02-13T03:32:47.818 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T03:32:47.935 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:48.092 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:48 trial096 ceph-mon[24671]: pgmap v37: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:32:48.092 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:48.092 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:48.092 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:48.092 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:48.092 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:48.093 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:48.093 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:48.093 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:48.093 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:48 trial096 ceph-mon[24671]: from='osd.2 [v2:10.20.193.133:6800/4145071410,v1:10.20.193.133:6801/4145071410]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T03:32:48.093 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:48 trial096 ceph-mon[24671]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T03:32:48.093 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:48.093 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:48.093 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:48 trial096 ceph-mon[24671]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:32:48.093 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:48 trial096 ceph-mon[24671]: Cluster is now healthy 2026-02-13T03:32:48.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:48 trial133 ceph-mon[26943]: pgmap v37: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:32:48.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:48.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:48.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:48.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:48.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:48.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:48.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:48.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:48.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:48 trial133 ceph-mon[26943]: from='osd.2 [v2:10.20.193.133:6800/4145071410,v1:10.20.193.133:6801/4145071410]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T03:32:48.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:48 trial133 ceph-mon[26943]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T03:32:48.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:48.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:48.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:48 trial133 ceph-mon[26943]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:32:48.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:48 trial133 ceph-mon[26943]: Cluster is now healthy 2026-02-13T03:32:48.390 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:32:48.407 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph orch daemon add osd trial096:vg_nvme/lv_3 --skip-validation 2026-02-13T03:32:48.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:48 trial132 ceph-mon[26888]: pgmap v37: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:32:48.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:48.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:48.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:48.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:48.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:48.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:48.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:48.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:48.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:48 trial132 ceph-mon[26888]: from='osd.2 [v2:10.20.193.133:6800/4145071410,v1:10.20.193.133:6801/4145071410]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T03:32:48.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:48 trial132 ceph-mon[26888]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T03:32:48.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:48.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:48.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:48 trial132 ceph-mon[26888]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:32:48.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:48 trial132 ceph-mon[26888]: Cluster is now healthy 2026-02-13T03:32:48.524 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:32:48.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.633+0000 7f09e45486c0 1 -- 10.20.193.96:0/309394939 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f09dc10eed0 msgr2=0x7f09dc10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:48.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.633+0000 7f09e45486c0 1 --2- 10.20.193.96:0/309394939 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f09dc10eed0 0x7f09dc10f2c0 secure :-1 s=READY pgs=153 gs=1 cs=0 l=1 c_cookie=15679585626880370109 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09cc009970 tx=0x7f09cc02ed20 comp rx=0 tx=0).stop 2026-02-13T03:32:48.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.633+0000 7f09e45486c0 1 -- 10.20.193.96:0/309394939 shutdown_connections 2026-02-13T03:32:48.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.633+0000 7f09e45486c0 1 --2- 10.20.193.96:0/309394939 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f09dc110a00 0x7f09dc171390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:48.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.633+0000 7f09e45486c0 1 --2- 10.20.193.96:0/309394939 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f09dc110050 0x7f09dc1104c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:48.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.633+0000 7f09e45486c0 1 --2- 10.20.193.96:0/309394939 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f09dc10eed0 0x7f09dc10f2c0 unknown :-1 s=CLOSED pgs=153 gs=1 cs=0 l=1 c_cookie=15679585626880370109 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:48.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.633+0000 7f09e45486c0 1 -- 10.20.193.96:0/309394939 >> 10.20.193.96:0/309394939 conn(0x7f09dc0ec5f0 msgr2=0x7f09dc10ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:48.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.633+0000 7f09e45486c0 1 -- 10.20.193.96:0/309394939 shutdown_connections 2026-02-13T03:32:48.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.633+0000 7f09e45486c0 1 -- 10.20.193.96:0/309394939 wait complete. 2026-02-13T03:32:48.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.634+0000 7f09e45486c0 1 Processor -- start 2026-02-13T03:32:48.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.634+0000 7f09e45486c0 1 -- start start 2026-02-13T03:32:48.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.634+0000 7f09e45486c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f09dc10eed0 0x7f09dc0f85a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:48.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.634+0000 7f09e45486c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f09dc110050 0x7f09dc171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:48.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.634+0000 7f09e45486c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f09dc110a00 0x7f09dc0f8e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:48.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.634+0000 7f09e45486c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc0f9a30 con 0x7f09dc110050 2026-02-13T03:32:48.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.634+0000 7f09e45486c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc0f9ba0 con 0x7f09dc110a00 2026-02-13T03:32:48.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.634+0000 7f09e45486c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc0f9d60 con 0x7f09dc10eed0 2026-02-13T03:32:48.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.634+0000 7f09e1ab86c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f09dc110050 0x7f09dc171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:48.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.634+0000 7f09e1ab86c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f09dc110050 0x7f09dc171390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:36698/0 (socket says 10.20.193.96:36698) 2026-02-13T03:32:48.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.634+0000 7f09e1ab86c0 1 -- 10.20.193.96:0/3797094159 learned_addr learned my addr 10.20.193.96:0/3797094159 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:32:48.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.634+0000 7f09e2aba6c0 1 --2- 10.20.193.96:0/3797094159 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f09dc110a00 0x7f09dc0f8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:48.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.634+0000 7f09e22b96c0 1 --2- 10.20.193.96:0/3797094159 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f09dc10eed0 0x7f09dc0f85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:48.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.634+0000 7f09e1ab86c0 1 -- 10.20.193.96:0/3797094159 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f09dc10eed0 msgr2=0x7f09dc0f85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:48.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.634+0000 7f09e1ab86c0 1 --2- 10.20.193.96:0/3797094159 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f09dc10eed0 0x7f09dc0f85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:48.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.634+0000 7f09e1ab86c0 1 -- 10.20.193.96:0/3797094159 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f09dc110a00 msgr2=0x7f09dc0f8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:48.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.634+0000 7f09e1ab86c0 1 --2- 10.20.193.96:0/3797094159 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f09dc110a00 0x7f09dc0f8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:48.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.634+0000 7f09e1ab86c0 1 -- 10.20.193.96:0/3797094159 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09cc009590 con 0x7f09dc110050 2026-02-13T03:32:48.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.634+0000 7f09e1ab86c0 1 --2- 10.20.193.96:0/3797094159 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f09dc110050 0x7f09dc171390 secure :-1 s=READY pgs=154 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09d000b6c0 tx=0x7f09d000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:48.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.634+0000 7f09c37fe6c0 1 -- 10.20.193.96:0/3797094159 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f09d00044a0 con 0x7f09dc110050 2026-02-13T03:32:48.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.634+0000 7f09e45486c0 1 -- 10.20.193.96:0/3797094159 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09dc0fa040 con 0x7f09dc110050 2026-02-13T03:32:48.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.634+0000 7f09c37fe6c0 1 -- 10.20.193.96:0/3797094159 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f09d000be50 con 0x7f09dc110050 2026-02-13T03:32:48.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.634+0000 7f09c37fe6c0 1 -- 10.20.193.96:0/3797094159 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f09d000cdc0 con 0x7f09dc110050 2026-02-13T03:32:48.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.634+0000 7f09e45486c0 1 -- 10.20.193.96:0/3797094159 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09dc0fa520 con 0x7f09dc110050 2026-02-13T03:32:48.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.635+0000 7f09e45486c0 1 -- 10.20.193.96:0/3797094159 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09dc175460 con 0x7f09dc110050 2026-02-13T03:32:48.639 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.636+0000 7f09c37fe6c0 1 -- 10.20.193.96:0/3797094159 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 10) ==== 157010+0+0 (secure 0 0 0) 0x7f09d00026b0 con 0x7f09dc110050 2026-02-13T03:32:48.640 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.637+0000 7f09c37fe6c0 1 --2- 10.20.193.96:0/3797094159 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f09b80b55f0 0x7f09b80d5aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:48.640 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.637+0000 7f09e22b96c0 1 --2- 10.20.193.96:0/3797094159 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f09b80b55f0 0x7f09b80d5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:48.640 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.637+0000 7f09c37fe6c0 1 -- 10.20.193.96:0/3797094159 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2221+0+0 (secure 0 0 0) 0x7f09d00e1f60 con 0x7f09dc110050 2026-02-13T03:32:48.640 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.637+0000 7f09c37fe6c0 1 -- 10.20.193.96:0/3797094159 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f09d00a9320 con 0x7f09dc110050 2026-02-13T03:32:48.640 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.637+0000 7f09e22b96c0 1 --2- 10.20.193.96:0/3797094159 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f09b80b55f0 0x7f09b80d5aa0 secure :-1 s=READY pgs=92 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09cc005b40 tx=0x7f09cc0023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:48.735 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:48.732+0000 7f09e45486c0 1 -- 10.20.193.96:0/3797094159 --> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial096:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f09dc0f1440 con 0x7f09b80b55f0 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: pgmap v38: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: pgmap v39: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: osdmap e11: 3 total, 2 up, 3 in 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: from='osd.2 [v2:10.20.193.133:6800/4145071410,v1:10.20.193.133:6801/4145071410]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial133", "root=default"]} : dispatch 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial133", "root=default"]} : dispatch 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial096:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:49 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:49.266 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: pgmap v38: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:32:49.266 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: pgmap v39: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:32:49.266 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:49.266 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T03:32:49.266 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: osdmap e11: 3 total, 2 up, 3 in 2026-02-13T03:32:49.266 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:32:49.266 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: from='osd.2 [v2:10.20.193.133:6800/4145071410,v1:10.20.193.133:6801/4145071410]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial133", "root=default"]} : dispatch 2026-02-13T03:32:49.266 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial133", "root=default"]} : dispatch 2026-02-13T03:32:49.266 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial096:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:32:49.266 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:49.266 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:49.266 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:49.266 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:49.267 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:49.267 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:49.267 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:49.267 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:32:49.267 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:49.267 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:49.267 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:49.267 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:49.267 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:32:49.267 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:49.267 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:49.267 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:49 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:49.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: pgmap v38: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:32:49.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: pgmap v39: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:32:49.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:49.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T03:32:49.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: osdmap e11: 3 total, 2 up, 3 in 2026-02-13T03:32:49.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:32:49.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: from='osd.2 [v2:10.20.193.133:6800/4145071410,v1:10.20.193.133:6801/4145071410]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial133", "root=default"]} : dispatch 2026-02-13T03:32:49.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial133", "root=default"]} : dispatch 2026-02-13T03:32:49.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial096:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:32:49.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:49.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:49.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:49.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:49.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:49.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:49.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:49.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:32:49.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:49.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:49.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:49.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:49.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:32:49.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:49.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:49.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:49 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:49.763 INFO:journalctl@ceph.osd.2.trial133.stdout:Feb 13 03:32:49 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-2[32173]: 2026-02-13T03:32:49.337+0000 7f2c15f1b6c0 -1 osd.2 0 waiting for initial osdmap 2026-02-13T03:32:49.763 INFO:journalctl@ceph.osd.2.trial133.stdout:Feb 13 03:32:49 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-2[32173]: 2026-02-13T03:32:49.339+0000 7f2c11ddf6c0 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:32:50.674 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:50 trial096 ceph-mon[24671]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial133", "root=default"]}]': finished 2026-02-13T03:32:50.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:50 trial096 ceph-mon[24671]: osdmap e12: 3 total, 2 up, 3 in 2026-02-13T03:32:50.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:50 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:32:50.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:50 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:32:50.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:50 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3067359541' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2fb1e80f-f91e-4f43-a277-ae0f650cbbf9"} : dispatch 2026-02-13T03:32:50.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:50 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3067359541' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2fb1e80f-f91e-4f43-a277-ae0f650cbbf9"}]': finished 2026-02-13T03:32:50.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:50 trial096 ceph-mon[24671]: osd.2 [v2:10.20.193.133:6800/4145071410,v1:10.20.193.133:6801/4145071410] boot 2026-02-13T03:32:50.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:50 trial096 ceph-mon[24671]: osdmap e13: 4 total, 3 up, 4 in 2026-02-13T03:32:50.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:50 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:32:50.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:50 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:32:50.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:50 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1996763026' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:32:50.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:50 trial132 ceph-mon[26888]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial133", "root=default"]}]': finished 2026-02-13T03:32:50.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:50 trial132 ceph-mon[26888]: osdmap e12: 3 total, 2 up, 3 in 2026-02-13T03:32:50.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:50 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:32:50.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:50 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:32:50.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:50 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3067359541' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2fb1e80f-f91e-4f43-a277-ae0f650cbbf9"} : dispatch 2026-02-13T03:32:50.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:50 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3067359541' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2fb1e80f-f91e-4f43-a277-ae0f650cbbf9"}]': finished 2026-02-13T03:32:50.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:50 trial132 ceph-mon[26888]: osd.2 [v2:10.20.193.133:6800/4145071410,v1:10.20.193.133:6801/4145071410] boot 2026-02-13T03:32:50.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:50 trial132 ceph-mon[26888]: osdmap e13: 4 total, 3 up, 4 in 2026-02-13T03:32:50.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:50 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:32:50.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:50 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:32:50.734 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:50 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1996763026' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:32:50.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:50 trial133 ceph-mon[26943]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial133", "root=default"]}]': finished 2026-02-13T03:32:50.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:50 trial133 ceph-mon[26943]: osdmap e12: 3 total, 2 up, 3 in 2026-02-13T03:32:50.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:50 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:32:50.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:50 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:32:50.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:50 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3067359541' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2fb1e80f-f91e-4f43-a277-ae0f650cbbf9"} : dispatch 2026-02-13T03:32:50.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:50 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3067359541' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2fb1e80f-f91e-4f43-a277-ae0f650cbbf9"}]': finished 2026-02-13T03:32:50.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:50 trial133 ceph-mon[26943]: osd.2 [v2:10.20.193.133:6800/4145071410,v1:10.20.193.133:6801/4145071410] boot 2026-02-13T03:32:50.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:50 trial133 ceph-mon[26943]: osdmap e13: 4 total, 3 up, 4 in 2026-02-13T03:32:50.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:50 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:32:50.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:50 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:32:50.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:50 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1996763026' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:32:51.538 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:51 trial096 ceph-mon[24671]: purged_snaps scrub starts 2026-02-13T03:32:51.538 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:51 trial096 ceph-mon[24671]: purged_snaps scrub ok 2026-02-13T03:32:51.538 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:51 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T03:32:51.538 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:51 trial096 ceph-mon[24671]: pgmap v44: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:32:51.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:51 trial132 ceph-mon[26888]: purged_snaps scrub starts 2026-02-13T03:32:51.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:51 trial132 ceph-mon[26888]: purged_snaps scrub ok 2026-02-13T03:32:51.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:51 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T03:32:51.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:51 trial132 ceph-mon[26888]: pgmap v44: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:32:51.762 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:51 trial133 ceph-mon[26943]: purged_snaps scrub starts 2026-02-13T03:32:51.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:51 trial133 ceph-mon[26943]: purged_snaps scrub ok 2026-02-13T03:32:51.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:51 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T03:32:51.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:51 trial133 ceph-mon[26943]: pgmap v44: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:32:52.359 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T03:32:52.359 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 ceph-mon[24671]: osdmap e14: 4 total, 3 up, 4 in 2026-02-13T03:32:52.359 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:32:52.359 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T03:32:52.359 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 ceph-mon[24671]: pgmap v46: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:32:52.359 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:52.359 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:52.359 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:52.359 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:52.359 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:52.359 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:52.359 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 ceph-mon[24671]: pgmap v47: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:32:52.359 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:52.359 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:52.359 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:52.360 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T03:32:52.360 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:52.605 INFO:journalctl@ceph.osd.1.trial132.stdout:Feb 13 03:32:52 trial132 sudo[34958]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T03:32:52.605 INFO:journalctl@ceph.osd.1.trial132.stdout:Feb 13 03:32:52 trial132 sudo[34958]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:32:52.605 INFO:journalctl@ceph.osd.1.trial132.stdout:Feb 13 03:32:52 trial132 sudo[34958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:32:52.605 INFO:journalctl@ceph.osd.1.trial132.stdout:Feb 13 03:32:52 trial132 sudo[34958]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:32:52.605 INFO:journalctl@ceph.osd.1.trial132.stdout:Feb 13 03:32:52 trial132 sudo[34962]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T03:32:52.605 INFO:journalctl@ceph.osd.1.trial132.stdout:Feb 13 03:32:52 trial132 sudo[34962]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:32:52.606 INFO:journalctl@ceph.osd.1.trial132.stdout:Feb 13 03:32:52 trial132 sudo[34962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:32:52.606 INFO:journalctl@ceph.osd.1.trial132.stdout:Feb 13 03:32:52 trial132 sudo[34962]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:32:52.606 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T03:32:52.606 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 ceph-mon[26888]: osdmap e14: 4 total, 3 up, 4 in 2026-02-13T03:32:52.606 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:32:52.606 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T03:32:52.606 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 ceph-mon[26888]: pgmap v46: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:32:52.606 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:52.606 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:52.607 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:52.607 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:52.607 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:52.607 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:52.607 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 ceph-mon[26888]: pgmap v47: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:32:52.607 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:52.607 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:52.607 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:52.607 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T03:32:52.607 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:52.650 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 sudo[42712]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-13T03:32:52.650 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 sudo[42712]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:32:52.650 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 sudo[42712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:32:52.650 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 sudo[42712]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:32:52.650 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 sudo[42722]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-13T03:32:52.650 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 sudo[42722]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:32:52.651 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 sudo[42722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:32:52.651 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:52 trial096 sudo[42722]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:32:52.651 INFO:journalctl@ceph.osd.0.trial096.stdout:Feb 13 03:32:52 trial096 sudo[42681]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T03:32:52.651 INFO:journalctl@ceph.osd.0.trial096.stdout:Feb 13 03:32:52 trial096 sudo[42681]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:32:52.651 INFO:journalctl@ceph.osd.0.trial096.stdout:Feb 13 03:32:52 trial096 sudo[42681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:32:52.651 INFO:journalctl@ceph.osd.0.trial096.stdout:Feb 13 03:32:52 trial096 sudo[42681]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:32:52.651 INFO:journalctl@ceph.osd.0.trial096.stdout:Feb 13 03:32:52 trial096 sudo[42685]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T03:32:52.651 INFO:journalctl@ceph.osd.0.trial096.stdout:Feb 13 03:32:52 trial096 sudo[42685]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:32:52.651 INFO:journalctl@ceph.osd.0.trial096.stdout:Feb 13 03:32:52 trial096 sudo[42685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:32:52.652 INFO:journalctl@ceph.osd.0.trial096.stdout:Feb 13 03:32:52 trial096 sudo[42685]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:32:52.763 INFO:journalctl@ceph.osd.2.trial133.stdout:Feb 13 03:32:52 trial133 sudo[35188]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T03:32:52.763 INFO:journalctl@ceph.osd.2.trial133.stdout:Feb 13 03:32:52 trial133 sudo[35188]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:32:52.763 INFO:journalctl@ceph.osd.2.trial133.stdout:Feb 13 03:32:52 trial133 sudo[35188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:32:52.763 INFO:journalctl@ceph.osd.2.trial133.stdout:Feb 13 03:32:52 trial133 sudo[35188]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:32:52.763 INFO:journalctl@ceph.osd.2.trial133.stdout:Feb 13 03:32:52 trial133 sudo[35192]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T03:32:52.763 INFO:journalctl@ceph.osd.2.trial133.stdout:Feb 13 03:32:52 trial133 sudo[35192]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:32:52.764 INFO:journalctl@ceph.osd.2.trial133.stdout:Feb 13 03:32:52 trial133 sudo[35192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:32:52.764 INFO:journalctl@ceph.osd.2.trial133.stdout:Feb 13 03:32:52 trial133 sudo[35192]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:32:52.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T03:32:52.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 ceph-mon[26943]: osdmap e14: 4 total, 3 up, 4 in 2026-02-13T03:32:52.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:32:52.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T03:32:52.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 ceph-mon[26943]: pgmap v46: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:32:52.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:52.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:52.765 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:52.765 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:52.765 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:52.765 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:52.765 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 ceph-mon[26943]: pgmap v47: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:32:52.765 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:52.765 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:52.765 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:52.765 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T03:32:52.765 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:52.765 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 sudo[35196]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-13T03:32:52.765 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 sudo[35196]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:32:52.766 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 sudo[35196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:32:52.766 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 sudo[35196]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:32:52.766 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 sudo[35200]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-13T03:32:52.766 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 sudo[35200]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:32:52.766 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 sudo[35200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:32:52.766 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:52 trial133 sudo[35200]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:32:52.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 sudo[34966]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-13T03:32:52.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 sudo[34966]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:32:52.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 sudo[34966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:32:52.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 sudo[34966]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:32:52.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 sudo[34970]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-13T03:32:52.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 sudo[34970]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:32:52.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 sudo[34970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:32:52.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:52 trial132 sudo[34970]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:32:53.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: pgmap v48: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:32:53.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:32:53.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T03:32:53.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: osdmap e15: 4 total, 3 up, 4 in 2026-02-13T03:32:53.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:32:53.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:53.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:53.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:53.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:32:53.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:32:53.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:32:53.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:53.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:53.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:53.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:32:53.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:32:53.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:53.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:53.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:32:53.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:53.677 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:32:53.677 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:53.677 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:53.677 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:32:53.677 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:53.677 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:53 trial096 ceph-mon[24671]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: pgmap v48: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: osdmap e15: 4 total, 3 up, 4 in 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:53.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:53 trial132 ceph-mon[26888]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: pgmap v48: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: osdmap e15: 4 total, 3 up, 4 in 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:53.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:53 trial133 ceph-mon[26943]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:32:54.361 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:54.356+0000 7f09c37fe6c0 1 -- 10.20.193.96:0/3797094159 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f09d00a5e20 con 0x7f09dc110050 2026-02-13T03:32:54.610 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:54 trial096 ceph-mon[24671]: osdmap e16: 4 total, 3 up, 4 in 2026-02-13T03:32:54.610 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:54 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:32:54.610 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:54 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:54.610 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:54 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:54.610 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:54 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:54.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:54 trial132 ceph-mon[26888]: osdmap e16: 4 total, 3 up, 4 in 2026-02-13T03:32:54.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:54 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:32:54.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:54 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:54.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:54 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:54.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:54 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:54.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:54 trial133 ceph-mon[26943]: osdmap e16: 4 total, 3 up, 4 in 2026-02-13T03:32:54.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:54 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:32:54.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:54 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:54.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:54 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:54.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:54 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:55.156 INFO:teuthology.orchestra.run.trial096.stdout:Created osd(s) 3 on host 'trial096' 2026-02-13T03:32:55.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:55.152+0000 7f09c37fe6c0 1 -- 10.20.193.96:0/3797094159 <== mgr.14116 v2:10.20.193.96:6800/1736050816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f09dc0f1440 con 0x7f09b80b55f0 2026-02-13T03:32:55.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:55.155+0000 7f09e45486c0 1 -- 10.20.193.96:0/3797094159 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f09b80b55f0 msgr2=0x7f09b80d5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:55.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:55.155+0000 7f09e45486c0 1 --2- 10.20.193.96:0/3797094159 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f09b80b55f0 0x7f09b80d5aa0 secure :-1 s=READY pgs=92 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09cc005b40 tx=0x7f09cc0023a0 comp rx=0 tx=0).stop 2026-02-13T03:32:55.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:55.155+0000 7f09e45486c0 1 -- 10.20.193.96:0/3797094159 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f09dc110050 msgr2=0x7f09dc171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:55.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:55.155+0000 7f09e45486c0 1 --2- 10.20.193.96:0/3797094159 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f09dc110050 0x7f09dc171390 secure :-1 s=READY pgs=154 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09d000b6c0 tx=0x7f09d000bb90 comp rx=0 tx=0).stop 2026-02-13T03:32:55.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:55.155+0000 7f09e45486c0 1 -- 10.20.193.96:0/3797094159 shutdown_connections 2026-02-13T03:32:55.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:55.155+0000 7f09e45486c0 1 --2- 10.20.193.96:0/3797094159 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f09b80b55f0 0x7f09b80d5aa0 unknown :-1 s=CLOSED pgs=92 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:55.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:55.155+0000 7f09e45486c0 1 --2- 10.20.193.96:0/3797094159 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f09dc110a00 0x7f09dc0f8e00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:55.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:55.155+0000 7f09e45486c0 1 --2- 10.20.193.96:0/3797094159 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f09dc110050 0x7f09dc171390 unknown :-1 s=CLOSED pgs=154 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:55.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:55.155+0000 7f09e45486c0 1 --2- 10.20.193.96:0/3797094159 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f09dc10eed0 0x7f09dc0f85a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:55.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:55.155+0000 7f09e45486c0 1 -- 10.20.193.96:0/3797094159 >> 10.20.193.96:0/3797094159 conn(0x7f09dc0ec5f0 msgr2=0x7f09dc0eeb30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:55.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:55.155+0000 7f09e45486c0 1 -- 10.20.193.96:0/3797094159 shutdown_connections 2026-02-13T03:32:55.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:32:55.155+0000 7f09e45486c0 1 -- 10.20.193.96:0/3797094159 wait complete. 2026-02-13T03:32:55.201 DEBUG:teuthology.orchestra.run.trial096:osd.3> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.3.service 2026-02-13T03:32:55.203 INFO:tasks.cephadm:Deploying osd.4 on trial132 with /dev/vg_nvme/lv_3... 2026-02-13T03:32:55.204 DEBUG:teuthology.orchestra.run.trial132:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T03:32:55.325 INFO:teuthology.orchestra.run.trial132.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.b/config 2026-02-13T03:32:55.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:55 trial132 ceph-mon[26888]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:32:55.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:55 trial132 ceph-mon[26888]: mgrmap e11: x(active, since 62s), standbys: z, y 2026-02-13T03:32:55.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:55 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:55.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:55 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:55.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:55 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:55.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:55 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:55.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:55 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:55.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:55 trial132 ceph-mon[26888]: pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:32:55.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:55 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:55.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:55 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:55.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:55 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:55.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:55 trial132 ceph-mon[26888]: from='osd.3 [v2:10.20.193.96:6810/2289717362,v1:10.20.193.96:6811/2289717362]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T03:32:55.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:55 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:55.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:55 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:55.674 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:55 trial096 ceph-mon[24671]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:32:55.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:55 trial096 ceph-mon[24671]: mgrmap e11: x(active, since 62s), standbys: z, y 2026-02-13T03:32:55.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:55 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:55.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:55 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:55.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:55 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:55.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:55 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:55.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:55 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:55.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:55 trial096 ceph-mon[24671]: pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:32:55.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:55 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:55.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:55 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:55.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:55 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:55.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:55 trial096 ceph-mon[24671]: from='osd.3 [v2:10.20.193.96:6810/2289717362,v1:10.20.193.96:6811/2289717362]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T03:32:55.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:55 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:55.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:55 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:55.759 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:32:55.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:55 trial133 ceph-mon[26943]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:32:55.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:55 trial133 ceph-mon[26943]: mgrmap e11: x(active, since 62s), standbys: z, y 2026-02-13T03:32:55.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:55 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:55.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:55 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:55.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:55 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:55.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:55 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:55.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:55 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:55.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:55 trial133 ceph-mon[26943]: pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:32:55.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:55 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:55.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:55 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:55.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:55 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:55.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:55 trial133 ceph-mon[26943]: from='osd.3 [v2:10.20.193.96:6810/2289717362,v1:10.20.193.96:6811/2289717362]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T03:32:55.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:55 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:55.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:55 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:55.777 DEBUG:teuthology.orchestra.run.trial132:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph orch daemon add osd trial132:vg_nvme/lv_3 --skip-validation 2026-02-13T03:32:55.894 INFO:teuthology.orchestra.run.trial132.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.b/config 2026-02-13T03:32:56.015 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.021+0000 7fd10aea06c0 1 -- 10.20.193.132:0/3964826630 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd104110a00 msgr2=0x7fd104171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:56.015 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.021+0000 7fd10aea06c0 1 --2- 10.20.193.132:0/3964826630 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd104110a00 0x7fd104171390 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=6827575914871948736 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd10000aa40 tx=0x7fd10002fde0 comp rx=0 tx=0).stop 2026-02-13T03:32:56.015 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd10aea06c0 1 -- 10.20.193.132:0/3964826630 shutdown_connections 2026-02-13T03:32:56.016 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd10aea06c0 1 --2- 10.20.193.132:0/3964826630 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd104110a00 0x7fd104171390 unknown :-1 s=CLOSED pgs=16 gs=1 cs=0 l=1 c_cookie=6827575914871948736 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:56.016 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd10aea06c0 1 --2- 10.20.193.132:0/3964826630 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd104110050 0x7fd1041104c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:56.016 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd10aea06c0 1 --2- 10.20.193.132:0/3964826630 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd10410eed0 0x7fd10410f2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:56.016 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd10aea06c0 1 -- 10.20.193.132:0/3964826630 >> 10.20.193.132:0/3964826630 conn(0x7fd1040ec5f0 msgr2=0x7fd10410ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:32:56.016 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd10aea06c0 1 -- 10.20.193.132:0/3964826630 shutdown_connections 2026-02-13T03:32:56.016 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd10aea06c0 1 -- 10.20.193.132:0/3964826630 wait complete. 2026-02-13T03:32:56.016 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd10aea06c0 1 Processor -- start 2026-02-13T03:32:56.016 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd10aea06c0 1 -- start start 2026-02-13T03:32:56.016 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd10aea06c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd10410eed0 0x7fd1040f8ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:56.016 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd10aea06c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd104110050 0x7fd104171370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:56.016 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd10aea06c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd104110a00 0x7fd1040f9730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:56.017 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd10aea06c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd1040fa380 con 0x7fd10410eed0 2026-02-13T03:32:56.017 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd10aea06c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd1040fa4f0 con 0x7fd104110050 2026-02-13T03:32:56.017 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd10aea06c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd1040fa6b0 con 0x7fd104110a00 2026-02-13T03:32:56.017 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd0fbfff6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd104110050 0x7fd104171370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:56.017 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd0fbfff6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd104110050 0x7fd104171370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.132:3300/0 says I am v2:10.20.193.132:55366/0 (socket says 10.20.193.132:55366) 2026-02-13T03:32:56.017 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd0fbfff6c0 1 -- 10.20.193.132:0/4048004753 learned_addr learned my addr 10.20.193.132:0/4048004753 (peer_addr_for_me v2:10.20.193.132:0/0) 2026-02-13T03:32:56.017 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd0fbfff6c0 1 -- 10.20.193.132:0/4048004753 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd104110a00 msgr2=0x7fd1040f9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:56.017 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd0fbfff6c0 1 --2- 10.20.193.132:0/4048004753 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd104110a00 0x7fd1040f9730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:56.017 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd0fbfff6c0 1 -- 10.20.193.132:0/4048004753 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd10410eed0 msgr2=0x7fd1040f8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:32:56.017 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd0fbfff6c0 1 --2- 10.20.193.132:0/4048004753 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd10410eed0 0x7fd1040f8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:32:56.017 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd0fbfff6c0 1 -- 10.20.193.132:0/4048004753 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd10000a660 con 0x7fd104110050 2026-02-13T03:32:56.017 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd0fbfff6c0 1 --2- 10.20.193.132:0/4048004753 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd104110050 0x7fd104171370 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0ec009490 tx=0x7fd0ec00bca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:56.018 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd0f9ffb6c0 1 -- 10.20.193.132:0/4048004753 <== mon.2 v2:10.20.193.132:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0ec004a80 con 0x7fd104110050 2026-02-13T03:32:56.018 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd0f9ffb6c0 1 -- 10.20.193.132:0/4048004753 <== mon.2 v2:10.20.193.132:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fd0ec009030 con 0x7fd104110050 2026-02-13T03:32:56.018 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd10aea06c0 1 -- 10.20.193.132:0/4048004753 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1040fa930 con 0x7fd104110050 2026-02-13T03:32:56.018 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.022+0000 7fd0f9ffb6c0 1 -- 10.20.193.132:0/4048004753 <== mon.2 v2:10.20.193.132:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0ec00cea0 con 0x7fd104110050 2026-02-13T03:32:56.018 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.023+0000 7fd10aea06c0 1 -- 10.20.193.132:0/4048004753 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1040fae60 con 0x7fd104110050 2026-02-13T03:32:56.018 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.023+0000 7fd10aea06c0 1 -- 10.20.193.132:0/4048004753 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1041753e0 con 0x7fd104110050 2026-02-13T03:32:56.019 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.024+0000 7fd0f9ffb6c0 1 -- 10.20.193.132:0/4048004753 <== mon.2 v2:10.20.193.132:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7fd0ec004060 con 0x7fd104110050 2026-02-13T03:32:56.019 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.025+0000 7fd0f9ffb6c0 1 --2- 10.20.193.132:0/4048004753 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd0e00b5680 0x7fd0e00d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:32:56.019 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.025+0000 7fd108c116c0 1 --2- 10.20.193.132:0/4048004753 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd0e00b5680 0x7fd0e00d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:32:56.019 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.025+0000 7fd0f9ffb6c0 1 -- 10.20.193.132:0/4048004753 <== mon.2 v2:10.20.193.132:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3150+0+0 (secure 0 0 0) 0x7fd0ec0e27a0 con 0x7fd104110050 2026-02-13T03:32:56.019 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.025+0000 7fd108c116c0 1 --2- 10.20.193.132:0/4048004753 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd0e00b5680 0x7fd0e00d5b30 secure :-1 s=READY pgs=98 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0f4005980 tx=0x7fd0f4005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:32:56.020 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.026+0000 7fd0f9ffb6c0 1 -- 10.20.193.132:0/4048004753 <== mon.2 v2:10.20.193.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd0ec0a6530 con 0x7fd104110050 2026-02-13T03:32:56.113 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:32:56.122+0000 7fd10aea06c0 1 -- 10.20.193.132:0/4048004753 --> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial132:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fd1040f1e60 con 0x7fd0e00b5680 2026-02-13T03:32:56.608 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:56 trial132 ceph-mon[26888]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:32:56.609 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:56 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:56.609 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:56 trial132 ceph-mon[26888]: from='osd.3 [v2:10.20.193.96:6810/2289717362,v1:10.20.193.96:6811/2289717362]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T03:32:56.609 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:56 trial132 ceph-mon[26888]: osdmap e17: 4 total, 3 up, 4 in 2026-02-13T03:32:56.609 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:56 trial132 ceph-mon[26888]: from='osd.3 [v2:10.20.193.96:6810/2289717362,v1:10.20.193.96:6811/2289717362]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial096", "root=default"]} : dispatch 2026-02-13T03:32:56.609 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:56 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:32:56.609 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:56 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:56.609 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:56 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:56.609 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:56 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:56.609 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:56 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:56.610 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:56 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:56.610 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:56 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:56.610 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:56 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:56.610 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:56 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:32:56.610 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:56 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T03:32:56.610 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:56 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:56.610 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:56 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:56.610 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:56 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:56.610 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:56 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:56.610 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:56 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:56.610 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:56 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:56.610 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:56 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:56.674 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:56 trial096 ceph-mon[24671]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:32:56.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:56 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:56.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:56 trial096 ceph-mon[24671]: from='osd.3 [v2:10.20.193.96:6810/2289717362,v1:10.20.193.96:6811/2289717362]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T03:32:56.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:56 trial096 ceph-mon[24671]: osdmap e17: 4 total, 3 up, 4 in 2026-02-13T03:32:56.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:56 trial096 ceph-mon[24671]: from='osd.3 [v2:10.20.193.96:6810/2289717362,v1:10.20.193.96:6811/2289717362]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial096", "root=default"]} : dispatch 2026-02-13T03:32:56.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:56 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:32:56.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:56 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:56.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:56 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:56.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:56 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:56.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:56 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:56.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:56 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:56.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:56 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:56.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:56 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:56.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:56 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:32:56.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:56 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T03:32:56.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:56 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:56.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:56 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:56.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:56 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:56.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:56 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:56.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:56 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:56.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:56 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:56.676 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:56 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:56.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:56 trial133 ceph-mon[26943]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:32:56.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:56 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:56.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:56 trial133 ceph-mon[26943]: from='osd.3 [v2:10.20.193.96:6810/2289717362,v1:10.20.193.96:6811/2289717362]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T03:32:56.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:56 trial133 ceph-mon[26943]: osdmap e17: 4 total, 3 up, 4 in 2026-02-13T03:32:56.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:56 trial133 ceph-mon[26943]: from='osd.3 [v2:10.20.193.96:6810/2289717362,v1:10.20.193.96:6811/2289717362]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial096", "root=default"]} : dispatch 2026-02-13T03:32:56.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:56 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:32:56.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:56 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:56.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:56 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:56.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:56 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:56.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:56 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:56.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:56 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:56.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:56 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:56.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:56 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:56.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:56 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:32:56.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:56 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T03:32:56.765 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:56 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:56.765 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:56 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:56.765 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:56 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:32:56.765 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:56 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:56.765 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:56 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:32:56.765 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:56 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:32:56.765 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:56 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:32:57.175 INFO:journalctl@ceph.osd.3.trial096.stdout:Feb 13 03:32:56 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-3[43162]: 2026-02-13T03:32:56.778+0000 7fb7c12446c0 -1 osd.3 0 waiting for initial osdmap 2026-02-13T03:32:57.175 INFO:journalctl@ceph.osd.3.trial096.stdout:Feb 13 03:32:56 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-3[43162]: 2026-02-13T03:32:56.781+0000 7fb7bd1086c0 -1 osd.3 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:32:58.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:57 trial096 ceph-mon[24671]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial132:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:32:58.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:57 trial096 ceph-mon[24671]: pgmap v55: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:32:58.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:57 trial096 ceph-mon[24671]: from='osd.3 [v2:10.20.193.96:6810/2289717362,v1:10.20.193.96:6811/2289717362]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial096", "root=default"]}]': finished 2026-02-13T03:32:58.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:57 trial096 ceph-mon[24671]: osdmap e18: 4 total, 3 up, 4 in 2026-02-13T03:32:58.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:57 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:32:58.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:57 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:32:58.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:57 trial096 ceph-mon[24671]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fc59010d-7a40-47e0-8111-85c564c60c27"} : dispatch 2026-02-13T03:32:58.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:57 trial096 ceph-mon[24671]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc59010d-7a40-47e0-8111-85c564c60c27"}]': finished 2026-02-13T03:32:58.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:57 trial096 ceph-mon[24671]: osd.3 [v2:10.20.193.96:6810/2289717362,v1:10.20.193.96:6811/2289717362] boot 2026-02-13T03:32:58.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:57 trial096 ceph-mon[24671]: osdmap e19: 5 total, 4 up, 5 in 2026-02-13T03:32:58.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:57 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:32:58.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:57 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:32:58.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:57 trial096 ceph-mon[24671]: from='client.? 10.20.193.132:0/3176239900' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fc59010d-7a40-47e0-8111-85c564c60c27"} : dispatch 2026-02-13T03:32:58.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:57 trial096 ceph-mon[24671]: from='client.? 10.20.193.132:0/4258674233' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:32:58.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:57 trial096 ceph-mon[24671]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:32:58.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:57 trial096 ceph-mon[24671]: Cluster is now healthy 2026-02-13T03:32:58.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:57 trial132 ceph-mon[26888]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial132:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:32:58.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:57 trial132 ceph-mon[26888]: pgmap v55: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:32:58.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:57 trial132 ceph-mon[26888]: from='osd.3 [v2:10.20.193.96:6810/2289717362,v1:10.20.193.96:6811/2289717362]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial096", "root=default"]}]': finished 2026-02-13T03:32:58.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:57 trial132 ceph-mon[26888]: osdmap e18: 4 total, 3 up, 4 in 2026-02-13T03:32:58.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:57 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:32:58.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:57 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:32:58.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:57 trial132 ceph-mon[26888]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fc59010d-7a40-47e0-8111-85c564c60c27"} : dispatch 2026-02-13T03:32:58.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:57 trial132 ceph-mon[26888]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc59010d-7a40-47e0-8111-85c564c60c27"}]': finished 2026-02-13T03:32:58.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:57 trial132 ceph-mon[26888]: osd.3 [v2:10.20.193.96:6810/2289717362,v1:10.20.193.96:6811/2289717362] boot 2026-02-13T03:32:58.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:57 trial132 ceph-mon[26888]: osdmap e19: 5 total, 4 up, 5 in 2026-02-13T03:32:58.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:57 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:32:58.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:57 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:32:58.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:57 trial132 ceph-mon[26888]: from='client.? 10.20.193.132:0/3176239900' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fc59010d-7a40-47e0-8111-85c564c60c27"} : dispatch 2026-02-13T03:32:58.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:57 trial132 ceph-mon[26888]: from='client.? 10.20.193.132:0/4258674233' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:32:58.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:57 trial132 ceph-mon[26888]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:32:58.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:57 trial132 ceph-mon[26888]: Cluster is now healthy 2026-02-13T03:32:58.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:57 trial133 ceph-mon[26943]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial132:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:32:58.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:57 trial133 ceph-mon[26943]: pgmap v55: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:32:58.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:57 trial133 ceph-mon[26943]: from='osd.3 [v2:10.20.193.96:6810/2289717362,v1:10.20.193.96:6811/2289717362]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial096", "root=default"]}]': finished 2026-02-13T03:32:58.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:57 trial133 ceph-mon[26943]: osdmap e18: 4 total, 3 up, 4 in 2026-02-13T03:32:58.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:57 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:32:58.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:57 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:32:58.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:57 trial133 ceph-mon[26943]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fc59010d-7a40-47e0-8111-85c564c60c27"} : dispatch 2026-02-13T03:32:58.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:57 trial133 ceph-mon[26943]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc59010d-7a40-47e0-8111-85c564c60c27"}]': finished 2026-02-13T03:32:58.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:57 trial133 ceph-mon[26943]: osd.3 [v2:10.20.193.96:6810/2289717362,v1:10.20.193.96:6811/2289717362] boot 2026-02-13T03:32:58.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:57 trial133 ceph-mon[26943]: osdmap e19: 5 total, 4 up, 5 in 2026-02-13T03:32:58.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:57 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:32:58.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:57 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:32:58.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:57 trial133 ceph-mon[26943]: from='client.? 10.20.193.132:0/3176239900' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fc59010d-7a40-47e0-8111-85c564c60c27"} : dispatch 2026-02-13T03:32:58.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:57 trial133 ceph-mon[26943]: from='client.? 10.20.193.132:0/4258674233' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:32:58.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:57 trial133 ceph-mon[26943]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:32:58.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:57 trial133 ceph-mon[26943]: Cluster is now healthy 2026-02-13T03:32:58.929 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:58 trial132 ceph-mon[26888]: purged_snaps scrub starts 2026-02-13T03:32:58.929 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:58 trial132 ceph-mon[26888]: purged_snaps scrub ok 2026-02-13T03:32:58.929 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:58 trial132 ceph-mon[26888]: osdmap e20: 5 total, 4 up, 5 in 2026-02-13T03:32:58.929 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:58 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:32:58.929 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:58 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:58.930 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:58 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:58.930 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:58 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:59.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:58 trial133 ceph-mon[26943]: purged_snaps scrub starts 2026-02-13T03:32:59.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:58 trial133 ceph-mon[26943]: purged_snaps scrub ok 2026-02-13T03:32:59.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:58 trial133 ceph-mon[26943]: osdmap e20: 5 total, 4 up, 5 in 2026-02-13T03:32:59.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:58 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:32:59.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:58 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:59.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:58 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:59.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:58 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:59.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:58 trial096 ceph-mon[24671]: purged_snaps scrub starts 2026-02-13T03:32:59.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:58 trial096 ceph-mon[24671]: purged_snaps scrub ok 2026-02-13T03:32:59.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:58 trial096 ceph-mon[24671]: osdmap e20: 5 total, 4 up, 5 in 2026-02-13T03:32:59.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:58 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:32:59.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:58 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:32:59.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:58 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:32:59.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:58 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:00.007 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:59 trial132 ceph-mon[26888]: pgmap v59: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:33:00.007 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:59 trial132 ceph-mon[26888]: pgmap v60: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:33:00.007 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:59 trial132 ceph-mon[26888]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:00.008 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:59 trial132 ceph-mon[26888]: osdmap e21: 5 total, 4 up, 5 in 2026-02-13T03:33:00.008 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:59 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:33:00.008 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:59 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T03:33:00.008 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:59 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:00.008 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:59 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:00.008 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:59 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:00.008 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:59 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:00.008 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:59 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:00.008 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:59 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:00.009 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:32:59 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:00.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:59 trial133 ceph-mon[26943]: pgmap v59: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:33:00.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:59 trial133 ceph-mon[26943]: pgmap v60: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:33:00.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:59 trial133 ceph-mon[26943]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:00.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:59 trial133 ceph-mon[26943]: osdmap e21: 5 total, 4 up, 5 in 2026-02-13T03:33:00.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:59 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:33:00.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:59 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T03:33:00.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:59 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:00.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:59 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:00.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:59 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:00.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:59 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:00.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:59 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:00.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:59 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:00.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:32:59 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:00.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:59 trial096 ceph-mon[24671]: pgmap v59: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:33:00.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:59 trial096 ceph-mon[24671]: pgmap v60: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:33:00.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:59 trial096 ceph-mon[24671]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:00.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:59 trial096 ceph-mon[24671]: osdmap e21: 5 total, 4 up, 5 in 2026-02-13T03:33:00.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:59 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:33:00.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:59 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T03:33:00.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:59 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:00.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:59 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:00.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:59 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:00.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:59 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:00.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:59 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:00.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:59 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:00.426 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:32:59 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:01.207 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:00 trial132 ceph-mon[26888]: pgmap v62: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:33:01.207 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:00 trial132 ceph-mon[26888]: osdmap e22: 5 total, 4 up, 5 in 2026-02-13T03:33:01.207 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:00 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:33:01.208 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:00 trial132 ceph-mon[26888]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:01.208 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:00 trial132 ceph-mon[26888]: Cluster is now healthy 2026-02-13T03:33:01.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:00 trial133 ceph-mon[26943]: pgmap v62: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:33:01.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:00 trial133 ceph-mon[26943]: osdmap e22: 5 total, 4 up, 5 in 2026-02-13T03:33:01.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:00 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:33:01.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:00 trial133 ceph-mon[26943]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:01.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:00 trial133 ceph-mon[26943]: Cluster is now healthy 2026-02-13T03:33:01.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:00 trial096 ceph-mon[24671]: pgmap v62: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:33:01.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:00 trial096 ceph-mon[24671]: osdmap e22: 5 total, 4 up, 5 in 2026-02-13T03:33:01.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:00 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:33:01.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:00 trial096 ceph-mon[24671]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:01.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:00 trial096 ceph-mon[24671]: Cluster is now healthy 2026-02-13T03:33:01.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:01 trial132 ceph-mon[26888]: osdmap e23: 5 total, 4 up, 5 in 2026-02-13T03:33:01.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:01 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:33:01.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:01 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:01.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:01 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:01.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:01 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:02.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:01 trial133 ceph-mon[26943]: osdmap e23: 5 total, 4 up, 5 in 2026-02-13T03:33:02.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:01 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:33:02.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:01 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:02.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:01 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:02.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:01 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:02.406 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:02.415+0000 7fd0f9ffb6c0 1 -- 10.20.193.132:0/4048004753 <== mgr.14116 v2:10.20.193.96:6800/1736050816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fd1040f1e60 con 0x7fd0e00b5680 2026-02-13T03:33:02.406 INFO:teuthology.orchestra.run.trial132.stdout:Created osd(s) 4 on host 'trial132' 2026-02-13T03:33:02.409 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:02.417+0000 7fd10aea06c0 1 -- 10.20.193.132:0/4048004753 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd0e00b5680 msgr2=0x7fd0e00d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:02.409 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:02.417+0000 7fd10aea06c0 1 --2- 10.20.193.132:0/4048004753 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd0e00b5680 0x7fd0e00d5b30 secure :-1 s=READY pgs=98 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0f4005980 tx=0x7fd0f4005910 comp rx=0 tx=0).stop 2026-02-13T03:33:02.409 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:02.417+0000 7fd10aea06c0 1 -- 10.20.193.132:0/4048004753 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd104110050 msgr2=0x7fd104171370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:02.409 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:02.417+0000 7fd10aea06c0 1 --2- 10.20.193.132:0/4048004753 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd104110050 0x7fd104171370 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0ec009490 tx=0x7fd0ec00bca0 comp rx=0 tx=0).stop 2026-02-13T03:33:02.409 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:02.417+0000 7fd10aea06c0 1 -- 10.20.193.132:0/4048004753 shutdown_connections 2026-02-13T03:33:02.409 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:02.417+0000 7fd10aea06c0 1 --2- 10.20.193.132:0/4048004753 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd0e00b5680 0x7fd0e00d5b30 unknown :-1 s=CLOSED pgs=98 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:02.409 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:02.417+0000 7fd10aea06c0 1 --2- 10.20.193.132:0/4048004753 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd104110a00 0x7fd1040f9730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:02.409 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:02.417+0000 7fd10aea06c0 1 --2- 10.20.193.132:0/4048004753 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd104110050 0x7fd104171370 unknown :-1 s=CLOSED pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:02.409 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:02.417+0000 7fd10aea06c0 1 --2- 10.20.193.132:0/4048004753 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd10410eed0 0x7fd1040f8ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:02.409 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:02.417+0000 7fd10aea06c0 1 -- 10.20.193.132:0/4048004753 >> 10.20.193.132:0/4048004753 conn(0x7fd1040ec5f0 msgr2=0x7fd1040ef4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:02.409 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:02.417+0000 7fd10aea06c0 1 -- 10.20.193.132:0/4048004753 shutdown_connections 2026-02-13T03:33:02.409 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:02.418+0000 7fd10aea06c0 1 -- 10.20.193.132:0/4048004753 wait complete. 2026-02-13T03:33:02.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:01 trial096 ceph-mon[24671]: osdmap e23: 5 total, 4 up, 5 in 2026-02-13T03:33:02.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:01 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:33:02.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:01 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:02.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:01 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:02.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:01 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:02.449 DEBUG:teuthology.orchestra.run.trial132:osd.4> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.4.service 2026-02-13T03:33:02.451 INFO:tasks.cephadm:Deploying osd.5 on trial133 with /dev/vg_nvme/lv_3... 2026-02-13T03:33:02.451 DEBUG:teuthology.orchestra.run.trial133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T03:33:02.571 INFO:teuthology.orchestra.run.trial133.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.c/config 2026-02-13T03:33:03.010 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:33:03.026 DEBUG:teuthology.orchestra.run.trial133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph orch daemon add osd trial133:vg_nvme/lv_3 --skip-validation 2026-02-13T03:33:03.048 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:02 trial133 ceph-mon[26943]: pgmap v65: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:33:03.049 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:02 trial133 ceph-mon[26943]: pgmap v66: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:33:03.049 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:02 trial133 ceph-mon[26943]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:03.049 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:02 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:03.049 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:02 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:03.049 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:02 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:03.049 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:02 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:03.049 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:02 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:03.049 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:02 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:03.049 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:02 trial133 ceph-mon[26943]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T03:33:03.049 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:02 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:03.049 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:02 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:03.050 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:02 trial133 ceph-mon[26943]: from='osd.4 [v2:10.20.193.132:6808/421645986,v1:10.20.193.132:6809/421645986]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T03:33:03.050 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:02 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:03.050 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:02 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:03.143 INFO:teuthology.orchestra.run.trial133.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.c/config 2026-02-13T03:33:03.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:02 trial132 ceph-mon[26888]: pgmap v65: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:33:03.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:02 trial132 ceph-mon[26888]: pgmap v66: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:33:03.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:02 trial132 ceph-mon[26888]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:03.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:02 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:03.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:02 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:03.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:02 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:03.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:02 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:03.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:02 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:03.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:02 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:03.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:02 trial132 ceph-mon[26888]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T03:33:03.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:02 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:03.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:02 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:03.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:02 trial132 ceph-mon[26888]: from='osd.4 [v2:10.20.193.132:6808/421645986,v1:10.20.193.132:6809/421645986]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T03:33:03.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:02 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:03.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:02 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:03.263 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.258+0000 7f471a0556c0 1 -- 10.20.193.133:0/2099554171 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f47141109f0 msgr2=0x7f4714171380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:03.263 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.258+0000 7f471a0556c0 1 --2- 10.20.193.133:0/2099554171 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f47141109f0 0x7f4714171380 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=12299714905051063339 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f470800aa40 tx=0x7f470802fde0 comp rx=0 tx=0).stop 2026-02-13T03:33:03.264 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.258+0000 7f471a0556c0 1 -- 10.20.193.133:0/2099554171 shutdown_connections 2026-02-13T03:33:03.264 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.258+0000 7f471a0556c0 1 --2- 10.20.193.133:0/2099554171 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f47141109f0 0x7f4714171380 unknown :-1 s=CLOSED pgs=16 gs=1 cs=0 l=1 c_cookie=12299714905051063339 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:03.264 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.258+0000 7f471a0556c0 1 --2- 10.20.193.133:0/2099554171 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4714110040 0x7f47141104b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:03.264 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.258+0000 7f471a0556c0 1 --2- 10.20.193.133:0/2099554171 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f471410eec0 0x7f471410f2b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:03.264 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.258+0000 7f471a0556c0 1 -- 10.20.193.133:0/2099554171 >> 10.20.193.133:0/2099554171 conn(0x7f47140ec5c0 msgr2=0x7f471410c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:03.264 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.258+0000 7f471a0556c0 1 -- 10.20.193.133:0/2099554171 shutdown_connections 2026-02-13T03:33:03.264 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.258+0000 7f471a0556c0 1 -- 10.20.193.133:0/2099554171 wait complete. 2026-02-13T03:33:03.264 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.258+0000 7f471a0556c0 1 Processor -- start 2026-02-13T03:33:03.264 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.259+0000 7f471a0556c0 1 -- start start 2026-02-13T03:33:03.264 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.259+0000 7f471a0556c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f471410eec0 0x7f47140f8f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:03.264 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.259+0000 7f471a0556c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4714110040 0x7f4714171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:03.265 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.259+0000 7f471a0556c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f47141109f0 0x7f47140f9780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:03.265 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.259+0000 7f471a0556c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f47140fa3b0 con 0x7f471410eec0 2026-02-13T03:33:03.265 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.259+0000 7f471a0556c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f47140fa520 con 0x7f4714110040 2026-02-13T03:33:03.265 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.259+0000 7f471a0556c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f47140fa6e0 con 0x7f47141109f0 2026-02-13T03:33:03.265 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.259+0000 7f4713fff6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f47141109f0 0x7f47140f9780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:03.265 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.259+0000 7f4713fff6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f47141109f0 0x7f47140f9780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.133:3300/0 says I am v2:10.20.193.133:34656/0 (socket says 10.20.193.133:34656) 2026-02-13T03:33:03.265 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.259+0000 7f4713fff6c0 1 -- 10.20.193.133:0/3387794873 learned_addr learned my addr 10.20.193.133:0/3387794873 (peer_addr_for_me v2:10.20.193.133:0/0) 2026-02-13T03:33:03.265 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.259+0000 7f4712ffd6c0 1 --2- 10.20.193.133:0/3387794873 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4714110040 0x7f4714171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:03.265 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.259+0000 7f47137fe6c0 1 --2- 10.20.193.133:0/3387794873 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f471410eec0 0x7f47140f8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:03.265 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.259+0000 7f4713fff6c0 1 -- 10.20.193.133:0/3387794873 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4714110040 msgr2=0x7f4714171380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:03.265 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.259+0000 7f4713fff6c0 1 --2- 10.20.193.133:0/3387794873 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4714110040 0x7f4714171380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:03.266 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.259+0000 7f4713fff6c0 1 -- 10.20.193.133:0/3387794873 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f471410eec0 msgr2=0x7f47140f8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:03.266 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.259+0000 7f4713fff6c0 1 --2- 10.20.193.133:0/3387794873 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f471410eec0 0x7f47140f8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:03.266 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.259+0000 7f4713fff6c0 1 -- 10.20.193.133:0/3387794873 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470800a660 con 0x7f47141109f0 2026-02-13T03:33:03.266 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.259+0000 7f4713fff6c0 1 --2- 10.20.193.133:0/3387794873 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f47141109f0 0x7f47140f9780 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4708006ec0 tx=0x7f47080054b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:03.266 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.259+0000 7f4710ff96c0 1 -- 10.20.193.133:0/3387794873 <== mon.1 v2:10.20.193.133:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4708030e80 con 0x7f47141109f0 2026-02-13T03:33:03.266 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.259+0000 7f471a0556c0 1 -- 10.20.193.133:0/3387794873 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47140fa960 con 0x7f47141109f0 2026-02-13T03:33:03.266 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.259+0000 7f4710ff96c0 1 -- 10.20.193.133:0/3387794873 <== mon.1 v2:10.20.193.133:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f4708003cf0 con 0x7f47141109f0 2026-02-13T03:33:03.266 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.259+0000 7f4710ff96c0 1 -- 10.20.193.133:0/3387794873 <== mon.1 v2:10.20.193.133:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f47080322b0 con 0x7f47141109f0 2026-02-13T03:33:03.266 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.259+0000 7f471a0556c0 1 -- 10.20.193.133:0/3387794873 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47140fad90 con 0x7f47141109f0 2026-02-13T03:33:03.266 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.260+0000 7f471a0556c0 1 -- 10.20.193.133:0/3387794873 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47140fafb0 con 0x7f47141109f0 2026-02-13T03:33:03.267 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.261+0000 7f4710ff96c0 1 -- 10.20.193.133:0/3387794873 <== mon.1 v2:10.20.193.133:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f4708008430 con 0x7f47141109f0 2026-02-13T03:33:03.267 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.262+0000 7f4710ff96c0 1 --2- 10.20.193.133:0/3387794873 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f46e80b5600 0x7f46e80d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:03.267 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.262+0000 7f4710ff96c0 1 -- 10.20.193.133:0/3387794873 <== mon.1 v2:10.20.193.133:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3561+0+0 (secure 0 0 0) 0x7f4708107d90 con 0x7f47141109f0 2026-02-13T03:33:03.268 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.262+0000 7f47137fe6c0 1 --2- 10.20.193.133:0/3387794873 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f46e80b5600 0x7f46e80d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:03.268 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.262+0000 7f4710ff96c0 1 -- 10.20.193.133:0/3387794873 <== mon.1 v2:10.20.193.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f47080cb980 con 0x7f47141109f0 2026-02-13T03:33:03.268 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.262+0000 7f47137fe6c0 1 --2- 10.20.193.133:0/3387794873 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f46e80b5600 0x7f46e80d5ab0 secure :-1 s=READY pgs=103 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4700005980 tx=0x7f47000094b0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:03.362 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:03.359+0000 7f471a0556c0 1 -- 10.20.193.133:0/3387794873 --> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial133:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f4714174d50 con 0x7f46e80b5600 2026-02-13T03:33:03.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:02 trial096 ceph-mon[24671]: pgmap v65: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:33:03.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:02 trial096 ceph-mon[24671]: pgmap v66: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:33:03.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:02 trial096 ceph-mon[24671]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:03.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:02 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:03.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:02 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:03.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:02 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:03.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:02 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:03.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:02 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:03.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:02 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:03.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:02 trial096 ceph-mon[24671]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T03:33:03.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:02 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:03.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:02 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:03.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:02 trial096 ceph-mon[24671]: from='osd.4 [v2:10.20.193.132:6808/421645986,v1:10.20.193.132:6809/421645986]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T03:33:03.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:02 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:03.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:02 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:04.191 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:03 trial132 ceph-mon[26888]: pgmap v67: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:33:04.191 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:03 trial132 ceph-mon[26888]: pgmap v68: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:33:04.191 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:03 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:04.191 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:03 trial132 ceph-mon[26888]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T03:33:04.191 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:03 trial132 ceph-mon[26888]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T03:33:04.191 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:03 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:33:04.191 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:03 trial132 ceph-mon[26888]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial132", "root=default"]} : dispatch 2026-02-13T03:33:04.192 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:03 trial132 ceph-mon[26888]: from='osd.4 [v2:10.20.193.132:6808/421645986,v1:10.20.193.132:6809/421645986]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial132", "root=default"]} : dispatch 2026-02-13T03:33:04.192 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:03 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:04.192 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:03 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:04.192 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:03 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:04.192 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:03 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:04.192 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:03 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:04.192 INFO:journalctl@ceph.osd.4.trial132.stdout:Feb 13 03:33:04 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-4[37951]: 2026-02-13T03:33:04.160+0000 7fd7c544b6c0 -1 osd.4 0 waiting for initial osdmap 2026-02-13T03:33:04.192 INFO:journalctl@ceph.osd.4.trial132.stdout:Feb 13 03:33:04 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-4[37951]: 2026-02-13T03:33:04.163+0000 7fd7bd3076c0 -1 osd.4 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:33:04.246 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:03 trial133 ceph-mon[26943]: pgmap v67: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:33:04.246 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:03 trial133 ceph-mon[26943]: pgmap v68: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:33:04.247 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:03 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:04.247 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:03 trial133 ceph-mon[26943]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T03:33:04.247 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:03 trial133 ceph-mon[26943]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T03:33:04.247 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:03 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:33:04.247 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:03 trial133 ceph-mon[26943]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial132", "root=default"]} : dispatch 2026-02-13T03:33:04.247 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:03 trial133 ceph-mon[26943]: from='osd.4 [v2:10.20.193.132:6808/421645986,v1:10.20.193.132:6809/421645986]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial132", "root=default"]} : dispatch 2026-02-13T03:33:04.247 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:03 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:04.247 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:03 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:04.247 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:03 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:04.247 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:03 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:04.247 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:03 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:04.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:03 trial096 ceph-mon[24671]: pgmap v67: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:33:04.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:03 trial096 ceph-mon[24671]: pgmap v68: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:33:04.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:03 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:04.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:03 trial096 ceph-mon[24671]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T03:33:04.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:03 trial096 ceph-mon[24671]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T03:33:04.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:03 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:33:04.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:03 trial096 ceph-mon[24671]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial132", "root=default"]} : dispatch 2026-02-13T03:33:04.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:03 trial096 ceph-mon[24671]: from='osd.4 [v2:10.20.193.132:6808/421645986,v1:10.20.193.132:6809/421645986]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial132", "root=default"]} : dispatch 2026-02-13T03:33:04.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:03 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:04.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:03 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:04.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:03 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:04.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:03 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:04.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:03 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:05.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:04 trial132 ceph-mon[26888]: from='client.24217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial133:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:33:05.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:04 trial132 ceph-mon[26888]: from='client.? 10.20.193.133:0/2452894080' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "301e3dbb-5341-4fda-9c71-7f2fa3f983b7"} : dispatch 2026-02-13T03:33:05.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:04 trial132 ceph-mon[26888]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "301e3dbb-5341-4fda-9c71-7f2fa3f983b7"} : dispatch 2026-02-13T03:33:05.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:04 trial132 ceph-mon[26888]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial132", "root=default"]}]': finished 2026-02-13T03:33:05.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:04 trial132 ceph-mon[26888]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "301e3dbb-5341-4fda-9c71-7f2fa3f983b7"}]': finished 2026-02-13T03:33:05.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:04 trial132 ceph-mon[26888]: osdmap e25: 6 total, 4 up, 6 in 2026-02-13T03:33:05.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:04 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:33:05.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:04 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:33:05.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:04 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:33:05.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:04 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:05.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:04 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:05.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:04 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:05.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:04 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:05.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:04 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:05.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:04 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:05.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:04 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:05.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:04 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:05.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:04 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:05.235 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:04 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:05.235 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:04 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:05.235 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:04 trial132 ceph-mon[26888]: from='client.? 10.20.193.133:0/2585224801' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:33:05.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:04 trial133 ceph-mon[26943]: from='client.24217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial133:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:33:05.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:04 trial133 ceph-mon[26943]: from='client.? 10.20.193.133:0/2452894080' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "301e3dbb-5341-4fda-9c71-7f2fa3f983b7"} : dispatch 2026-02-13T03:33:05.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:04 trial133 ceph-mon[26943]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "301e3dbb-5341-4fda-9c71-7f2fa3f983b7"} : dispatch 2026-02-13T03:33:05.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:04 trial133 ceph-mon[26943]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial132", "root=default"]}]': finished 2026-02-13T03:33:05.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:04 trial133 ceph-mon[26943]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "301e3dbb-5341-4fda-9c71-7f2fa3f983b7"}]': finished 2026-02-13T03:33:05.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:04 trial133 ceph-mon[26943]: osdmap e25: 6 total, 4 up, 6 in 2026-02-13T03:33:05.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:04 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:33:05.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:04 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:33:05.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:04 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:33:05.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:04 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:05.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:04 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:05.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:04 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:05.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:04 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:05.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:04 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:05.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:04 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:05.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:04 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:05.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:04 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:05.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:04 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:05.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:04 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:05.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:04 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:05.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:04 trial133 ceph-mon[26943]: from='client.? 10.20.193.133:0/2585224801' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:33:05.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:04 trial096 ceph-mon[24671]: from='client.24217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial133:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:33:05.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:04 trial096 ceph-mon[24671]: from='client.? 10.20.193.133:0/2452894080' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "301e3dbb-5341-4fda-9c71-7f2fa3f983b7"} : dispatch 2026-02-13T03:33:05.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:04 trial096 ceph-mon[24671]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "301e3dbb-5341-4fda-9c71-7f2fa3f983b7"} : dispatch 2026-02-13T03:33:05.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:04 trial096 ceph-mon[24671]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial132", "root=default"]}]': finished 2026-02-13T03:33:05.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:04 trial096 ceph-mon[24671]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "301e3dbb-5341-4fda-9c71-7f2fa3f983b7"}]': finished 2026-02-13T03:33:05.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:04 trial096 ceph-mon[24671]: osdmap e25: 6 total, 4 up, 6 in 2026-02-13T03:33:05.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:04 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:33:05.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:04 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:33:05.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:04 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:33:05.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:04 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:05.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:04 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:05.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:04 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:05.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:04 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:05.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:04 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:05.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:04 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:05.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:04 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:05.426 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:04 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:05.426 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:04 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:05.426 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:04 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:05.426 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:04 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:05.426 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:04 trial096 ceph-mon[24671]: from='client.? 10.20.193.133:0/2585224801' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:33:06.121 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:05 trial133 ceph-mon[26943]: purged_snaps scrub starts 2026-02-13T03:33:06.121 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:05 trial133 ceph-mon[26943]: purged_snaps scrub ok 2026-02-13T03:33:06.122 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:05 trial133 ceph-mon[26943]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 193 KiB/s, 0 objects/s recovering 2026-02-13T03:33:06.122 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:05 trial133 ceph-mon[26943]: osd.4 [v2:10.20.193.132:6808/421645986,v1:10.20.193.132:6809/421645986] boot 2026-02-13T03:33:06.122 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:05 trial133 ceph-mon[26943]: osdmap e26: 6 total, 5 up, 6 in 2026-02-13T03:33:06.122 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:05 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:33:06.122 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:05 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:33:06.122 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:05 trial133 ceph-mon[26943]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:06.122 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:05 trial133 ceph-mon[26943]: Cluster is now healthy 2026-02-13T03:33:06.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:05 trial132 ceph-mon[26888]: purged_snaps scrub starts 2026-02-13T03:33:06.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:05 trial132 ceph-mon[26888]: purged_snaps scrub ok 2026-02-13T03:33:06.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:05 trial132 ceph-mon[26888]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 193 KiB/s, 0 objects/s recovering 2026-02-13T03:33:06.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:05 trial132 ceph-mon[26888]: osd.4 [v2:10.20.193.132:6808/421645986,v1:10.20.193.132:6809/421645986] boot 2026-02-13T03:33:06.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:05 trial132 ceph-mon[26888]: osdmap e26: 6 total, 5 up, 6 in 2026-02-13T03:33:06.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:05 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:33:06.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:05 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:33:06.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:05 trial132 ceph-mon[26888]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:06.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:05 trial132 ceph-mon[26888]: Cluster is now healthy 2026-02-13T03:33:06.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:05 trial096 ceph-mon[24671]: purged_snaps scrub starts 2026-02-13T03:33:06.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:05 trial096 ceph-mon[24671]: purged_snaps scrub ok 2026-02-13T03:33:06.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:05 trial096 ceph-mon[24671]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 193 KiB/s, 0 objects/s recovering 2026-02-13T03:33:06.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:05 trial096 ceph-mon[24671]: osd.4 [v2:10.20.193.132:6808/421645986,v1:10.20.193.132:6809/421645986] boot 2026-02-13T03:33:06.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:05 trial096 ceph-mon[24671]: osdmap e26: 6 total, 5 up, 6 in 2026-02-13T03:33:06.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:05 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:33:06.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:05 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:33:06.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:05 trial096 ceph-mon[24671]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:06.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:05 trial096 ceph-mon[24671]: Cluster is now healthy 2026-02-13T03:33:07.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:06 trial132 ceph-mon[26888]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 158 KiB/s, 0 objects/s recovering 2026-02-13T03:33:07.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:07.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T03:33:07.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:07.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:07.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:07.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:07.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:07.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:07.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:07.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:07.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:07.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:06 trial133 ceph-mon[26943]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 158 KiB/s, 0 objects/s recovering 2026-02-13T03:33:07.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:07.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T03:33:07.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:07.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:07.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:07.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:07.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:07.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:07.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:07.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:07.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:07.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:06 trial096 ceph-mon[24671]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 158 KiB/s, 0 objects/s recovering 2026-02-13T03:33:07.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:07.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T03:33:07.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:07.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:07.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:07.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:07.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:07.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:07.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:07.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:07.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:08.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:07 trial132 ceph-mon[26888]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 167 KiB/s, 0 objects/s recovering 2026-02-13T03:33:08.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:07 trial133 ceph-mon[26943]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 167 KiB/s, 0 objects/s recovering 2026-02-13T03:33:08.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:07 trial096 ceph-mon[24671]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 167 KiB/s, 0 objects/s recovering 2026-02-13T03:33:09.612 INFO:teuthology.orchestra.run.trial133.stdout:Created osd(s) 5 on host 'trial133' 2026-02-13T03:33:09.613 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:09.609+0000 7f4710ff96c0 1 -- 10.20.193.133:0/3387794873 <== mgr.14116 v2:10.20.193.96:6800/1736050816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f4714174d50 con 0x7f46e80b5600 2026-02-13T03:33:09.615 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:09.611+0000 7f471a0556c0 1 -- 10.20.193.133:0/3387794873 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f46e80b5600 msgr2=0x7f46e80d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:09.615 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:09.611+0000 7f471a0556c0 1 --2- 10.20.193.133:0/3387794873 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f46e80b5600 0x7f46e80d5ab0 secure :-1 s=READY pgs=103 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4700005980 tx=0x7f47000094b0 comp rx=0 tx=0).stop 2026-02-13T03:33:09.615 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:09.611+0000 7f471a0556c0 1 -- 10.20.193.133:0/3387794873 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f47141109f0 msgr2=0x7f47140f9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:09.615 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:09.611+0000 7f471a0556c0 1 --2- 10.20.193.133:0/3387794873 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f47141109f0 0x7f47140f9780 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4708006ec0 tx=0x7f47080054b0 comp rx=0 tx=0).stop 2026-02-13T03:33:09.615 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:09.612+0000 7f471a0556c0 1 -- 10.20.193.133:0/3387794873 shutdown_connections 2026-02-13T03:33:09.615 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:09.612+0000 7f471a0556c0 1 --2- 10.20.193.133:0/3387794873 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f46e80b5600 0x7f46e80d5ab0 unknown :-1 s=CLOSED pgs=103 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:09.615 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:09.612+0000 7f471a0556c0 1 --2- 10.20.193.133:0/3387794873 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f47141109f0 0x7f47140f9780 unknown :-1 s=CLOSED pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:09.616 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:09.612+0000 7f471a0556c0 1 --2- 10.20.193.133:0/3387794873 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4714110040 0x7f4714171380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:09.616 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:09.612+0000 7f471a0556c0 1 --2- 10.20.193.133:0/3387794873 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f471410eec0 0x7f47140f8f20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:09.616 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:09.612+0000 7f471a0556c0 1 -- 10.20.193.133:0/3387794873 >> 10.20.193.133:0/3387794873 conn(0x7f47140ec5c0 msgr2=0x7f47140ef4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:09.616 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:09.612+0000 7f471a0556c0 1 -- 10.20.193.133:0/3387794873 shutdown_connections 2026-02-13T03:33:09.616 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:09.612+0000 7f471a0556c0 1 -- 10.20.193.133:0/3387794873 wait complete. 2026-02-13T03:33:09.656 DEBUG:teuthology.orchestra.run.trial133:osd.5> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.5.service 2026-02-13T03:33:09.698 INFO:tasks.cephadm:Deploying osd.6 on trial096 with /dev/vg_nvme/lv_2... 2026-02-13T03:33:09.698 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T03:33:09.819 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:33:09.842 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:09 trial096 ceph-mon[24671]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:33:09.842 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:09 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:09.843 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:09 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:09.843 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:09 trial096 ceph-mon[24671]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:33:09.843 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:09 trial096 ceph-mon[24671]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:09.843 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:09 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:09.843 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:09 trial096 ceph-mon[24671]: from='osd.5 [v2:10.20.193.133:6808/3625077127,v1:10.20.193.133:6809/3625077127]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T03:33:09.843 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:09 trial096 ceph-mon[24671]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T03:33:09.843 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:09 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:09.843 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:09 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:09.843 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:09 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:09.843 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:09 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:09.843 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:09 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:09.844 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:09 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:09.844 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:09 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:09.844 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:09 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:09.845 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:09 trial133 ceph-mon[26943]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:33:09.845 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:09 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:09.845 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:09 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:09.845 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:09 trial133 ceph-mon[26943]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:33:09.845 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:09 trial133 ceph-mon[26943]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:09.845 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:09 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:09.846 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:09 trial133 ceph-mon[26943]: from='osd.5 [v2:10.20.193.133:6808/3625077127,v1:10.20.193.133:6809/3625077127]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T03:33:09.846 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:09 trial133 ceph-mon[26943]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T03:33:09.846 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:09 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:09.846 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:09 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:09.846 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:09 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:09.846 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:09 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:09.846 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:09 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:09.846 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:09 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:09.846 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:09 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:09.846 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:09 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:09.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:09 trial132 ceph-mon[26888]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:33:09.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:09 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:09.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:09 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:09.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:09 trial132 ceph-mon[26888]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:33:09.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:09 trial132 ceph-mon[26888]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:09.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:09 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:09.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:09 trial132 ceph-mon[26888]: from='osd.5 [v2:10.20.193.133:6808/3625077127,v1:10.20.193.133:6809/3625077127]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T03:33:09.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:09 trial132 ceph-mon[26888]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T03:33:09.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:09 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:09.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:09 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:09.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:09 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:09.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:09 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:09.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:09 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:09.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:09 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:09.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:09 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:09.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:09 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:10.270 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:33:10.288 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph orch daemon add osd trial096:vg_nvme/lv_2 --skip-validation 2026-02-13T03:33:10.407 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:33:10.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.524+0000 7f2fa96716c0 1 -- 10.20.193.96:0/529374664 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2fa4110040 msgr2=0x7f2fa41104b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:10.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.524+0000 7f2fa96716c0 1 --2- 10.20.193.96:0/529374664 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2fa4110040 0x7f2fa41104b0 secure :-1 s=READY pgs=165 gs=2 cs=0 l=1 c_cookie=1240500555088279872 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f8c009970 tx=0x7f2f8c02ed50 comp rx=0 tx=0).stop 2026-02-13T03:33:10.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.524+0000 7f2fa96716c0 1 -- 10.20.193.96:0/529374664 shutdown_connections 2026-02-13T03:33:10.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.524+0000 7f2fa96716c0 1 --2- 10.20.193.96:0/529374664 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2fa41109f0 0x7f2fa4171380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:10.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.524+0000 7f2fa96716c0 1 --2- 10.20.193.96:0/529374664 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2fa4110040 0x7f2fa41104b0 unknown :-1 s=CLOSED pgs=165 gs=2 cs=0 l=1 c_cookie=1240500555088279872 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:10.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.524+0000 7f2fa96716c0 1 --2- 10.20.193.96:0/529374664 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2fa410eec0 0x7f2fa410f2b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:10.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.524+0000 7f2fa96716c0 1 -- 10.20.193.96:0/529374664 >> 10.20.193.96:0/529374664 conn(0x7f2fa40ec5c0 msgr2=0x7f2fa410c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:10.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.524+0000 7f2fa96716c0 1 -- 10.20.193.96:0/529374664 shutdown_connections 2026-02-13T03:33:10.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.524+0000 7f2fa96716c0 1 -- 10.20.193.96:0/529374664 wait complete. 2026-02-13T03:33:10.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.525+0000 7f2fa96716c0 1 Processor -- start 2026-02-13T03:33:10.530 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.525+0000 7f2fa96716c0 1 -- start start 2026-02-13T03:33:10.530 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.525+0000 7f2fa96716c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2fa410eec0 0x7f2fa411ad20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:10.530 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.525+0000 7f2fa96716c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2fa4110040 0x7f2fa411b370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:10.530 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.525+0000 7f2fa96716c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2fa41109f0 0x7f2fa411bf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:10.530 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.525+0000 7f2fa96716c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa411c660 con 0x7f2fa4110040 2026-02-13T03:33:10.530 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.525+0000 7f2fa96716c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa411c7d0 con 0x7f2fa41109f0 2026-02-13T03:33:10.530 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.525+0000 7f2fa96716c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa411c990 con 0x7f2fa410eec0 2026-02-13T03:33:10.530 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.525+0000 7f2fa27fc6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2fa4110040 0x7f2fa411b370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:10.530 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.525+0000 7f2fa27fc6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2fa4110040 0x7f2fa411b370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49212/0 (socket says 10.20.193.96:49212) 2026-02-13T03:33:10.530 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.525+0000 7f2fa27fc6c0 1 -- 10.20.193.96:0/2094082071 learned_addr learned my addr 10.20.193.96:0/2094082071 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:33:10.530 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.525+0000 7f2fa2ffd6c0 1 --2- 10.20.193.96:0/2094082071 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2fa410eec0 0x7f2fa411ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:10.531 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.525+0000 7f2fa27fc6c0 1 -- 10.20.193.96:0/2094082071 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2fa410eec0 msgr2=0x7f2fa411ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:10.531 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.525+0000 7f2fa27fc6c0 1 --2- 10.20.193.96:0/2094082071 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2fa410eec0 0x7f2fa411ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:10.531 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.525+0000 7f2fa27fc6c0 1 -- 10.20.193.96:0/2094082071 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2fa41109f0 msgr2=0x7f2fa411bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:10.531 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.525+0000 7f2fa27fc6c0 1 --2- 10.20.193.96:0/2094082071 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2fa41109f0 0x7f2fa411bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:10.531 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.525+0000 7f2fa27fc6c0 1 -- 10.20.193.96:0/2094082071 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f8c009590 con 0x7f2fa4110040 2026-02-13T03:33:10.531 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.525+0000 7f2fa27fc6c0 1 --2- 10.20.193.96:0/2094082071 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2fa4110040 0x7f2fa411b370 secure :-1 s=READY pgs=166 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f8c02fef0 tx=0x7f2f8c0045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:10.531 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.525+0000 7f2f83fff6c0 1 -- 10.20.193.96:0/2094082071 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f8c002ba0 con 0x7f2fa4110040 2026-02-13T03:33:10.531 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.525+0000 7f2f83fff6c0 1 -- 10.20.193.96:0/2094082071 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f2f8c002d00 con 0x7f2fa4110040 2026-02-13T03:33:10.531 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.525+0000 7f2f83fff6c0 1 -- 10.20.193.96:0/2094082071 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f8c031340 con 0x7f2fa4110040 2026-02-13T03:33:10.531 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.525+0000 7f2fa96716c0 1 -- 10.20.193.96:0/2094082071 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa411cc10 con 0x7f2fa4110040 2026-02-13T03:33:10.531 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.525+0000 7f2fa96716c0 1 -- 10.20.193.96:0/2094082071 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa415d1a0 con 0x7f2fa4110040 2026-02-13T03:33:10.531 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.526+0000 7f2fa96716c0 1 -- 10.20.193.96:0/2094082071 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fa4064690 con 0x7f2fa4110040 2026-02-13T03:33:10.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.527+0000 7f2f83fff6c0 1 -- 10.20.193.96:0/2094082071 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f2f8c0079f0 con 0x7f2fa4110040 2026-02-13T03:33:10.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.528+0000 7f2f83fff6c0 1 --2- 10.20.193.96:0/2094082071 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f2f780b5680 0x7f2f780d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:10.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.528+0000 7f2f83fff6c0 1 -- 10.20.193.96:0/2094082071 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4014+0+0 (secure 0 0 0) 0x7f2f8c106ed0 con 0x7f2fa4110040 2026-02-13T03:33:10.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.528+0000 7f2fa2ffd6c0 1 --2- 10.20.193.96:0/2094082071 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f2f780b5680 0x7f2f780d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:10.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.528+0000 7f2fa2ffd6c0 1 --2- 10.20.193.96:0/2094082071 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f2f780b5680 0x7f2f780d5b30 secure :-1 s=READY pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f98005980 tx=0x7f2f98005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:10.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.528+0000 7f2f83fff6c0 1 -- 10.20.193.96:0/2094082071 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2f8c0ca900 con 0x7f2fa4110040 2026-02-13T03:33:10.626 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:10.624+0000 7f2fa96716c0 1 -- 10.20.193.96:0/2094082071 --> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial096:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f2fa404ca20 con 0x7f2f780b5680 2026-02-13T03:33:10.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:10 trial133 ceph-mon[26943]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:33:10.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:10 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:10.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:10 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:10.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:10 trial133 ceph-mon[26943]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T03:33:10.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:10 trial133 ceph-mon[26943]: from='osd.5 [v2:10.20.193.133:6808/3625077127,v1:10.20.193.133:6809/3625077127]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial133", "root=default"]} : dispatch 2026-02-13T03:33:10.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:10 trial133 ceph-mon[26943]: osdmap e27: 6 total, 5 up, 6 in 2026-02-13T03:33:10.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:10 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:33:10.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:10 trial133 ceph-mon[26943]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial133", "root=default"]} : dispatch 2026-02-13T03:33:10.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:10 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:10.921 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:10 trial096 ceph-mon[24671]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:33:10.921 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:10 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:10.921 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:10 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:10.921 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:10 trial096 ceph-mon[24671]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T03:33:10.922 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:10 trial096 ceph-mon[24671]: from='osd.5 [v2:10.20.193.133:6808/3625077127,v1:10.20.193.133:6809/3625077127]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial133", "root=default"]} : dispatch 2026-02-13T03:33:10.922 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:10 trial096 ceph-mon[24671]: osdmap e27: 6 total, 5 up, 6 in 2026-02-13T03:33:10.922 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:10 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:33:10.922 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:10 trial096 ceph-mon[24671]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial133", "root=default"]} : dispatch 2026-02-13T03:33:10.922 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:10 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:10.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:10 trial132 ceph-mon[26888]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:33:10.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:10 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:10.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:10 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:10.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:10 trial132 ceph-mon[26888]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T03:33:10.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:10 trial132 ceph-mon[26888]: from='osd.5 [v2:10.20.193.133:6808/3625077127,v1:10.20.193.133:6809/3625077127]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial133", "root=default"]} : dispatch 2026-02-13T03:33:10.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:10 trial132 ceph-mon[26888]: osdmap e27: 6 total, 5 up, 6 in 2026-02-13T03:33:10.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:10 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:33:10.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:10 trial132 ceph-mon[26888]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial133", "root=default"]} : dispatch 2026-02-13T03:33:10.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:10 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:11.263 INFO:journalctl@ceph.osd.5.trial133.stdout:Feb 13 03:33:10 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-5[38366]: 2026-02-13T03:33:10.954+0000 7fb6f2e116c0 -1 osd.5 0 waiting for initial osdmap 2026-02-13T03:33:11.264 INFO:journalctl@ceph.osd.5.trial133.stdout:Feb 13 03:33:10 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-5[38366]: 2026-02-13T03:33:10.958+0000 7fb6eecd56c0 -1 osd.5 28 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:33:11.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:33:11.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial096:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:33:11.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:11.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:11.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:11.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:11.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:11.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial133", "root=default"]}]': finished 2026-02-13T03:33:11.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: osdmap e28: 6 total, 5 up, 6 in 2026-02-13T03:33:11.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:33:11.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:33:11.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:11.926 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:11.926 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:11.926 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:11.926 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:11.926 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:11.926 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:11.926 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:11.926 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:11.926 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:11.926 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:11.926 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3318809395' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5d25b12d-8499-4f12-91ca-ce4953256678"} : dispatch 2026-02-13T03:33:11.926 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3318809395' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d25b12d-8499-4f12-91ca-ce4953256678"}]': finished 2026-02-13T03:33:11.927 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: osd.5 [v2:10.20.193.133:6808/3625077127,v1:10.20.193.133:6809/3625077127] boot 2026-02-13T03:33:11.927 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: osdmap e29: 7 total, 6 up, 7 in 2026-02-13T03:33:11.927 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:33:11.927 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:11.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:33:11.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial096:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:33:11.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:11.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:11.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:11.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:11.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:11.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial133", "root=default"]}]': finished 2026-02-13T03:33:11.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: osdmap e28: 6 total, 5 up, 6 in 2026-02-13T03:33:11.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:33:11.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:33:11.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:11.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:11.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:11.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:11.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:11.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:11.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:11.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:11.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:11.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:11.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:11.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3318809395' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5d25b12d-8499-4f12-91ca-ce4953256678"} : dispatch 2026-02-13T03:33:11.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3318809395' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d25b12d-8499-4f12-91ca-ce4953256678"}]': finished 2026-02-13T03:33:11.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: osd.5 [v2:10.20.193.133:6808/3625077127,v1:10.20.193.133:6809/3625077127] boot 2026-02-13T03:33:11.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: osdmap e29: 7 total, 6 up, 7 in 2026-02-13T03:33:11.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:33:11.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:12.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:33:12.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial096:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:33:12.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:12.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:12.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:12.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:12.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:12.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial133", "root=default"]}]': finished 2026-02-13T03:33:12.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: osdmap e28: 6 total, 5 up, 6 in 2026-02-13T03:33:12.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:33:12.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:33:12.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:12.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:12.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:12.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:12.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:12.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:12.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:12.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:12.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:12.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:12.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:12.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3318809395' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5d25b12d-8499-4f12-91ca-ce4953256678"} : dispatch 2026-02-13T03:33:12.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3318809395' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d25b12d-8499-4f12-91ca-ce4953256678"}]': finished 2026-02-13T03:33:12.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: osd.5 [v2:10.20.193.133:6808/3625077127,v1:10.20.193.133:6809/3625077127] boot 2026-02-13T03:33:12.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: osdmap e29: 7 total, 6 up, 7 in 2026-02-13T03:33:12.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:33:12.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:12.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:12 trial096 ceph-mon[24671]: purged_snaps scrub starts 2026-02-13T03:33:12.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:12 trial096 ceph-mon[24671]: purged_snaps scrub ok 2026-02-13T03:33:12.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:12 trial096 ceph-mon[24671]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:33:12.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:12 trial096 ceph-mon[24671]: osdmap e30: 7 total, 6 up, 7 in 2026-02-13T03:33:12.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:12 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:12.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:12 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3802171598' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:33:12.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:12 trial096 ceph-mon[24671]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:12.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:12 trial096 ceph-mon[24671]: Cluster is now healthy 2026-02-13T03:33:12.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:12 trial132 ceph-mon[26888]: purged_snaps scrub starts 2026-02-13T03:33:12.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:12 trial132 ceph-mon[26888]: purged_snaps scrub ok 2026-02-13T03:33:12.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:12 trial132 ceph-mon[26888]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:33:12.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:12 trial132 ceph-mon[26888]: osdmap e30: 7 total, 6 up, 7 in 2026-02-13T03:33:12.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:12 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:12.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:12 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3802171598' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:33:12.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:12 trial132 ceph-mon[26888]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:12.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:12 trial132 ceph-mon[26888]: Cluster is now healthy 2026-02-13T03:33:13.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:12 trial133 ceph-mon[26943]: purged_snaps scrub starts 2026-02-13T03:33:13.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:12 trial133 ceph-mon[26943]: purged_snaps scrub ok 2026-02-13T03:33:13.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:12 trial133 ceph-mon[26943]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:33:13.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:12 trial133 ceph-mon[26943]: osdmap e30: 7 total, 6 up, 7 in 2026-02-13T03:33:13.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:12 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:13.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:12 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3802171598' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:33:13.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:12 trial133 ceph-mon[26943]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:13.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:12 trial133 ceph-mon[26943]: Cluster is now healthy 2026-02-13T03:33:13.741 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:13 trial096 ceph-mon[24671]: osdmap e31: 7 total, 6 up, 7 in 2026-02-13T03:33:13.741 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:13.741 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:13.741 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:13.742 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:13.742 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:13.742 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:13.742 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:13.742 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:13.742 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:13.742 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:13.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:13 trial132 ceph-mon[26888]: osdmap e31: 7 total, 6 up, 7 in 2026-02-13T03:33:13.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:13 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:13.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:13 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:13.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:13 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:13.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:13 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:13.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:13 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:13.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:13 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:13.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:13 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:13.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:13 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:13.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:13 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:13.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:13 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:14.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:13 trial133 ceph-mon[26943]: osdmap e31: 7 total, 6 up, 7 in 2026-02-13T03:33:14.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:14.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:14.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:14.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:14.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:14.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:14.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:14.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:14.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:14.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:14.832 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:14 trial096 ceph-mon[24671]: pgmap v85: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T03:33:14.833 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:14 trial096 ceph-mon[24671]: pgmap v86: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T03:33:14.833 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:14 trial096 ceph-mon[24671]: pgmap v87: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T03:33:14.833 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:14 trial096 ceph-mon[24671]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2026-02-13T03:33:14.833 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:14 trial096 ceph-mon[24671]: osdmap e32: 7 total, 6 up, 7 in 2026-02-13T03:33:14.833 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:14 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:14.833 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:14 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T03:33:14.833 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:14 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:14.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:14 trial132 ceph-mon[26888]: pgmap v85: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T03:33:14.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:14 trial132 ceph-mon[26888]: pgmap v86: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T03:33:14.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:14 trial132 ceph-mon[26888]: pgmap v87: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T03:33:14.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:14 trial132 ceph-mon[26888]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2026-02-13T03:33:14.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:14 trial132 ceph-mon[26888]: osdmap e32: 7 total, 6 up, 7 in 2026-02-13T03:33:14.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:14 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:14.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:14 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T03:33:14.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:14 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:15.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:14 trial133 ceph-mon[26943]: pgmap v85: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T03:33:15.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:14 trial133 ceph-mon[26943]: pgmap v86: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T03:33:15.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:14 trial133 ceph-mon[26943]: pgmap v87: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T03:33:15.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:14 trial133 ceph-mon[26943]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2026-02-13T03:33:15.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:14 trial133 ceph-mon[26943]: osdmap e32: 7 total, 6 up, 7 in 2026-02-13T03:33:15.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:14 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:15.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:14 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T03:33:15.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:14 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:15.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:15 trial096 ceph-mon[24671]: pgmap v89: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T03:33:15.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:15 trial096 ceph-mon[24671]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:15.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:15 trial096 ceph-mon[24671]: osdmap e33: 7 total, 6 up, 7 in 2026-02-13T03:33:15.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:15 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:15.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:15 trial132 ceph-mon[26888]: pgmap v89: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T03:33:15.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:15 trial132 ceph-mon[26888]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:15.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:15 trial132 ceph-mon[26888]: osdmap e33: 7 total, 6 up, 7 in 2026-02-13T03:33:15.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:15 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:16.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:15 trial133 ceph-mon[26943]: pgmap v89: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T03:33:16.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:15 trial133 ceph-mon[26943]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:16.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:15 trial133 ceph-mon[26943]: osdmap e33: 7 total, 6 up, 7 in 2026-02-13T03:33:16.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:15 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:16.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:16 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:16.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:16 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:16.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:16 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:16.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:16 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:16.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:16 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:16.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:16 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:17.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:16 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:17.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:16 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:17.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:16 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:17.120 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:17.117+0000 7f2f83fff6c0 1 -- 10.20.193.96:0/2094082071 <== mgr.14116 v2:10.20.193.96:6800/1736050816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f2fa404ca20 con 0x7f2f780b5680 2026-02-13T03:33:17.120 INFO:teuthology.orchestra.run.trial096.stdout:Created osd(s) 6 on host 'trial096' 2026-02-13T03:33:17.123 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:17.119+0000 7f2fa96716c0 1 -- 10.20.193.96:0/2094082071 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f2f780b5680 msgr2=0x7f2f780d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:17.123 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:17.119+0000 7f2fa96716c0 1 --2- 10.20.193.96:0/2094082071 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f2f780b5680 0x7f2f780d5b30 secure :-1 s=READY pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f98005980 tx=0x7f2f98005910 comp rx=0 tx=0).stop 2026-02-13T03:33:17.123 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:17.119+0000 7f2fa96716c0 1 -- 10.20.193.96:0/2094082071 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2fa4110040 msgr2=0x7f2fa411b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:17.123 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:17.119+0000 7f2fa96716c0 1 --2- 10.20.193.96:0/2094082071 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2fa4110040 0x7f2fa411b370 secure :-1 s=READY pgs=166 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f8c02fef0 tx=0x7f2f8c0045f0 comp rx=0 tx=0).stop 2026-02-13T03:33:17.123 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:17.119+0000 7f2fa96716c0 1 -- 10.20.193.96:0/2094082071 shutdown_connections 2026-02-13T03:33:17.123 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:17.119+0000 7f2fa96716c0 1 --2- 10.20.193.96:0/2094082071 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f2f780b5680 0x7f2f780d5b30 unknown :-1 s=CLOSED pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:17.123 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:17.119+0000 7f2fa96716c0 1 --2- 10.20.193.96:0/2094082071 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2fa41109f0 0x7f2fa411bf60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:17.123 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:17.119+0000 7f2fa96716c0 1 --2- 10.20.193.96:0/2094082071 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2fa4110040 0x7f2fa411b370 unknown :-1 s=CLOSED pgs=166 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:17.123 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:17.119+0000 7f2fa96716c0 1 --2- 10.20.193.96:0/2094082071 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2fa410eec0 0x7f2fa411ad20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:17.124 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:17.119+0000 7f2fa96716c0 1 -- 10.20.193.96:0/2094082071 >> 10.20.193.96:0/2094082071 conn(0x7f2fa40ec5c0 msgr2=0x7f2fa4111330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:17.124 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:17.119+0000 7f2fa96716c0 1 -- 10.20.193.96:0/2094082071 shutdown_connections 2026-02-13T03:33:17.124 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:17.119+0000 7f2fa96716c0 1 -- 10.20.193.96:0/2094082071 wait complete. 2026-02-13T03:33:17.164 DEBUG:teuthology.orchestra.run.trial096:osd.6> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.6.service 2026-02-13T03:33:17.166 INFO:tasks.cephadm:Deploying osd.7 on trial132 with /dev/vg_nvme/lv_2... 2026-02-13T03:33:17.166 DEBUG:teuthology.orchestra.run.trial132:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T03:33:17.288 INFO:teuthology.orchestra.run.trial132.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.b/config 2026-02-13T03:33:17.703 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:17 trial132 ceph-mon[26888]: pgmap v91: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T03:33:17.703 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:17 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:17.703 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:17 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:17.703 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:17 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:17.704 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:17 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:17.704 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:17 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:17.704 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:17 trial132 ceph-mon[26888]: pgmap v92: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T03:33:17.704 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:17 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:17.704 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:17 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:17.704 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:17 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:17.704 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:17 trial132 ceph-mon[26888]: from='osd.6 [v2:10.20.193.96:6818/4035362295,v1:10.20.193.96:6819/4035362295]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T03:33:17.704 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:17 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:17.704 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:17 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:17.704 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:17 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:17.749 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:33:17.767 DEBUG:teuthology.orchestra.run.trial132:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph orch daemon add osd trial132:vg_nvme/lv_2 --skip-validation 2026-02-13T03:33:17.887 INFO:teuthology.orchestra.run.trial132.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.b/config 2026-02-13T03:33:17.942 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:17 trial096 ceph-mon[24671]: pgmap v91: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T03:33:17.942 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:17 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:17.942 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:17 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:17.942 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:17 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:17.943 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:17 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:17.943 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:17 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:17.943 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:17 trial096 ceph-mon[24671]: pgmap v92: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T03:33:17.943 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:17 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:17.943 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:17 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:17.943 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:17 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:17.943 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:17 trial096 ceph-mon[24671]: from='osd.6 [v2:10.20.193.96:6818/4035362295,v1:10.20.193.96:6819/4035362295]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T03:33:17.943 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:17 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:17.943 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:17 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:17.943 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:17 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:18.007 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.013+0000 7f8898fbf6c0 1 -- 10.20.193.132:0/623263843 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8894110a00 msgr2=0x7f8894171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:18.007 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.013+0000 7f8898fbf6c0 1 --2- 10.20.193.132:0/623263843 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8894110a00 0x7f8894171390 secure :-1 s=READY pgs=25 gs=1 cs=0 l=1 c_cookie=7717334738672268235 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f888400aa40 tx=0x7f888402fde0 comp rx=0 tx=0).stop 2026-02-13T03:33:18.007 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.013+0000 7f8898fbf6c0 1 -- 10.20.193.132:0/623263843 shutdown_connections 2026-02-13T03:33:18.008 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.013+0000 7f8898fbf6c0 1 --2- 10.20.193.132:0/623263843 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8894110a00 0x7f8894171390 unknown :-1 s=CLOSED pgs=25 gs=1 cs=0 l=1 c_cookie=7717334738672268235 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:18.008 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.013+0000 7f8898fbf6c0 1 --2- 10.20.193.132:0/623263843 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8894110050 0x7f88941104c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:18.008 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.013+0000 7f8898fbf6c0 1 --2- 10.20.193.132:0/623263843 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f889410eed0 0x7f889410f2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:18.008 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.013+0000 7f8898fbf6c0 1 -- 10.20.193.132:0/623263843 >> 10.20.193.132:0/623263843 conn(0x7f88940ec5f0 msgr2=0x7f889410ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:18.008 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.013+0000 7f8898fbf6c0 1 -- 10.20.193.132:0/623263843 shutdown_connections 2026-02-13T03:33:18.008 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.013+0000 7f8898fbf6c0 1 -- 10.20.193.132:0/623263843 wait complete. 2026-02-13T03:33:18.008 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.013+0000 7f8898fbf6c0 1 Processor -- start 2026-02-13T03:33:18.008 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.013+0000 7f8898fbf6c0 1 -- start start 2026-02-13T03:33:18.008 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.013+0000 7f8898fbf6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f889410eed0 0x7f88940f84b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:18.008 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.013+0000 7f8898fbf6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8894110050 0x7f8894171370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:18.008 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.013+0000 7f8898fbf6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8894110a00 0x7f88940f8cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:18.009 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.013+0000 7f8898fbf6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f88940f9940 con 0x7f8894110050 2026-02-13T03:33:18.009 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.013+0000 7f8898fbf6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f88940f9ab0 con 0x7f889410eed0 2026-02-13T03:33:18.009 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.013+0000 7f8898fbf6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f88940f9c70 con 0x7f8894110a00 2026-02-13T03:33:18.009 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.013+0000 7f88925756c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f889410eed0 0x7f88940f84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:18.009 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.013+0000 7f88925756c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f889410eed0 0x7f88940f84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.132:3300/0 says I am v2:10.20.193.132:53412/0 (socket says 10.20.193.132:53412) 2026-02-13T03:33:18.009 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.013+0000 7f88925756c0 1 -- 10.20.193.132:0/2987834730 learned_addr learned my addr 10.20.193.132:0/2987834730 (peer_addr_for_me v2:10.20.193.132:0/0) 2026-02-13T03:33:18.009 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.013+0000 7f8891d746c0 1 --2- 10.20.193.132:0/2987834730 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8894110050 0x7f8894171370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:18.009 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.013+0000 7f8892d766c0 1 --2- 10.20.193.132:0/2987834730 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8894110a00 0x7f88940f8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:18.009 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.014+0000 7f88925756c0 1 -- 10.20.193.132:0/2987834730 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8894110a00 msgr2=0x7f88940f8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:18.009 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.014+0000 7f88925756c0 1 --2- 10.20.193.132:0/2987834730 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8894110a00 0x7f88940f8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:18.009 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.014+0000 7f88925756c0 1 -- 10.20.193.132:0/2987834730 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8894110050 msgr2=0x7f8894171370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:18.010 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.014+0000 7f88925756c0 1 --2- 10.20.193.132:0/2987834730 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8894110050 0x7f8894171370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:18.010 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.014+0000 7f88925756c0 1 -- 10.20.193.132:0/2987834730 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f888400a660 con 0x7f889410eed0 2026-02-13T03:33:18.010 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.014+0000 7f88925756c0 1 --2- 10.20.193.132:0/2987834730 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f889410eed0 0x7f88940f84b0 secure :-1 s=READY pgs=26 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f888800b710 tx=0x7f888800bbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:18.010 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.014+0000 7f887b7fe6c0 1 -- 10.20.193.132:0/2987834730 <== mon.2 v2:10.20.193.132:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8888004250 con 0x7f889410eed0 2026-02-13T03:33:18.010 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.014+0000 7f887b7fe6c0 1 -- 10.20.193.132:0/2987834730 <== mon.2 v2:10.20.193.132:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f8888002da0 con 0x7f889410eed0 2026-02-13T03:33:18.010 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.014+0000 7f8898fbf6c0 1 -- 10.20.193.132:0/2987834730 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88940f9ef0 con 0x7f889410eed0 2026-02-13T03:33:18.010 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.014+0000 7f887b7fe6c0 1 -- 10.20.193.132:0/2987834730 <== mon.2 v2:10.20.193.132:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f888800ce30 con 0x7f889410eed0 2026-02-13T03:33:18.010 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.014+0000 7f8898fbf6c0 1 -- 10.20.193.132:0/2987834730 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88940fa420 con 0x7f889410eed0 2026-02-13T03:33:18.010 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.014+0000 7f8898fbf6c0 1 -- 10.20.193.132:0/2987834730 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8894175460 con 0x7f889410eed0 2026-02-13T03:33:18.011 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.016+0000 7f887b7fe6c0 1 -- 10.20.193.132:0/2987834730 <== mon.2 v2:10.20.193.132:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f88880028c0 con 0x7f889410eed0 2026-02-13T03:33:18.011 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.016+0000 7f887b7fe6c0 1 --2- 10.20.193.132:0/2987834730 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f886c0b5680 0x7f886c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:18.011 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.016+0000 7f887b7fe6c0 1 -- 10.20.193.132:0/2987834730 <== mon.2 v2:10.20.193.132:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4446+0+0 (secure 0 0 0) 0x7f88880e2ca0 con 0x7f889410eed0 2026-02-13T03:33:18.012 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.016+0000 7f8891d746c0 1 --2- 10.20.193.132:0/2987834730 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f886c0b5680 0x7f886c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:18.012 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.017+0000 7f8891d746c0 1 --2- 10.20.193.132:0/2987834730 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f886c0b5680 0x7f886c0d5b30 secure :-1 s=READY pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f887c004750 tx=0x7f887c009190 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:18.012 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.017+0000 7f887b7fe6c0 1 -- 10.20.193.132:0/2987834730 <== mon.2 v2:10.20.193.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f88880a6560 con 0x7f889410eed0 2026-02-13T03:33:18.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:17 trial133 ceph-mon[26943]: pgmap v91: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T03:33:18.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:17 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:18.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:17 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:18.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:17 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:18.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:17 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:18.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:17 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:18.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:17 trial133 ceph-mon[26943]: pgmap v92: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T03:33:18.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:17 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:18.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:17 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:18.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:17 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:18.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:17 trial133 ceph-mon[26943]: from='osd.6 [v2:10.20.193.96:6818/4035362295,v1:10.20.193.96:6819/4035362295]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T03:33:18.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:17 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:18.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:17 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:18.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:17 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:18.107 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:18.114+0000 7f8898fbf6c0 1 -- 10.20.193.132:0/2987834730 --> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial132:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f88940efd70 con 0x7f886c0b5680 2026-02-13T03:33:18.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:18 trial132 ceph-mon[26888]: pgmap v93: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T03:33:18.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:18 trial132 ceph-mon[26888]: from='osd.6 [v2:10.20.193.96:6818/4035362295,v1:10.20.193.96:6819/4035362295]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T03:33:18.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:18 trial132 ceph-mon[26888]: osdmap e34: 7 total, 6 up, 7 in 2026-02-13T03:33:18.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:18 trial132 ceph-mon[26888]: from='osd.6 [v2:10.20.193.96:6818/4035362295,v1:10.20.193.96:6819/4035362295]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial096", "root=default"]} : dispatch 2026-02-13T03:33:18.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:18.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:18.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:18.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:18.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:18.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:18.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:18.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:18.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:18.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:18.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:18.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:18.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:18.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:18.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:18.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:18.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:18.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:19.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:18 trial133 ceph-mon[26943]: pgmap v93: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T03:33:19.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:18 trial133 ceph-mon[26943]: from='osd.6 [v2:10.20.193.96:6818/4035362295,v1:10.20.193.96:6819/4035362295]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T03:33:19.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:18 trial133 ceph-mon[26943]: osdmap e34: 7 total, 6 up, 7 in 2026-02-13T03:33:19.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:18 trial133 ceph-mon[26943]: from='osd.6 [v2:10.20.193.96:6818/4035362295,v1:10.20.193.96:6819/4035362295]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial096", "root=default"]} : dispatch 2026-02-13T03:33:19.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:19.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:19.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:19.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:19.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:19.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:19.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:19.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:19.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:19.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:19.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:19.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:19.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:19.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:19.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:19.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:19.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:19.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:19.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:18 trial096 ceph-mon[24671]: pgmap v93: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T03:33:19.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:18 trial096 ceph-mon[24671]: from='osd.6 [v2:10.20.193.96:6818/4035362295,v1:10.20.193.96:6819/4035362295]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T03:33:19.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:18 trial096 ceph-mon[24671]: osdmap e34: 7 total, 6 up, 7 in 2026-02-13T03:33:19.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:18 trial096 ceph-mon[24671]: from='osd.6 [v2:10.20.193.96:6818/4035362295,v1:10.20.193.96:6819/4035362295]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial096", "root=default"]} : dispatch 2026-02-13T03:33:19.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:19.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:19.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:19.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:19.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:19.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:19.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:19.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:19.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:19.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:19.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:19.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:19.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:19.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:19.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:19.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:19.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:19.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:19.176 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:33:18 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6[49624]: 2026-02-13T03:33:18.685+0000 7ff3f9acf6c0 -1 osd.6 0 waiting for initial osdmap 2026-02-13T03:33:19.176 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:33:18 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6[49624]: 2026-02-13T03:33:18.690+0000 7ff3f59936c0 -1 osd.6 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:33:19.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:19 trial132 ceph-mon[26888]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial132:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:33:19.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:19 trial132 ceph-mon[26888]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 136 KiB/s, 0 objects/s recovering 2026-02-13T03:33:19.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:19 trial132 ceph-mon[26888]: from='osd.6 [v2:10.20.193.96:6818/4035362295,v1:10.20.193.96:6819/4035362295]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial096", "root=default"]}]': finished 2026-02-13T03:33:19.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:19 trial132 ceph-mon[26888]: osdmap e35: 7 total, 6 up, 7 in 2026-02-13T03:33:19.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:19 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:19.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:19 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:19.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:19 trial132 ceph-mon[26888]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c7d1b3d6-d6c9-4ee2-a767-45dc6a68e941"} : dispatch 2026-02-13T03:33:19.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:19 trial132 ceph-mon[26888]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7d1b3d6-d6c9-4ee2-a767-45dc6a68e941"}]': finished 2026-02-13T03:33:19.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:19 trial132 ceph-mon[26888]: osd.6 [v2:10.20.193.96:6818/4035362295,v1:10.20.193.96:6819/4035362295] boot 2026-02-13T03:33:19.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:19 trial132 ceph-mon[26888]: osdmap e36: 8 total, 7 up, 8 in 2026-02-13T03:33:19.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:19 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:19.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:19 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:33:19.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:19 trial132 ceph-mon[26888]: from='client.? 10.20.193.132:0/1009405899' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c7d1b3d6-d6c9-4ee2-a767-45dc6a68e941"} : dispatch 2026-02-13T03:33:19.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:19 trial132 ceph-mon[26888]: from='client.? 10.20.193.132:0/10037371' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:33:19.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:19 trial132 ceph-mon[26888]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:19.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:19 trial132 ceph-mon[26888]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2026-02-13T03:33:19.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:19 trial132 ceph-mon[26888]: Cluster is now healthy 2026-02-13T03:33:20.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:19 trial133 ceph-mon[26943]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial132:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:33:20.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:19 trial133 ceph-mon[26943]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 136 KiB/s, 0 objects/s recovering 2026-02-13T03:33:20.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:19 trial133 ceph-mon[26943]: from='osd.6 [v2:10.20.193.96:6818/4035362295,v1:10.20.193.96:6819/4035362295]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial096", "root=default"]}]': finished 2026-02-13T03:33:20.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:19 trial133 ceph-mon[26943]: osdmap e35: 7 total, 6 up, 7 in 2026-02-13T03:33:20.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:19 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:20.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:19 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:20.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:19 trial133 ceph-mon[26943]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c7d1b3d6-d6c9-4ee2-a767-45dc6a68e941"} : dispatch 2026-02-13T03:33:20.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:19 trial133 ceph-mon[26943]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7d1b3d6-d6c9-4ee2-a767-45dc6a68e941"}]': finished 2026-02-13T03:33:20.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:19 trial133 ceph-mon[26943]: osd.6 [v2:10.20.193.96:6818/4035362295,v1:10.20.193.96:6819/4035362295] boot 2026-02-13T03:33:20.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:19 trial133 ceph-mon[26943]: osdmap e36: 8 total, 7 up, 8 in 2026-02-13T03:33:20.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:19 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:20.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:19 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:33:20.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:19 trial133 ceph-mon[26943]: from='client.? 10.20.193.132:0/1009405899' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c7d1b3d6-d6c9-4ee2-a767-45dc6a68e941"} : dispatch 2026-02-13T03:33:20.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:19 trial133 ceph-mon[26943]: from='client.? 10.20.193.132:0/10037371' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:33:20.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:19 trial133 ceph-mon[26943]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:20.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:19 trial133 ceph-mon[26943]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2026-02-13T03:33:20.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:19 trial133 ceph-mon[26943]: Cluster is now healthy 2026-02-13T03:33:20.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:19 trial096 ceph-mon[24671]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial132:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:33:20.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:19 trial096 ceph-mon[24671]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 136 KiB/s, 0 objects/s recovering 2026-02-13T03:33:20.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:19 trial096 ceph-mon[24671]: from='osd.6 [v2:10.20.193.96:6818/4035362295,v1:10.20.193.96:6819/4035362295]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial096", "root=default"]}]': finished 2026-02-13T03:33:20.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:19 trial096 ceph-mon[24671]: osdmap e35: 7 total, 6 up, 7 in 2026-02-13T03:33:20.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:19 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:20.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:19 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:20.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:19 trial096 ceph-mon[24671]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c7d1b3d6-d6c9-4ee2-a767-45dc6a68e941"} : dispatch 2026-02-13T03:33:20.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:19 trial096 ceph-mon[24671]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7d1b3d6-d6c9-4ee2-a767-45dc6a68e941"}]': finished 2026-02-13T03:33:20.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:19 trial096 ceph-mon[24671]: osd.6 [v2:10.20.193.96:6818/4035362295,v1:10.20.193.96:6819/4035362295] boot 2026-02-13T03:33:20.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:19 trial096 ceph-mon[24671]: osdmap e36: 8 total, 7 up, 8 in 2026-02-13T03:33:20.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:19 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:33:20.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:19 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:33:20.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:19 trial096 ceph-mon[24671]: from='client.? 10.20.193.132:0/1009405899' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c7d1b3d6-d6c9-4ee2-a767-45dc6a68e941"} : dispatch 2026-02-13T03:33:20.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:19 trial096 ceph-mon[24671]: from='client.? 10.20.193.132:0/10037371' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:33:20.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:19 trial096 ceph-mon[24671]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:20.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:19 trial096 ceph-mon[24671]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2026-02-13T03:33:20.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:19 trial096 ceph-mon[24671]: Cluster is now healthy 2026-02-13T03:33:20.943 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:20 trial132 ceph-mon[26888]: purged_snaps scrub starts 2026-02-13T03:33:20.943 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:20 trial132 ceph-mon[26888]: purged_snaps scrub ok 2026-02-13T03:33:21.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:20 trial133 ceph-mon[26943]: purged_snaps scrub starts 2026-02-13T03:33:21.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:20 trial133 ceph-mon[26943]: purged_snaps scrub ok 2026-02-13T03:33:21.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:20 trial096 ceph-mon[24671]: purged_snaps scrub starts 2026-02-13T03:33:21.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:20 trial096 ceph-mon[24671]: purged_snaps scrub ok 2026-02-13T03:33:21.750 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:21 trial132 ceph-mon[26888]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail; 160 KiB/s, 0 objects/s recovering 2026-02-13T03:33:21.751 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:21 trial132 ceph-mon[26888]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail; 168 KiB/s, 0 objects/s recovering 2026-02-13T03:33:21.751 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:21.751 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:21.751 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:21.751 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:21.751 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:21.751 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:21.751 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:21 trial132 ceph-mon[26888]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail; 179 KiB/s, 0 objects/s recovering 2026-02-13T03:33:21.751 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:21.751 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:21.751 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:21.752 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T03:33:21.752 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:21 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:22.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:21 trial133 ceph-mon[26943]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail; 160 KiB/s, 0 objects/s recovering 2026-02-13T03:33:22.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:21 trial133 ceph-mon[26943]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail; 168 KiB/s, 0 objects/s recovering 2026-02-13T03:33:22.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:22.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:22.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:22.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:22.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:22.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:22.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:21 trial133 ceph-mon[26943]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail; 179 KiB/s, 0 objects/s recovering 2026-02-13T03:33:22.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:22.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:22.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:22.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T03:33:22.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:21 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:22.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:21 trial096 ceph-mon[24671]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail; 160 KiB/s, 0 objects/s recovering 2026-02-13T03:33:22.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:21 trial096 ceph-mon[24671]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail; 168 KiB/s, 0 objects/s recovering 2026-02-13T03:33:22.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:22.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:22.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:22.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:22.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:22.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:22.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:21 trial096 ceph-mon[24671]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail; 179 KiB/s, 0 objects/s recovering 2026-02-13T03:33:22.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:22.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:22.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:22.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T03:33:22.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:21 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:22.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:22 trial132 ceph-mon[26888]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:33:22.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:22 trial132 ceph-mon[26888]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:23.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:22 trial133 ceph-mon[26943]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:33:23.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:22 trial133 ceph-mon[26943]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:23.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:22 trial096 ceph-mon[24671]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:33:23.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:22 trial096 ceph-mon[24671]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:23.962 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:23 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:23.962 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:23 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:23.963 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:23 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:24.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:23 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:24.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:23 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:24.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:23 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:24.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:23 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:24.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:23 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:24.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:23 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:24.585 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:24.593+0000 7f887b7fe6c0 1 -- 10.20.193.132:0/2987834730 <== mgr.14116 v2:10.20.193.96:6800/1736050816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f88940efd70 con 0x7f886c0b5680 2026-02-13T03:33:24.586 INFO:teuthology.orchestra.run.trial132.stdout:Created osd(s) 7 on host 'trial132' 2026-02-13T03:33:24.588 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:24.595+0000 7f8898fbf6c0 1 -- 10.20.193.132:0/2987834730 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f886c0b5680 msgr2=0x7f886c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:24.588 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:24.595+0000 7f8898fbf6c0 1 --2- 10.20.193.132:0/2987834730 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f886c0b5680 0x7f886c0d5b30 secure :-1 s=READY pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f887c004750 tx=0x7f887c009190 comp rx=0 tx=0).stop 2026-02-13T03:33:24.588 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:24.595+0000 7f8898fbf6c0 1 -- 10.20.193.132:0/2987834730 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f889410eed0 msgr2=0x7f88940f84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:24.588 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:24.595+0000 7f8898fbf6c0 1 --2- 10.20.193.132:0/2987834730 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f889410eed0 0x7f88940f84b0 secure :-1 s=READY pgs=26 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f888800b710 tx=0x7f888800bbe0 comp rx=0 tx=0).stop 2026-02-13T03:33:24.588 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:24.595+0000 7f8898fbf6c0 1 -- 10.20.193.132:0/2987834730 shutdown_connections 2026-02-13T03:33:24.588 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:24.595+0000 7f8898fbf6c0 1 --2- 10.20.193.132:0/2987834730 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f886c0b5680 0x7f886c0d5b30 unknown :-1 s=CLOSED pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:24.589 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:24.595+0000 7f8898fbf6c0 1 --2- 10.20.193.132:0/2987834730 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8894110a00 0x7f88940f8cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:24.589 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:24.595+0000 7f8898fbf6c0 1 --2- 10.20.193.132:0/2987834730 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8894110050 0x7f8894171370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:24.589 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:24.595+0000 7f8898fbf6c0 1 --2- 10.20.193.132:0/2987834730 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f889410eed0 0x7f88940f84b0 unknown :-1 s=CLOSED pgs=26 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:24.589 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:24.595+0000 7f8898fbf6c0 1 -- 10.20.193.132:0/2987834730 >> 10.20.193.132:0/2987834730 conn(0x7f88940ec5f0 msgr2=0x7f88940ee580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:24.589 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:24.595+0000 7f8898fbf6c0 1 -- 10.20.193.132:0/2987834730 shutdown_connections 2026-02-13T03:33:24.589 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:24.595+0000 7f8898fbf6c0 1 -- 10.20.193.132:0/2987834730 wait complete. 2026-02-13T03:33:24.628 DEBUG:teuthology.orchestra.run.trial132:osd.7> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.7.service 2026-02-13T03:33:24.630 INFO:tasks.cephadm:Deploying osd.8 on trial133 with /dev/vg_nvme/lv_2... 2026-02-13T03:33:24.631 DEBUG:teuthology.orchestra.run.trial133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T03:33:24.752 INFO:teuthology.orchestra.run.trial133.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.c/config 2026-02-13T03:33:24.966 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:24 trial133 ceph-mon[26943]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:33:24.966 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:24.966 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:24.967 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:24.967 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:24.967 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:24.967 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:24.967 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:24.967 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:24.967 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:24 trial133 ceph-mon[26943]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T03:33:24.967 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:24 trial133 ceph-mon[26943]: from='osd.7 [v2:10.20.193.132:6816/2832704836,v1:10.20.193.132:6817/2832704836]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T03:33:24.967 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:24 trial133 ceph-mon[26943]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:24.967 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:24 trial133 ceph-mon[26943]: Cluster is now healthy 2026-02-13T03:33:24.967 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:24.967 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:24 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:24.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:24 trial132 ceph-mon[26888]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:33:24.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:24.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:24.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:24.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:24.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:24.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:24.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:24.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:24.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:24 trial132 ceph-mon[26888]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T03:33:24.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:24 trial132 ceph-mon[26888]: from='osd.7 [v2:10.20.193.132:6816/2832704836,v1:10.20.193.132:6817/2832704836]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T03:33:24.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:24 trial132 ceph-mon[26888]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:24.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:24 trial132 ceph-mon[26888]: Cluster is now healthy 2026-02-13T03:33:24.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:24.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:24 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:25.169 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:33:25.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:24 trial096 ceph-mon[24671]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:33:25.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:25.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:25.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:25.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:25.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:25.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:25.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:25.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:25.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:24 trial096 ceph-mon[24671]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T03:33:25.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:24 trial096 ceph-mon[24671]: from='osd.7 [v2:10.20.193.132:6816/2832704836,v1:10.20.193.132:6817/2832704836]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T03:33:25.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:24 trial096 ceph-mon[24671]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:25.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:24 trial096 ceph-mon[24671]: Cluster is now healthy 2026-02-13T03:33:25.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:25.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:24 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:25.186 DEBUG:teuthology.orchestra.run.trial133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph orch daemon add osd trial133:vg_nvme/lv_2 --skip-validation 2026-02-13T03:33:25.303 INFO:teuthology.orchestra.run.trial133.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.c/config 2026-02-13T03:33:25.425 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.420+0000 7f6fc0de46c0 1 -- 10.20.193.133:0/205869097 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6fbc10ddd0 msgr2=0x7f6fbc10e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:25.426 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.420+0000 7f6fc0de46c0 1 --2- 10.20.193.133:0/205869097 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6fbc10ddd0 0x7f6fbc10e240 secure :-1 s=READY pgs=25 gs=1 cs=0 l=1 c_cookie=5424317324798548988 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fa4009970 tx=0x7f6fa402ed20 comp rx=0 tx=0).stop 2026-02-13T03:33:25.426 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.420+0000 7f6fc0de46c0 1 -- 10.20.193.133:0/205869097 shutdown_connections 2026-02-13T03:33:25.426 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.420+0000 7f6fc0de46c0 1 --2- 10.20.193.133:0/205869097 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6fbc10e780 0x7f6fbc16f110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:25.426 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.420+0000 7f6fc0de46c0 1 --2- 10.20.193.133:0/205869097 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6fbc10ddd0 0x7f6fbc10e240 unknown :-1 s=CLOSED pgs=25 gs=1 cs=0 l=1 c_cookie=5424317324798548988 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:25.426 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.420+0000 7f6fc0de46c0 1 --2- 10.20.193.133:0/205869097 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6fbc10cc50 0x7f6fbc10d040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:25.426 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.420+0000 7f6fc0de46c0 1 -- 10.20.193.133:0/205869097 >> 10.20.193.133:0/205869097 conn(0x7f6fbc0ea370 msgr2=0x7f6fbc10a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:25.426 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.420+0000 7f6fc0de46c0 1 -- 10.20.193.133:0/205869097 shutdown_connections 2026-02-13T03:33:25.426 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.420+0000 7f6fc0de46c0 1 -- 10.20.193.133:0/205869097 wait complete. 2026-02-13T03:33:25.426 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.421+0000 7f6fc0de46c0 1 Processor -- start 2026-02-13T03:33:25.426 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.421+0000 7f6fc0de46c0 1 -- start start 2026-02-13T03:33:25.426 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.421+0000 7f6fc0de46c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6fbc10cc50 0x7f6fbc061ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:25.427 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.421+0000 7f6fc0de46c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6fbc10ddd0 0x7f6fbc16f110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:25.427 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.421+0000 7f6fc0de46c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6fbc10e780 0x7f6fbc0607a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:25.427 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.421+0000 7f6fc0de46c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f6fbc060dc0 con 0x7f6fbc10e780 2026-02-13T03:33:25.427 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.421+0000 7f6fc0de46c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6fbc060f30 con 0x7f6fbc10ddd0 2026-02-13T03:33:25.427 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.421+0000 7f6fc0de46c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6fbc0610f0 con 0x7f6fbc10cc50 2026-02-13T03:33:25.427 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.421+0000 7f6fba5756c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6fbc10cc50 0x7f6fbc061ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:25.427 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.421+0000 7f6fba5756c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6fbc10cc50 0x7f6fbc061ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.133:3300/0 says I am v2:10.20.193.133:47662/0 (socket says 10.20.193.133:47662) 2026-02-13T03:33:25.427 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.421+0000 7f6fba5756c0 1 -- 10.20.193.133:0/3464063423 learned_addr learned my addr 10.20.193.133:0/3464063423 (peer_addr_for_me v2:10.20.193.133:0/0) 2026-02-13T03:33:25.427 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.421+0000 7f6fb9d746c0 1 --2- 10.20.193.133:0/3464063423 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6fbc10ddd0 0x7f6fbc16f110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:25.427 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.421+0000 7f6fbad766c0 1 --2- 10.20.193.133:0/3464063423 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6fbc10e780 0x7f6fbc0607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:25.427 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.421+0000 7f6fba5756c0 1 -- 10.20.193.133:0/3464063423 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6fbc10ddd0 msgr2=0x7f6fbc16f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:25.427 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.421+0000 7f6fba5756c0 1 --2- 10.20.193.133:0/3464063423 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6fbc10ddd0 0x7f6fbc16f110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:25.428 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.421+0000 7f6fba5756c0 1 -- 10.20.193.133:0/3464063423 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6fbc10e780 msgr2=0x7f6fbc0607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:25.428 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.421+0000 7f6fba5756c0 1 --2- 10.20.193.133:0/3464063423 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6fbc10e780 0x7f6fbc0607a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:25.428 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.421+0000 7f6fba5756c0 1 -- 10.20.193.133:0/3464063423 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa4009590 con 0x7f6fbc10cc50 2026-02-13T03:33:25.428 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.421+0000 7f6fba5756c0 1 --2- 10.20.193.133:0/3464063423 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6fbc10cc50 0x7f6fbc061ea0 secure :-1 s=READY pgs=26 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fb0005dc0 tx=0x7f6fb000bbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:25.428 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.421+0000 7f6fa37fe6c0 1 -- 10.20.193.133:0/3464063423 <== mon.1 v2:10.20.193.133:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6fb0004250 con 0x7f6fbc10cc50 2026-02-13T03:33:25.428 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.421+0000 7f6fc0de46c0 1 -- 10.20.193.133:0/3464063423 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fbc0613d0 con 0x7f6fbc10cc50 2026-02-13T03:33:25.428 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.421+0000 7f6fa37fe6c0 1 -- 10.20.193.133:0/3464063423 <== mon.1 v2:10.20.193.133:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f6fb0009070 con 0x7f6fbc10cc50 2026-02-13T03:33:25.428 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.421+0000 7f6fc0de46c0 1 -- 10.20.193.133:0/3464063423 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fbc0fa5a0 con 0x7f6fbc10cc50 2026-02-13T03:33:25.428 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.421+0000 7f6fa37fe6c0 1 -- 10.20.193.133:0/3464063423 <== mon.1 v2:10.20.193.133:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6fb000cdb0 con 0x7f6fbc10cc50 2026-02-13T03:33:25.428 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.422+0000 7f6fc0de46c0 1 -- 10.20.193.133:0/3464063423 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fbc173180 con 0x7f6fbc10cc50 2026-02-13T03:33:25.429 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.423+0000 7f6fa37fe6c0 1 -- 10.20.193.133:0/3464063423 <== mon.1 v2:10.20.193.133:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f6fb00028c0 con 0x7f6fbc10cc50 2026-02-13T03:33:25.430 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.423+0000 7f6fa37fe6c0 1 --2- 10.20.193.133:0/3464063423 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f6f940b5680 0x7f6f940d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:25.430 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.424+0000 7f6fa37fe6c0 1 -- 10.20.193.133:0/3464063423 <== mon.1 v2:10.20.193.133:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4878+0+0 (secure 0 0 0) 0x7f6fb00e2dc0 con 0x7f6fbc10cc50 2026-02-13T03:33:25.430 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.424+0000 7f6fb9d746c0 1 --2- 10.20.193.133:0/3464063423 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f6f940b5680 0x7f6f940d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:25.430 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.424+0000 7f6fa37fe6c0 1 -- 10.20.193.133:0/3464063423 <== mon.1 v2:10.20.193.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6fb00a6490 con 0x7f6fbc10cc50 2026-02-13T03:33:25.430 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.424+0000 7f6fb9d746c0 1 --2- 10.20.193.133:0/3464063423 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f6f940b5680 0x7f6f940d5b30 secure :-1 s=READY pgs=118 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fa40023e0 tx=0x7f6fa4005f40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:25.523 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:25.520+0000 7f6fc0de46c0 1 -- 10.20.193.133:0/3464063423 --> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial133:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f6fbc04ca20 con 0x7f6f940b5680 2026-02-13T03:33:25.952 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:25 trial133 ceph-mon[26943]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:33:25.952 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:25 trial133 ceph-mon[26943]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:33:25.952 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:25 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:25.952 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:25 trial133 ceph-mon[26943]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T03:33:25.952 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:25 trial133 ceph-mon[26943]: osdmap e37: 8 total, 7 up, 8 in 2026-02-13T03:33:25.952 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:25 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:33:25.953 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:25 trial133 ceph-mon[26943]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial132", "root=default"]} : dispatch 2026-02-13T03:33:25.953 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:25 trial133 ceph-mon[26943]: from='osd.7 [v2:10.20.193.132:6816/2832704836,v1:10.20.193.132:6817/2832704836]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial132", "root=default"]} : dispatch 2026-02-13T03:33:25.953 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:25 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:25.953 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:25 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:25.953 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:25 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:25.953 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:25 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:25.953 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:25 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:25.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:25 trial132 ceph-mon[26888]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:33:25.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:25 trial132 ceph-mon[26888]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:33:25.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:25 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:25.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:25 trial132 ceph-mon[26888]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T03:33:25.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:25 trial132 ceph-mon[26888]: osdmap e37: 8 total, 7 up, 8 in 2026-02-13T03:33:25.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:25 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:33:25.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:25 trial132 ceph-mon[26888]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial132", "root=default"]} : dispatch 2026-02-13T03:33:25.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:25 trial132 ceph-mon[26888]: from='osd.7 [v2:10.20.193.132:6816/2832704836,v1:10.20.193.132:6817/2832704836]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial132", "root=default"]} : dispatch 2026-02-13T03:33:25.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:25 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:25.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:25 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:25.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:25 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:25.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:25 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:25.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:25 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:26.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:25 trial096 ceph-mon[24671]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:33:26.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:25 trial096 ceph-mon[24671]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:33:26.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:25 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:26.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:25 trial096 ceph-mon[24671]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T03:33:26.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:25 trial096 ceph-mon[24671]: osdmap e37: 8 total, 7 up, 8 in 2026-02-13T03:33:26.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:25 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:33:26.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:25 trial096 ceph-mon[24671]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial132", "root=default"]} : dispatch 2026-02-13T03:33:26.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:25 trial096 ceph-mon[24671]: from='osd.7 [v2:10.20.193.132:6816/2832704836,v1:10.20.193.132:6817/2832704836]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial132", "root=default"]} : dispatch 2026-02-13T03:33:26.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:25 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:26.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:25 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:26.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:25 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:26.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:25 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:26.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:25 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:26.483 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:33:26 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:33:26.176+0000 7fa1810b06c0 -1 osd.7 0 waiting for initial osdmap 2026-02-13T03:33:26.483 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:33:26 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:33:26.181+0000 7fa178f6c6c0 -1 osd.7 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:33:26.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial133:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:33:26.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:26.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:26.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:26.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:26.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:26.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:26.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:26.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:26.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:26.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:26.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:33:26.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:26.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:26.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:26.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial132", "root=default"]}]': finished 2026-02-13T03:33:26.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: osdmap e38: 8 total, 7 up, 8 in 2026-02-13T03:33:26.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:33:26.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:33:26.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: from='client.? 10.20.193.133:0/2183348009' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "27d57241-5de9-4678-a519-7d218f165183"} : dispatch 2026-02-13T03:33:26.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "27d57241-5de9-4678-a519-7d218f165183"} : dispatch 2026-02-13T03:33:26.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "27d57241-5de9-4678-a519-7d218f165183"}]': finished 2026-02-13T03:33:26.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: osd.7 [v2:10.20.193.132:6816/2832704836,v1:10.20.193.132:6817/2832704836] boot 2026-02-13T03:33:26.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: osdmap e39: 9 total, 8 up, 9 in 2026-02-13T03:33:26.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:33:26.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:26.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: from='client.? 10.20.193.133:0/3466842068' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:33:26.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: osdmap e40: 9 total, 8 up, 9 in 2026-02-13T03:33:26.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:26 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:27.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial133:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:33:27.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:27.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:27.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:27.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:27.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:27.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:27.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:27.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:27.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:27.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:27.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:33:27.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:27.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:27.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:27.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial132", "root=default"]}]': finished 2026-02-13T03:33:27.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: osdmap e38: 8 total, 7 up, 8 in 2026-02-13T03:33:27.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:33:27.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:33:27.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: from='client.? 10.20.193.133:0/2183348009' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "27d57241-5de9-4678-a519-7d218f165183"} : dispatch 2026-02-13T03:33:27.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "27d57241-5de9-4678-a519-7d218f165183"} : dispatch 2026-02-13T03:33:27.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "27d57241-5de9-4678-a519-7d218f165183"}]': finished 2026-02-13T03:33:27.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: osd.7 [v2:10.20.193.132:6816/2832704836,v1:10.20.193.132:6817/2832704836] boot 2026-02-13T03:33:27.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: osdmap e39: 9 total, 8 up, 9 in 2026-02-13T03:33:27.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:33:27.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:27.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: from='client.? 10.20.193.133:0/3466842068' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:33:27.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: osdmap e40: 9 total, 8 up, 9 in 2026-02-13T03:33:27.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:26 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:27.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial133:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:33:27.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:27.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:27.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:27.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:27.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:27.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:27.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:27.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:27.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:27.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:27.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:33:27.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:27.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:27.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:27.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial132", "root=default"]}]': finished 2026-02-13T03:33:27.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: osdmap e38: 8 total, 7 up, 8 in 2026-02-13T03:33:27.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:33:27.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:33:27.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: from='client.? 10.20.193.133:0/2183348009' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "27d57241-5de9-4678-a519-7d218f165183"} : dispatch 2026-02-13T03:33:27.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "27d57241-5de9-4678-a519-7d218f165183"} : dispatch 2026-02-13T03:33:27.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "27d57241-5de9-4678-a519-7d218f165183"}]': finished 2026-02-13T03:33:27.177 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: osd.7 [v2:10.20.193.132:6816/2832704836,v1:10.20.193.132:6817/2832704836] boot 2026-02-13T03:33:27.177 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: osdmap e39: 9 total, 8 up, 9 in 2026-02-13T03:33:27.177 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:33:27.177 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:27.177 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: from='client.? 10.20.193.133:0/3466842068' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:33:27.177 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: osdmap e40: 9 total, 8 up, 9 in 2026-02-13T03:33:27.177 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:26 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:27.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:27 trial132 ceph-mon[26888]: purged_snaps scrub starts 2026-02-13T03:33:27.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:27 trial132 ceph-mon[26888]: purged_snaps scrub ok 2026-02-13T03:33:27.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:27 trial132 ceph-mon[26888]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:27.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:27 trial132 ceph-mon[26888]: Cluster is now healthy 2026-02-13T03:33:27.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:27 trial132 ceph-mon[26888]: osdmap e41: 9 total, 8 up, 9 in 2026-02-13T03:33:27.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:27 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:27.991 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:27 trial133 ceph-mon[26943]: purged_snaps scrub starts 2026-02-13T03:33:27.991 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:27 trial133 ceph-mon[26943]: purged_snaps scrub ok 2026-02-13T03:33:27.992 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:27 trial133 ceph-mon[26943]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:27.992 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:27 trial133 ceph-mon[26943]: Cluster is now healthy 2026-02-13T03:33:27.992 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:27 trial133 ceph-mon[26943]: osdmap e41: 9 total, 8 up, 9 in 2026-02-13T03:33:27.992 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:27 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:28.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:27 trial096 ceph-mon[24671]: purged_snaps scrub starts 2026-02-13T03:33:28.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:27 trial096 ceph-mon[24671]: purged_snaps scrub ok 2026-02-13T03:33:28.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:27 trial096 ceph-mon[24671]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:28.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:27 trial096 ceph-mon[24671]: Cluster is now healthy 2026-02-13T03:33:28.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:27 trial096 ceph-mon[24671]: osdmap e41: 9 total, 8 up, 9 in 2026-02-13T03:33:28.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:27 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:28.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:28 trial133 ceph-mon[26943]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 213 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:33:28.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:28 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:28.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:28 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:28.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:28 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:28.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:28 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:28.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:28 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:28.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:28 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:28.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:28 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:28.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:28 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:28.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:28 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:28.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:28 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-13T03:33:28.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:28 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:28.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:28 trial133 ceph-mon[26943]: osdmap e42: 9 total, 8 up, 9 in 2026-02-13T03:33:28.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:28 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:28.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:28 trial132 ceph-mon[26888]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 213 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:33:28.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:28 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:28.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:28 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:28.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:28 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:28.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:28 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:28.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:28 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:28.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:28 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:28.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:28 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:28.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:28 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:28.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:28 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:28.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:28 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-13T03:33:28.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:28 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:28.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:28 trial132 ceph-mon[26888]: osdmap e42: 9 total, 8 up, 9 in 2026-02-13T03:33:28.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:28 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:29.075 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:28 trial096 ceph-mon[24671]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 213 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:33:29.075 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:28 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:29.075 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:28 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:29.076 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:28 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:29.076 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:28 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:29.076 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:28 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:29.076 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:28 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:29.076 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:28 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:29.076 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:28 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:29.076 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:28 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:29.076 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:28 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-13T03:33:29.076 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:28 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:29.076 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:28 trial096 ceph-mon[24671]: osdmap e42: 9 total, 8 up, 9 in 2026-02-13T03:33:29.077 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:28 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:29.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:29 trial132 ceph-mon[26888]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:33:29.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:29 trial132 ceph-mon[26888]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:33:29.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:29 trial132 ceph-mon[26888]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:33:29.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:29 trial132 ceph-mon[26888]: osdmap e43: 9 total, 8 up, 9 in 2026-02-13T03:33:29.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:29 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:30.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:29 trial133 ceph-mon[26943]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:33:30.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:29 trial133 ceph-mon[26943]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:33:30.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:29 trial133 ceph-mon[26943]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:33:30.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:29 trial133 ceph-mon[26943]: osdmap e43: 9 total, 8 up, 9 in 2026-02-13T03:33:30.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:29 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:30.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:29 trial096 ceph-mon[24671]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:33:30.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:29 trial096 ceph-mon[24671]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:33:30.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:29 trial096 ceph-mon[24671]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:33:30.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:29 trial096 ceph-mon[24671]: osdmap e43: 9 total, 8 up, 9 in 2026-02-13T03:33:30.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:29 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:30.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:30 trial132 ceph-mon[26888]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:31.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:30 trial133 ceph-mon[26943]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:31.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:30 trial096 ceph-mon[24671]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:31.928 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:31.925+0000 7f6fa37fe6c0 1 -- 10.20.193.133:0/3464063423 <== mgr.14116 v2:10.20.193.96:6800/1736050816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f6fbc04ca20 con 0x7f6f940b5680 2026-02-13T03:33:31.928 INFO:teuthology.orchestra.run.trial133.stdout:Created osd(s) 8 on host 'trial133' 2026-02-13T03:33:31.930 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:31.927+0000 7f6fc0de46c0 1 -- 10.20.193.133:0/3464063423 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f6f940b5680 msgr2=0x7f6f940d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:31.930 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:31.927+0000 7f6fc0de46c0 1 --2- 10.20.193.133:0/3464063423 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f6f940b5680 0x7f6f940d5b30 secure :-1 s=READY pgs=118 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fa40023e0 tx=0x7f6fa4005f40 comp rx=0 tx=0).stop 2026-02-13T03:33:31.931 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:31.927+0000 7f6fc0de46c0 1 -- 10.20.193.133:0/3464063423 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6fbc10cc50 msgr2=0x7f6fbc061ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:31.931 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:31.927+0000 7f6fc0de46c0 1 --2- 10.20.193.133:0/3464063423 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6fbc10cc50 0x7f6fbc061ea0 secure :-1 s=READY pgs=26 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fb0005dc0 tx=0x7f6fb000bbb0 comp rx=0 tx=0).stop 2026-02-13T03:33:31.931 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:31.927+0000 7f6fc0de46c0 1 -- 10.20.193.133:0/3464063423 shutdown_connections 2026-02-13T03:33:31.931 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:31.927+0000 7f6fc0de46c0 1 --2- 10.20.193.133:0/3464063423 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f6f940b5680 0x7f6f940d5b30 unknown :-1 s=CLOSED pgs=118 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:31.931 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:31.927+0000 7f6fc0de46c0 1 --2- 10.20.193.133:0/3464063423 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6fbc10e780 0x7f6fbc0607a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:31.931 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:31.927+0000 7f6fc0de46c0 1 --2- 10.20.193.133:0/3464063423 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6fbc10ddd0 0x7f6fbc16f110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:31.931 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:31.927+0000 7f6fc0de46c0 1 --2- 10.20.193.133:0/3464063423 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6fbc10cc50 0x7f6fbc061ea0 unknown :-1 s=CLOSED pgs=26 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:31.931 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:31.927+0000 7f6fc0de46c0 1 -- 10.20.193.133:0/3464063423 >> 10.20.193.133:0/3464063423 conn(0x7f6fbc0ea370 msgr2=0x7f6fbc0ec8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:31.931 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:31.927+0000 7f6fc0de46c0 1 -- 10.20.193.133:0/3464063423 shutdown_connections 2026-02-13T03:33:31.931 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:31.927+0000 7f6fc0de46c0 1 -- 10.20.193.133:0/3464063423 wait complete. 2026-02-13T03:33:31.969 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:31 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:31.969 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:31 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:31.970 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:31 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:31.970 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:31 trial133 ceph-mon[26943]: pgmap v117: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:33:31.970 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:31 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:31.970 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:31 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:31.970 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:31 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:31.970 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:31 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:31.970 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:31 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:31.970 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:31 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:31.970 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:31 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:31.970 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:31 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:31.972 DEBUG:teuthology.orchestra.run.trial133:osd.8> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.8.service 2026-02-13T03:33:31.974 INFO:tasks.cephadm:Deploying osd.9 on trial096 with /dev/vg_nvme/lv_1... 2026-02-13T03:33:31.974 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T03:33:31.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:31 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:31.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:31 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:31.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:31 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:31.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:31 trial132 ceph-mon[26888]: pgmap v117: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:33:31.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:31 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:31.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:31 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:31.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:31 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:31.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:31 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:31.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:31 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:31.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:31 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:31.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:31 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:31.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:31 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:31.998 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:31 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:31.998 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:31 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:31.999 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:31 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:31.999 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:31 trial096 ceph-mon[24671]: pgmap v117: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:33:31.999 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:31 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:31.999 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:31 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:31.999 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:31 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:31.999 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:31 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:31.999 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:31 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:31.999 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:31 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:31.999 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:31 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:31.999 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:31 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:32.095 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:33:32.547 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:33:32.565 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph orch daemon add osd trial096:vg_nvme/lv_1 --skip-validation 2026-02-13T03:33:32.725 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:33:32.780 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:32 trial096 ceph-mon[24671]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:33:32.780 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:32 trial096 ceph-mon[24671]: from='osd.8 [v2:10.20.193.133:6816/3678366387,v1:10.20.193.133:6817/3678366387]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T03:33:32.780 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:32 trial096 ceph-mon[24671]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T03:33:32.780 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:32 trial096 ceph-mon[24671]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:32.780 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:32 trial096 ceph-mon[24671]: Cluster is now healthy 2026-02-13T03:33:32.780 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:32 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:32.781 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:32 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:32.781 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:32 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:32.854 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.849+0000 7f616e1876c0 1 -- 10.20.193.96:0/1216163328 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f616810eec0 msgr2=0x7f616810f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:32.855 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.849+0000 7f616e1876c0 1 --2- 10.20.193.96:0/1216163328 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f616810eec0 0x7f616810f2b0 secure :-1 s=READY pgs=174 gs=1 cs=0 l=1 c_cookie=6139338067585903346 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6154009970 tx=0x7f615402ed20 comp rx=0 tx=0).stop 2026-02-13T03:33:32.855 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.849+0000 7f616e1876c0 1 -- 10.20.193.96:0/1216163328 shutdown_connections 2026-02-13T03:33:32.855 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.849+0000 7f616e1876c0 1 --2- 10.20.193.96:0/1216163328 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f61681109f0 0x7f6168171380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:32.855 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.849+0000 7f616e1876c0 1 --2- 10.20.193.96:0/1216163328 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6168110040 0x7f61681104b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:32.855 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.849+0000 7f616e1876c0 1 --2- 10.20.193.96:0/1216163328 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f616810eec0 0x7f616810f2b0 unknown :-1 s=CLOSED pgs=174 gs=1 cs=0 l=1 c_cookie=6139338067585903346 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:32.855 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.849+0000 7f616e1876c0 1 -- 10.20.193.96:0/1216163328 >> 10.20.193.96:0/1216163328 conn(0x7f61680ec5c0 msgr2=0x7f616810c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:32.855 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.849+0000 7f616e1876c0 1 -- 10.20.193.96:0/1216163328 shutdown_connections 2026-02-13T03:33:32.855 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.849+0000 7f616e1876c0 1 -- 10.20.193.96:0/1216163328 wait complete. 2026-02-13T03:33:32.855 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.850+0000 7f616e1876c0 1 Processor -- start 2026-02-13T03:33:32.856 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.850+0000 7f616e1876c0 1 -- start start 2026-02-13T03:33:32.856 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.850+0000 7f616e1876c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f616810eec0 0x7f61680f8540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:32.856 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.850+0000 7f616e1876c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6168110040 0x7f6168171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:32.856 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.850+0000 7f616e1876c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f61681109f0 0x7f61680f8da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:32.856 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.850+0000 7f616e1876c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f61680f99d0 con 0x7f61681109f0 2026-02-13T03:33:32.856 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.850+0000 7f616e1876c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f61680f9b40 con 0x7f616810eec0 2026-02-13T03:33:32.856 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.850+0000 7f616e1876c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f61680f9d00 con 0x7f6168110040 2026-02-13T03:33:32.856 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.850+0000 7f6167fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f61681109f0 0x7f61680f8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:32.856 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.850+0000 7f6167fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f61681109f0 0x7f61680f8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:40556/0 (socket says 10.20.193.96:40556) 2026-02-13T03:33:32.856 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.850+0000 7f6167fff6c0 1 -- 10.20.193.96:0/1635506250 learned_addr learned my addr 10.20.193.96:0/1635506250 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:33:32.856 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.850+0000 7f6166ffd6c0 1 --2- 10.20.193.96:0/1635506250 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6168110040 0x7f6168171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:32.856 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.850+0000 7f6167fff6c0 1 -- 10.20.193.96:0/1635506250 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6168110040 msgr2=0x7f6168171380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:32.857 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.850+0000 7f6167fff6c0 1 --2- 10.20.193.96:0/1635506250 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6168110040 0x7f6168171380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:32.857 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.850+0000 7f6167fff6c0 1 -- 10.20.193.96:0/1635506250 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f616810eec0 msgr2=0x7f61680f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:32.857 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.850+0000 7f6167fff6c0 1 --2- 10.20.193.96:0/1635506250 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f616810eec0 0x7f61680f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:32.857 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.850+0000 7f6167fff6c0 1 -- 10.20.193.96:0/1635506250 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6154009590 con 0x7f61681109f0 2026-02-13T03:33:32.857 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.850+0000 7f6167fff6c0 1 --2- 10.20.193.96:0/1635506250 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f61681109f0 0x7f61680f8da0 secure :-1 s=READY pgs=175 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f615c00c6c0 tx=0x7f615c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:32.857 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.850+0000 7f6164ff96c0 1 -- 10.20.193.96:0/1635506250 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f615c003a30 con 0x7f61681109f0 2026-02-13T03:33:32.857 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.850+0000 7f6164ff96c0 1 -- 10.20.193.96:0/1635506250 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f615c005500 con 0x7f61681109f0 2026-02-13T03:33:32.857 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.850+0000 7f6164ff96c0 1 -- 10.20.193.96:0/1635506250 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f615c00dd80 con 0x7f61681109f0 2026-02-13T03:33:32.857 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.850+0000 7f616e1876c0 1 -- 10.20.193.96:0/1635506250 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61680f9fe0 con 0x7f61681109f0 2026-02-13T03:33:32.857 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.850+0000 7f616e1876c0 1 -- 10.20.193.96:0/1635506250 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61680fa470 con 0x7f61681109f0 2026-02-13T03:33:32.857 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.851+0000 7f616e1876c0 1 -- 10.20.193.96:0/1635506250 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6168175450 con 0x7f61681109f0 2026-02-13T03:33:32.858 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.852+0000 7f6164ff96c0 1 -- 10.20.193.96:0/1635506250 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f615c005080 con 0x7f61681109f0 2026-02-13T03:33:32.859 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.852+0000 7f6164ff96c0 1 --2- 10.20.193.96:0/1635506250 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f613c0b5680 0x7f613c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:32.859 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.853+0000 7f61677fe6c0 1 --2- 10.20.193.96:0/1635506250 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f613c0b5680 0x7f613c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:32.859 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.853+0000 7f6164ff96c0 1 -- 10.20.193.96:0/1635506250 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5310+0+0 (secure 0 0 0) 0x7f615c0e3df0 con 0x7f61681109f0 2026-02-13T03:33:32.859 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.853+0000 7f61677fe6c0 1 --2- 10.20.193.96:0/1635506250 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f613c0b5680 0x7f613c0d5b30 secure :-1 s=READY pgs=123 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61540098c0 tx=0x7f6154005bc0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:32.859 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.853+0000 7f6164ff96c0 1 -- 10.20.193.96:0/1635506250 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f615c0a7310 con 0x7f61681109f0 2026-02-13T03:33:32.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:32.949+0000 7f616e1876c0 1 -- 10.20.193.96:0/1635506250 --> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial096:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f61680f1410 con 0x7f613c0b5680 2026-02-13T03:33:32.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:32 trial132 ceph-mon[26888]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:33:32.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:32 trial132 ceph-mon[26888]: from='osd.8 [v2:10.20.193.133:6816/3678366387,v1:10.20.193.133:6817/3678366387]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T03:33:32.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:32 trial132 ceph-mon[26888]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T03:33:32.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:32 trial132 ceph-mon[26888]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:32.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:32 trial132 ceph-mon[26888]: Cluster is now healthy 2026-02-13T03:33:32.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:32 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:32.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:32 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:32.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:32 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:33.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:32 trial133 ceph-mon[26943]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:33:33.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:32 trial133 ceph-mon[26943]: from='osd.8 [v2:10.20.193.133:6816/3678366387,v1:10.20.193.133:6817/3678366387]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T03:33:33.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:32 trial133 ceph-mon[26943]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T03:33:33.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:32 trial133 ceph-mon[26943]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:33.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:32 trial133 ceph-mon[26943]: Cluster is now healthy 2026-02-13T03:33:33.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:32 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:33.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:32 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:33.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:32 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:33.850 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:33:33.851 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-13T03:33:33.851 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: from='osd.8 [v2:10.20.193.133:6816/3678366387,v1:10.20.193.133:6817/3678366387]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial133", "root=default"]} : dispatch 2026-02-13T03:33:33.851 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: osdmap e44: 9 total, 8 up, 9 in 2026-02-13T03:33:33.851 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:33.851 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial133", "root=default"]} : dispatch 2026-02-13T03:33:33.851 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:33.851 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial096:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:33:33.851 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:33.851 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:33.851 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:33.851 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:33.852 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:33.852 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:33.852 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:33.852 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:33.852 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:33.852 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:33.852 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:33.852 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:33.852 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:33.852 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:33.852 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:33.852 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:33.853 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:33 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:33.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:33:33.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-13T03:33:33.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: from='osd.8 [v2:10.20.193.133:6816/3678366387,v1:10.20.193.133:6817/3678366387]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial133", "root=default"]} : dispatch 2026-02-13T03:33:33.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: osdmap e44: 9 total, 8 up, 9 in 2026-02-13T03:33:33.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:33.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial133", "root=default"]} : dispatch 2026-02-13T03:33:33.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:33.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial096:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:33:33.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:33.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:33.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:33.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:33.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:33.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:33.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:33.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:33.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:33.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:33.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:33.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:33.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:33.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:33.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:33.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:33.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:33 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:34.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:33:34.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-13T03:33:34.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: from='osd.8 [v2:10.20.193.133:6816/3678366387,v1:10.20.193.133:6817/3678366387]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial133", "root=default"]} : dispatch 2026-02-13T03:33:34.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: osdmap e44: 9 total, 8 up, 9 in 2026-02-13T03:33:34.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:34.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial133", "root=default"]} : dispatch 2026-02-13T03:33:34.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:34.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial096:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:33:34.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:34.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:34.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:34.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:34.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:34.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:34.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:34.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:34.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:34.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:34.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:34.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:34.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:34.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:34.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:34.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:34.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:33 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:34.015 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:33:33 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:33:33.717+0000 7fab057836c0 -1 osd.8 0 waiting for initial osdmap 2026-02-13T03:33:34.016 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:33:33 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:33:33.723+0000 7faafd63f6c0 -1 osd.8 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:33:34.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:34 trial132 ceph-mon[26888]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:33:34.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:34 trial132 ceph-mon[26888]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial133", "root=default"]}]': finished 2026-02-13T03:33:34.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:34 trial132 ceph-mon[26888]: osdmap e45: 9 total, 8 up, 9 in 2026-02-13T03:33:34.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:34 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:34.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:34 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:34.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:34 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/774139156' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "93c1ae3e-3b87-4e71-b876-dcd60bbefd40"} : dispatch 2026-02-13T03:33:34.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:34 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/774139156' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93c1ae3e-3b87-4e71-b876-dcd60bbefd40"}]': finished 2026-02-13T03:33:34.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:34 trial132 ceph-mon[26888]: osd.8 [v2:10.20.193.133:6816/3678366387,v1:10.20.193.133:6817/3678366387] boot 2026-02-13T03:33:34.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:34 trial132 ceph-mon[26888]: osdmap e46: 10 total, 9 up, 10 in 2026-02-13T03:33:34.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:34 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:34.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:34 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:34.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:34 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3739515919' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:33:34.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:34 trial132 ceph-mon[26888]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:34.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:34 trial132 ceph-mon[26888]: Cluster is now healthy 2026-02-13T03:33:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:34 trial133 ceph-mon[26943]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:33:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:34 trial133 ceph-mon[26943]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial133", "root=default"]}]': finished 2026-02-13T03:33:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:34 trial133 ceph-mon[26943]: osdmap e45: 9 total, 8 up, 9 in 2026-02-13T03:33:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:34 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:34 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:34 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/774139156' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "93c1ae3e-3b87-4e71-b876-dcd60bbefd40"} : dispatch 2026-02-13T03:33:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:34 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/774139156' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93c1ae3e-3b87-4e71-b876-dcd60bbefd40"}]': finished 2026-02-13T03:33:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:34 trial133 ceph-mon[26943]: osd.8 [v2:10.20.193.133:6816/3678366387,v1:10.20.193.133:6817/3678366387] boot 2026-02-13T03:33:35.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:34 trial133 ceph-mon[26943]: osdmap e46: 10 total, 9 up, 10 in 2026-02-13T03:33:35.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:34 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:35.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:34 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:35.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:34 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3739515919' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:33:35.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:34 trial133 ceph-mon[26943]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:35.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:34 trial133 ceph-mon[26943]: Cluster is now healthy 2026-02-13T03:33:35.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:34 trial096 ceph-mon[24671]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:33:35.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:34 trial096 ceph-mon[24671]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial133", "root=default"]}]': finished 2026-02-13T03:33:35.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:34 trial096 ceph-mon[24671]: osdmap e45: 9 total, 8 up, 9 in 2026-02-13T03:33:35.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:34 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:35.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:34 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:35.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:34 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/774139156' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "93c1ae3e-3b87-4e71-b876-dcd60bbefd40"} : dispatch 2026-02-13T03:33:35.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:34 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/774139156' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93c1ae3e-3b87-4e71-b876-dcd60bbefd40"}]': finished 2026-02-13T03:33:35.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:34 trial096 ceph-mon[24671]: osd.8 [v2:10.20.193.133:6816/3678366387,v1:10.20.193.133:6817/3678366387] boot 2026-02-13T03:33:35.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:34 trial096 ceph-mon[24671]: osdmap e46: 10 total, 9 up, 10 in 2026-02-13T03:33:35.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:34 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:33:35.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:34 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:35.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:34 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3739515919' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:33:35.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:34 trial096 ceph-mon[24671]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:35.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:34 trial096 ceph-mon[24671]: Cluster is now healthy 2026-02-13T03:33:36.032 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:35 trial096 ceph-mon[24671]: purged_snaps scrub starts 2026-02-13T03:33:36.032 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:35 trial096 ceph-mon[24671]: purged_snaps scrub ok 2026-02-13T03:33:36.032 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:35 trial096 ceph-mon[24671]: osdmap e47: 10 total, 9 up, 10 in 2026-02-13T03:33:36.032 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:35 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:36.032 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:35 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:36.032 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:35 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:36.032 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:35 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:36.033 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:35 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:36.033 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:35 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:36.033 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:35 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:36.033 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:35 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:36.033 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:35 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:36.033 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:35 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:36.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:35 trial132 ceph-mon[26888]: purged_snaps scrub starts 2026-02-13T03:33:36.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:35 trial132 ceph-mon[26888]: purged_snaps scrub ok 2026-02-13T03:33:36.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:35 trial132 ceph-mon[26888]: osdmap e47: 10 total, 9 up, 10 in 2026-02-13T03:33:36.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:35 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:36.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:35 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:36.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:35 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:36.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:35 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:36.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:35 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:36.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:35 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:36.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:35 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:36.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:35 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:36.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:35 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:36.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:35 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:36.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:35 trial133 ceph-mon[26943]: purged_snaps scrub starts 2026-02-13T03:33:36.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:35 trial133 ceph-mon[26943]: purged_snaps scrub ok 2026-02-13T03:33:36.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:35 trial133 ceph-mon[26943]: osdmap e47: 10 total, 9 up, 10 in 2026-02-13T03:33:36.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:35 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:36.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:35 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:36.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:35 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:36.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:35 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:36.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:35 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:36.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:35 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:36.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:35 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:36.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:35 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:36.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:35 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:36.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:35 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:36.819 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:36 trial096 ceph-mon[24671]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T03:33:36.819 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:36 trial096 ceph-mon[24671]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T03:33:36.819 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:36 trial096 ceph-mon[24671]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T03:33:36.819 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:36 trial096 ceph-mon[24671]: osdmap e48: 10 total, 9 up, 10 in 2026-02-13T03:33:36.819 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:36 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:36.820 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:36 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-13T03:33:36.820 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:36 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:36.820 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:36 trial096 ceph-mon[24671]: osdmap e49: 10 total, 9 up, 10 in 2026-02-13T03:33:36.820 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:36 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:37.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:36 trial132 ceph-mon[26888]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T03:33:37.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:36 trial132 ceph-mon[26888]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T03:33:37.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:36 trial132 ceph-mon[26888]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T03:33:37.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:36 trial132 ceph-mon[26888]: osdmap e48: 10 total, 9 up, 10 in 2026-02-13T03:33:37.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:36 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:37.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:36 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-13T03:33:37.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:36 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:37.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:36 trial132 ceph-mon[26888]: osdmap e49: 10 total, 9 up, 10 in 2026-02-13T03:33:37.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:36 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:37.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:36 trial133 ceph-mon[26943]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T03:33:37.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:36 trial133 ceph-mon[26943]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T03:33:37.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:36 trial133 ceph-mon[26943]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T03:33:37.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:36 trial133 ceph-mon[26943]: osdmap e48: 10 total, 9 up, 10 in 2026-02-13T03:33:37.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:36 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:37.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:36 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-13T03:33:37.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:36 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:37.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:36 trial133 ceph-mon[26943]: osdmap e49: 10 total, 9 up, 10 in 2026-02-13T03:33:37.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:36 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:38.063 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:37 trial096 ceph-mon[24671]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T03:33:38.064 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:37 trial096 ceph-mon[24671]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:38.064 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:37 trial096 ceph-mon[24671]: osdmap e50: 10 total, 9 up, 10 in 2026-02-13T03:33:38.064 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:37 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:38.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:37 trial132 ceph-mon[26888]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T03:33:38.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:37 trial132 ceph-mon[26888]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:38.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:37 trial132 ceph-mon[26888]: osdmap e50: 10 total, 9 up, 10 in 2026-02-13T03:33:38.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:37 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:38.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:37 trial133 ceph-mon[26943]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T03:33:38.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:37 trial133 ceph-mon[26943]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:38.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:37 trial133 ceph-mon[26943]: osdmap e50: 10 total, 9 up, 10 in 2026-02-13T03:33:38.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:37 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:38.850 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:38 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:38.850 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:38 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:38.850 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:38 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:39.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:38 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:39.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:38 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:39.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:38 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:39.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:38 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:39.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:38 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:39.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:38 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:39.431 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:39.428+0000 7f6164ff96c0 1 -- 10.20.193.96:0/1635506250 <== mgr.14116 v2:10.20.193.96:6800/1736050816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f61680f1410 con 0x7f613c0b5680 2026-02-13T03:33:39.431 INFO:teuthology.orchestra.run.trial096.stdout:Created osd(s) 9 on host 'trial096' 2026-02-13T03:33:39.434 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:39.430+0000 7f616e1876c0 1 -- 10.20.193.96:0/1635506250 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f613c0b5680 msgr2=0x7f613c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:39.434 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:39.430+0000 7f616e1876c0 1 --2- 10.20.193.96:0/1635506250 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f613c0b5680 0x7f613c0d5b30 secure :-1 s=READY pgs=123 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61540098c0 tx=0x7f6154005bc0 comp rx=0 tx=0).stop 2026-02-13T03:33:39.434 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:39.430+0000 7f616e1876c0 1 -- 10.20.193.96:0/1635506250 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f61681109f0 msgr2=0x7f61680f8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:39.434 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:39.430+0000 7f616e1876c0 1 --2- 10.20.193.96:0/1635506250 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f61681109f0 0x7f61680f8da0 secure :-1 s=READY pgs=175 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f615c00c6c0 tx=0x7f615c00cb90 comp rx=0 tx=0).stop 2026-02-13T03:33:39.434 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:39.430+0000 7f616e1876c0 1 -- 10.20.193.96:0/1635506250 shutdown_connections 2026-02-13T03:33:39.434 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:39.430+0000 7f616e1876c0 1 --2- 10.20.193.96:0/1635506250 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f613c0b5680 0x7f613c0d5b30 unknown :-1 s=CLOSED pgs=123 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:39.434 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:39.430+0000 7f616e1876c0 1 --2- 10.20.193.96:0/1635506250 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f61681109f0 0x7f61680f8da0 unknown :-1 s=CLOSED pgs=175 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:39.434 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:39.430+0000 7f616e1876c0 1 --2- 10.20.193.96:0/1635506250 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6168110040 0x7f6168171380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:39.434 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:39.430+0000 7f616e1876c0 1 --2- 10.20.193.96:0/1635506250 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f616810eec0 0x7f61680f8540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:39.435 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:39.430+0000 7f616e1876c0 1 -- 10.20.193.96:0/1635506250 >> 10.20.193.96:0/1635506250 conn(0x7f61680ec5c0 msgr2=0x7f61680eeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:39.435 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:39.430+0000 7f616e1876c0 1 -- 10.20.193.96:0/1635506250 shutdown_connections 2026-02-13T03:33:39.435 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:39.430+0000 7f616e1876c0 1 -- 10.20.193.96:0/1635506250 wait complete. 2026-02-13T03:33:39.476 DEBUG:teuthology.orchestra.run.trial096:osd.9> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.9.service 2026-02-13T03:33:39.478 INFO:tasks.cephadm:Deploying osd.10 on trial132 with /dev/vg_nvme/lv_1... 2026-02-13T03:33:39.479 DEBUG:teuthology.orchestra.run.trial132:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T03:33:39.598 INFO:teuthology.orchestra.run.trial132.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.b/config 2026-02-13T03:33:39.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:39 trial096 ceph-mon[24671]: pgmap v132: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail; 215 KiB/s, 0 objects/s recovering 2026-02-13T03:33:39.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:39 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:39.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:39 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:39.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:39 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:39.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:39 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:39.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:39 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:39.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:39 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:39.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:39 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:39.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:39 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:39.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:39 trial096 ceph-mon[24671]: from='osd.9 [v2:10.20.193.96:6826/1024808447,v1:10.20.193.96:6827/1024808447]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T03:33:39.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:39 trial096 ceph-mon[24671]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:39.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:39 trial096 ceph-mon[24671]: Cluster is now healthy 2026-02-13T03:33:39.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:39 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:39.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:39 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:40.007 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:39 trial132 ceph-mon[26888]: pgmap v132: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail; 215 KiB/s, 0 objects/s recovering 2026-02-13T03:33:40.007 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:39 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:40.007 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:39 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:40.007 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:39 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:40.007 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:39 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:40.007 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:39 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:40.008 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:39 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:40.008 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:39 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:40.008 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:39 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:40.008 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:39 trial132 ceph-mon[26888]: from='osd.9 [v2:10.20.193.96:6826/1024808447,v1:10.20.193.96:6827/1024808447]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T03:33:40.008 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:39 trial132 ceph-mon[26888]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:40.008 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:39 trial132 ceph-mon[26888]: Cluster is now healthy 2026-02-13T03:33:40.008 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:39 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:40.008 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:39 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:40.036 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-13T03:33:40.054 DEBUG:teuthology.orchestra.run.trial132:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph orch daemon add osd trial132:vg_nvme/lv_1 --skip-validation 2026-02-13T03:33:40.174 INFO:teuthology.orchestra.run.trial132.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.b/config 2026-02-13T03:33:40.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:39 trial133 ceph-mon[26943]: pgmap v132: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail; 215 KiB/s, 0 objects/s recovering 2026-02-13T03:33:40.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:39 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:40.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:39 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:40.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:39 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:40.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:39 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:40.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:39 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:40.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:39 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:40.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:39 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:40.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:39 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:40.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:39 trial133 ceph-mon[26943]: from='osd.9 [v2:10.20.193.96:6826/1024808447,v1:10.20.193.96:6827/1024808447]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T03:33:40.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:39 trial133 ceph-mon[26943]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:40.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:39 trial133 ceph-mon[26943]: Cluster is now healthy 2026-02-13T03:33:40.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:39 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:40.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:39 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:40.299 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.304+0000 7feac2c886c0 1 -- 10.20.193.132:0/1009385400 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7feabc110a00 msgr2=0x7feabc171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:40.299 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.304+0000 7feac2c886c0 1 --2- 10.20.193.132:0/1009385400 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7feabc110a00 0x7feabc171390 secure :-1 s=READY pgs=34 gs=1 cs=0 l=1 c_cookie=4058603440049724342 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feab800aa40 tx=0x7feab802fde0 comp rx=0 tx=0).stop 2026-02-13T03:33:40.299 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.304+0000 7feac2c886c0 1 -- 10.20.193.132:0/1009385400 shutdown_connections 2026-02-13T03:33:40.299 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.304+0000 7feac2c886c0 1 --2- 10.20.193.132:0/1009385400 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7feabc110a00 0x7feabc171390 unknown :-1 s=CLOSED pgs=34 gs=1 cs=0 l=1 c_cookie=4058603440049724342 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:40.299 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.304+0000 7feac2c886c0 1 --2- 10.20.193.132:0/1009385400 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7feabc110050 0x7feabc1104c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:40.299 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.304+0000 7feac2c886c0 1 --2- 10.20.193.132:0/1009385400 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7feabc10eed0 0x7feabc10f2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:40.299 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.304+0000 7feac2c886c0 1 -- 10.20.193.132:0/1009385400 >> 10.20.193.132:0/1009385400 conn(0x7feabc0ec5f0 msgr2=0x7feabc10ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:40.299 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.305+0000 7feac2c886c0 1 -- 10.20.193.132:0/1009385400 shutdown_connections 2026-02-13T03:33:40.300 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.305+0000 7feac2c886c0 1 -- 10.20.193.132:0/1009385400 wait complete. 2026-02-13T03:33:40.300 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.305+0000 7feac2c886c0 1 Processor -- start 2026-02-13T03:33:40.300 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.305+0000 7feac2c886c0 1 -- start start 2026-02-13T03:33:40.300 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.305+0000 7feac2c886c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7feabc10eed0 0x7feabc0f8ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:40.300 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.305+0000 7feac2c886c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7feabc110050 0x7feabc171370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:40.300 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.305+0000 7feac2c886c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7feabc110a00 0x7feabc0f9730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:40.300 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.305+0000 7feac2c886c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7feabc0fa380 con 0x7feabc110a00 2026-02-13T03:33:40.300 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.305+0000 7feac2c886c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7feabc0fa4f0 con 0x7feabc10eed0 2026-02-13T03:33:40.300 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.305+0000 7feac2c886c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7feabc0fa6b0 con 0x7feabc110050 2026-02-13T03:33:40.300 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.305+0000 7feac09fd6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7feabc10eed0 0x7feabc0f8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:40.300 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.305+0000 7feac11fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7feabc110a00 0x7feabc0f9730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:40.301 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.305+0000 7feac11fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7feabc110a00 0x7feabc0f9730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.132:34220/0 (socket says 10.20.193.132:34220) 2026-02-13T03:33:40.301 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.305+0000 7feac11fe6c0 1 -- 10.20.193.132:0/1734067249 learned_addr learned my addr 10.20.193.132:0/1734067249 (peer_addr_for_me v2:10.20.193.132:0/0) 2026-02-13T03:33:40.301 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.305+0000 7feab3fff6c0 1 --2- 10.20.193.132:0/1734067249 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7feabc110050 0x7feabc171370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:40.301 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.305+0000 7feac09fd6c0 1 -- 10.20.193.132:0/1734067249 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7feabc110050 msgr2=0x7feabc171370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:40.301 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.305+0000 7feac09fd6c0 1 --2- 10.20.193.132:0/1734067249 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7feabc110050 0x7feabc171370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:40.301 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.305+0000 7feac09fd6c0 1 -- 10.20.193.132:0/1734067249 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7feabc110a00 msgr2=0x7feabc0f9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:40.301 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.305+0000 7feac09fd6c0 1 --2- 10.20.193.132:0/1734067249 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7feabc110a00 0x7feabc0f9730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:40.301 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.305+0000 7feac09fd6c0 1 -- 10.20.193.132:0/1734067249 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab800a660 con 0x7feabc10eed0 2026-02-13T03:33:40.301 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.305+0000 7feac11fe6c0 1 --2- 10.20.193.132:0/1734067249 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7feabc110a00 0x7feabc0f9730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T03:33:40.301 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.306+0000 7feac09fd6c0 1 --2- 10.20.193.132:0/1734067249 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7feabc10eed0 0x7feabc0f8ef0 secure :-1 s=READY pgs=35 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feaac00b640 tx=0x7feaac00bb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:40.301 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.306+0000 7feab1ffb6c0 1 -- 10.20.193.132:0/1734067249 <== mon.2 v2:10.20.193.132:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feaac0044a0 con 0x7feabc10eed0 2026-02-13T03:33:40.301 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.306+0000 7feac2c886c0 1 -- 10.20.193.132:0/1734067249 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feabc0fa930 con 0x7feabc10eed0 2026-02-13T03:33:40.302 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.306+0000 7feab1ffb6c0 1 -- 10.20.193.132:0/1734067249 <== mon.2 v2:10.20.193.132:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7feaac009030 con 0x7feabc10eed0 2026-02-13T03:33:40.302 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.306+0000 7feab1ffb6c0 1 -- 10.20.193.132:0/1734067249 <== mon.2 v2:10.20.193.132:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feaac00cc90 con 0x7feabc10eed0 2026-02-13T03:33:40.302 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.306+0000 7feac2c886c0 1 -- 10.20.193.132:0/1734067249 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feabc0fae10 con 0x7feabc10eed0 2026-02-13T03:33:40.302 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.306+0000 7feac2c886c0 1 -- 10.20.193.132:0/1734067249 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feabc1753e0 con 0x7feabc10eed0 2026-02-13T03:33:40.303 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.308+0000 7feab1ffb6c0 1 -- 10.20.193.132:0/1734067249 <== mon.2 v2:10.20.193.132:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7feaac0026b0 con 0x7feabc10eed0 2026-02-13T03:33:40.303 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.308+0000 7feab1ffb6c0 1 --2- 10.20.193.132:0/1734067249 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fea980b5600 0x7fea980d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:40.303 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.309+0000 7feab1ffb6c0 1 -- 10.20.193.132:0/1734067249 <== mon.2 v2:10.20.193.132:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5742+0+0 (secure 0 0 0) 0x7feaac0e3010 con 0x7feabc10eed0 2026-02-13T03:33:40.303 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.309+0000 7feab3fff6c0 1 --2- 10.20.193.132:0/1734067249 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fea980b5600 0x7fea980d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:40.303 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.309+0000 7feab1ffb6c0 1 -- 10.20.193.132:0/1734067249 <== mon.2 v2:10.20.193.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7feaac0a9e20 con 0x7feabc10eed0 2026-02-13T03:33:40.303 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.310+0000 7feab3fff6c0 1 --2- 10.20.193.132:0/1734067249 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fea980b5600 0x7fea980d5ab0 secure :-1 s=READY pgs=128 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feaa4005fd0 tx=0x7feaa40093f0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:40.400 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:40.407+0000 7feac2c886c0 1 -- 10.20.193.132:0/1734067249 --> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial132:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7feabc04ca20 con 0x7fea980b5600 2026-02-13T03:33:40.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: pgmap v133: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail; 176 KiB/s, 0 objects/s recovering 2026-02-13T03:33:40.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: pgmap v134: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail; 146 KiB/s, 0 objects/s recovering 2026-02-13T03:33:40.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:40.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: from='osd.9 [v2:10.20.193.96:6826/1024808447,v1:10.20.193.96:6827/1024808447]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-13T03:33:40.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: osdmap e51: 10 total, 9 up, 10 in 2026-02-13T03:33:40.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: from='osd.9 [v2:10.20.193.96:6826/1024808447,v1:10.20.193.96:6827/1024808447]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial096", "root=default"]} : dispatch 2026-02-13T03:33:40.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:40.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:40.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:40.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:40.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:40.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:40.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:40.926 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:40.926 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:40.926 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:40.926 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:40.926 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:40.926 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:40.926 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:40.926 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:40.926 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:40.926 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:40.926 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:40.926 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:40.927 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:40 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:40.959 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: pgmap v133: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail; 176 KiB/s, 0 objects/s recovering 2026-02-13T03:33:40.960 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: pgmap v134: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail; 146 KiB/s, 0 objects/s recovering 2026-02-13T03:33:40.960 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:40.960 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: from='osd.9 [v2:10.20.193.96:6826/1024808447,v1:10.20.193.96:6827/1024808447]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-13T03:33:40.960 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: osdmap e51: 10 total, 9 up, 10 in 2026-02-13T03:33:40.960 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: from='osd.9 [v2:10.20.193.96:6826/1024808447,v1:10.20.193.96:6827/1024808447]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial096", "root=default"]} : dispatch 2026-02-13T03:33:40.960 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:40.960 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:40.960 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:40.960 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:40.960 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:40.960 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:40.961 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:40.961 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:40.961 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:40.961 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:40.961 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:40.961 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:40.961 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:40.961 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:40.961 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:40.961 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:40.961 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:40.961 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:40.962 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:40.962 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:40 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:41.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: pgmap v133: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail; 176 KiB/s, 0 objects/s recovering 2026-02-13T03:33:41.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: pgmap v134: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail; 146 KiB/s, 0 objects/s recovering 2026-02-13T03:33:41.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:41.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: from='osd.9 [v2:10.20.193.96:6826/1024808447,v1:10.20.193.96:6827/1024808447]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-13T03:33:41.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: osdmap e51: 10 total, 9 up, 10 in 2026-02-13T03:33:41.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: from='osd.9 [v2:10.20.193.96:6826/1024808447,v1:10.20.193.96:6827/1024808447]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial096", "root=default"]} : dispatch 2026-02-13T03:33:41.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:41.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:41.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:41.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:41.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:41.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:41.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:41.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:41.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:41.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:41.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:41.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:41.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:41.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:41.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:41.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:41.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:41.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:41.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:41.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:40 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:41.424 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:33:41 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:33:41.023+0000 7f30666e86c0 -1 osd.9 0 waiting for initial osdmap 2026-02-13T03:33:41.425 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:33:41 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:33:41.029+0000 7f305e5a46c0 -1 osd.9 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:33:42.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:41 trial096 ceph-mon[24671]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial132:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:33:42.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:41 trial096 ceph-mon[24671]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail; 145 KiB/s, 0 objects/s recovering 2026-02-13T03:33:42.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:41 trial096 ceph-mon[24671]: from='osd.9 [v2:10.20.193.96:6826/1024808447,v1:10.20.193.96:6827/1024808447]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial096", "root=default"]}]': finished 2026-02-13T03:33:42.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:41 trial096 ceph-mon[24671]: osdmap e52: 10 total, 9 up, 10 in 2026-02-13T03:33:42.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:41 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:42.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:41 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:42.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:41 trial096 ceph-mon[24671]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0e027d3a-fcab-46b0-8719-d335e01449da"} : dispatch 2026-02-13T03:33:42.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:41 trial096 ceph-mon[24671]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0e027d3a-fcab-46b0-8719-d335e01449da"}]': finished 2026-02-13T03:33:42.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:41 trial096 ceph-mon[24671]: osd.9 [v2:10.20.193.96:6826/1024808447,v1:10.20.193.96:6827/1024808447] boot 2026-02-13T03:33:42.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:41 trial096 ceph-mon[24671]: osdmap e53: 11 total, 10 up, 11 in 2026-02-13T03:33:42.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:41 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:42.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:41 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:33:42.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:41 trial096 ceph-mon[24671]: from='client.? 10.20.193.132:0/2564040945' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0e027d3a-fcab-46b0-8719-d335e01449da"} : dispatch 2026-02-13T03:33:42.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:41 trial096 ceph-mon[24671]: from='client.? 10.20.193.132:0/2688018381' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:33:42.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:41 trial096 ceph-mon[24671]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:42.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:41 trial096 ceph-mon[24671]: Cluster is now healthy 2026-02-13T03:33:42.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:41 trial132 ceph-mon[26888]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial132:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:33:42.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:41 trial132 ceph-mon[26888]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail; 145 KiB/s, 0 objects/s recovering 2026-02-13T03:33:42.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:41 trial132 ceph-mon[26888]: from='osd.9 [v2:10.20.193.96:6826/1024808447,v1:10.20.193.96:6827/1024808447]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial096", "root=default"]}]': finished 2026-02-13T03:33:42.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:41 trial132 ceph-mon[26888]: osdmap e52: 10 total, 9 up, 10 in 2026-02-13T03:33:42.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:41 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:42.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:41 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:42.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:41 trial132 ceph-mon[26888]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0e027d3a-fcab-46b0-8719-d335e01449da"} : dispatch 2026-02-13T03:33:42.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:41 trial132 ceph-mon[26888]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0e027d3a-fcab-46b0-8719-d335e01449da"}]': finished 2026-02-13T03:33:42.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:41 trial132 ceph-mon[26888]: osd.9 [v2:10.20.193.96:6826/1024808447,v1:10.20.193.96:6827/1024808447] boot 2026-02-13T03:33:42.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:41 trial132 ceph-mon[26888]: osdmap e53: 11 total, 10 up, 11 in 2026-02-13T03:33:42.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:41 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:42.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:41 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:33:42.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:41 trial132 ceph-mon[26888]: from='client.? 10.20.193.132:0/2564040945' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0e027d3a-fcab-46b0-8719-d335e01449da"} : dispatch 2026-02-13T03:33:42.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:41 trial132 ceph-mon[26888]: from='client.? 10.20.193.132:0/2688018381' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:33:42.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:41 trial132 ceph-mon[26888]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:42.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:41 trial132 ceph-mon[26888]: Cluster is now healthy 2026-02-13T03:33:42.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:41 trial133 ceph-mon[26943]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial132:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:33:42.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:41 trial133 ceph-mon[26943]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail; 145 KiB/s, 0 objects/s recovering 2026-02-13T03:33:42.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:41 trial133 ceph-mon[26943]: from='osd.9 [v2:10.20.193.96:6826/1024808447,v1:10.20.193.96:6827/1024808447]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial096", "root=default"]}]': finished 2026-02-13T03:33:42.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:41 trial133 ceph-mon[26943]: osdmap e52: 10 total, 9 up, 10 in 2026-02-13T03:33:42.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:41 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:42.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:41 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:42.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:41 trial133 ceph-mon[26943]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0e027d3a-fcab-46b0-8719-d335e01449da"} : dispatch 2026-02-13T03:33:42.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:41 trial133 ceph-mon[26943]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0e027d3a-fcab-46b0-8719-d335e01449da"}]': finished 2026-02-13T03:33:42.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:41 trial133 ceph-mon[26943]: osd.9 [v2:10.20.193.96:6826/1024808447,v1:10.20.193.96:6827/1024808447] boot 2026-02-13T03:33:42.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:41 trial133 ceph-mon[26943]: osdmap e53: 11 total, 10 up, 11 in 2026-02-13T03:33:42.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:41 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:33:42.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:41 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:33:42.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:41 trial133 ceph-mon[26943]: from='client.? 10.20.193.132:0/2564040945' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0e027d3a-fcab-46b0-8719-d335e01449da"} : dispatch 2026-02-13T03:33:42.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:41 trial133 ceph-mon[26943]: from='client.? 10.20.193.132:0/2688018381' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:33:42.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:41 trial133 ceph-mon[26943]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:42.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:41 trial133 ceph-mon[26943]: Cluster is now healthy 2026-02-13T03:33:42.923 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:42 trial132 ceph-mon[26888]: purged_snaps scrub starts 2026-02-13T03:33:42.923 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:42 trial132 ceph-mon[26888]: purged_snaps scrub ok 2026-02-13T03:33:43.164 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:42 trial133 ceph-mon[26943]: purged_snaps scrub starts 2026-02-13T03:33:43.164 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:42 trial133 ceph-mon[26943]: purged_snaps scrub ok 2026-02-13T03:33:43.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:42 trial096 ceph-mon[24671]: purged_snaps scrub starts 2026-02-13T03:33:43.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:42 trial096 ceph-mon[24671]: purged_snaps scrub ok 2026-02-13T03:33:44.036 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:43 trial132 ceph-mon[26888]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:33:44.036 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:43 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:44.036 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:43 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:44.037 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:43 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:44.037 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:43 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:44.037 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:43 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:44.037 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:43 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:44.037 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:43 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:44.037 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:43 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:44.037 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:43 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:44.037 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:43 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-13T03:33:44.037 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:43 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:44.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:43 trial096 ceph-mon[24671]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:33:44.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:43 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:44.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:43 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:44.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:43 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:44.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:43 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:44.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:43 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:44.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:43 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:44.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:43 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:44.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:43 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:44.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:43 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:44.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:43 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-13T03:33:44.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:43 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:44.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:43 trial133 ceph-mon[26943]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:33:44.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:43 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:44.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:43 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:44.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:43 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:44.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:43 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:44.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:43 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:44.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:43 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:44.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:43 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:44.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:43 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:44.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:43 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:44.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:43 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-13T03:33:44.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:43 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:44.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:44 trial132 ceph-mon[26888]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:33:44.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:44 trial132 ceph-mon[26888]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:33:44.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:44 trial132 ceph-mon[26888]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:33:45.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:44 trial096 ceph-mon[24671]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:33:45.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:44 trial096 ceph-mon[24671]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:33:45.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:44 trial096 ceph-mon[24671]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:33:45.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:44 trial133 ceph-mon[26943]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:33:45.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:44 trial133 ceph-mon[26943]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:33:45.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:44 trial133 ceph-mon[26943]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:33:45.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:45 trial132 ceph-mon[26888]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:46.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:45 trial096 ceph-mon[24671]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:46.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:45 trial133 ceph-mon[26943]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:46.892 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:46.900+0000 7feab1ffb6c0 1 -- 10.20.193.132:0/1734067249 <== mgr.14116 v2:10.20.193.96:6800/1736050816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7feabc04ca20 con 0x7fea980b5600 2026-02-13T03:33:46.893 INFO:teuthology.orchestra.run.trial132.stdout:Created osd(s) 10 on host 'trial132' 2026-02-13T03:33:46.895 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:46.902+0000 7feac2c886c0 1 -- 10.20.193.132:0/1734067249 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fea980b5600 msgr2=0x7fea980d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:46.895 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:46.902+0000 7feac2c886c0 1 --2- 10.20.193.132:0/1734067249 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fea980b5600 0x7fea980d5ab0 secure :-1 s=READY pgs=128 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feaa4005fd0 tx=0x7feaa40093f0 comp rx=0 tx=0).stop 2026-02-13T03:33:46.896 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:46.902+0000 7feac2c886c0 1 -- 10.20.193.132:0/1734067249 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7feabc10eed0 msgr2=0x7feabc0f8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:46.896 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:46.902+0000 7feac2c886c0 1 --2- 10.20.193.132:0/1734067249 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7feabc10eed0 0x7feabc0f8ef0 secure :-1 s=READY pgs=35 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feaac00b640 tx=0x7feaac00bb10 comp rx=0 tx=0).stop 2026-02-13T03:33:46.896 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:46.903+0000 7feac2c886c0 1 -- 10.20.193.132:0/1734067249 shutdown_connections 2026-02-13T03:33:46.896 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:46.903+0000 7feac2c886c0 1 --2- 10.20.193.132:0/1734067249 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fea980b5600 0x7fea980d5ab0 unknown :-1 s=CLOSED pgs=128 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:46.896 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:46.903+0000 7feac2c886c0 1 --2- 10.20.193.132:0/1734067249 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7feabc110a00 0x7feabc0f9730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:46.896 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:46.903+0000 7feac2c886c0 1 --2- 10.20.193.132:0/1734067249 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7feabc110050 0x7feabc171370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:46.896 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:46.903+0000 7feac2c886c0 1 --2- 10.20.193.132:0/1734067249 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7feabc10eed0 0x7feabc0f8ef0 unknown :-1 s=CLOSED pgs=35 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:46.896 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:46.903+0000 7feac2c886c0 1 -- 10.20.193.132:0/1734067249 >> 10.20.193.132:0/1734067249 conn(0x7feabc0ec5f0 msgr2=0x7feabc0ef4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:46.896 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:46.903+0000 7feac2c886c0 1 -- 10.20.193.132:0/1734067249 shutdown_connections 2026-02-13T03:33:46.896 INFO:teuthology.orchestra.run.trial132.stderr:2026-02-13T03:33:46.903+0000 7feac2c886c0 1 -- 10.20.193.132:0/1734067249 wait complete. 2026-02-13T03:33:46.939 DEBUG:teuthology.orchestra.run.trial132:osd.10> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.10.service 2026-02-13T03:33:46.941 INFO:tasks.cephadm:Deploying osd.11 on trial133 with /dev/vg_nvme/lv_1... 2026-02-13T03:33:46.942 DEBUG:teuthology.orchestra.run.trial133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T03:33:47.062 INFO:teuthology.orchestra.run.trial133.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.c/config 2026-02-13T03:33:47.085 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:46 trial133 ceph-mon[26943]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:33:47.085 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:46 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:47.086 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:46 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:47.086 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:46 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:47.086 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:46 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:47.086 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:46 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:47.086 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:46 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:47.086 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:46 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:47.086 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:46 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:47.086 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:46 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:47.086 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:46 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:47.086 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:46 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:47.130 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:46 trial132 ceph-mon[26888]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:33:47.130 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:46 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:47.130 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:46 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:47.130 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:46 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:47.130 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:46 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:47.130 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:46 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:47.131 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:46 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:47.131 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:46 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:47.131 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:46 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:47.131 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:46 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:47.131 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:46 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:47.131 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:46 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:47.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:46 trial096 ceph-mon[24671]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:33:47.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:46 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:47.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:46 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:47.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:46 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:47.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:46 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:47.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:46 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:47.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:46 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:47.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:46 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:47.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:46 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:47.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:46 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:47.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:46 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:47.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:46 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:47.504 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-13T03:33:47.523 DEBUG:teuthology.orchestra.run.trial133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph orch daemon add osd trial133:vg_nvme/lv_1 --skip-validation 2026-02-13T03:33:47.640 INFO:teuthology.orchestra.run.trial133.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.c/config 2026-02-13T03:33:47.765 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.760+0000 7f8d460316c0 1 -- 10.20.193.133:0/1600358921 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8d4010eec0 msgr2=0x7f8d4010f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:47.765 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.760+0000 7f8d460316c0 1 --2- 10.20.193.133:0/1600358921 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8d4010eec0 0x7f8d4010f2b0 secure :-1 s=READY pgs=35 gs=1 cs=0 l=1 c_cookie=13223856692881326158 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d2c009970 tx=0x7f8d2c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:33:47.765 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.760+0000 7f8d460316c0 1 -- 10.20.193.133:0/1600358921 shutdown_connections 2026-02-13T03:33:47.765 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.760+0000 7f8d460316c0 1 --2- 10.20.193.133:0/1600358921 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8d401109f0 0x7f8d40171380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:47.766 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.760+0000 7f8d460316c0 1 --2- 10.20.193.133:0/1600358921 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8d40110040 0x7f8d401104b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:47.766 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.760+0000 7f8d460316c0 1 --2- 10.20.193.133:0/1600358921 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8d4010eec0 0x7f8d4010f2b0 unknown :-1 s=CLOSED pgs=35 gs=1 cs=0 l=1 c_cookie=13223856692881326158 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:47.766 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.760+0000 7f8d460316c0 1 -- 10.20.193.133:0/1600358921 >> 10.20.193.133:0/1600358921 conn(0x7f8d400ec5c0 msgr2=0x7f8d4010c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:47.766 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.760+0000 7f8d460316c0 1 -- 10.20.193.133:0/1600358921 shutdown_connections 2026-02-13T03:33:47.766 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.760+0000 7f8d460316c0 1 -- 10.20.193.133:0/1600358921 wait complete. 2026-02-13T03:33:47.766 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.761+0000 7f8d460316c0 1 Processor -- start 2026-02-13T03:33:47.766 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.761+0000 7f8d460316c0 1 -- start start 2026-02-13T03:33:47.766 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.761+0000 7f8d460316c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8d4010eec0 0x7f8d400f9060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:47.766 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.761+0000 7f8d460316c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8d40110040 0x7f8d40171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:47.766 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.761+0000 7f8d460316c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8d401109f0 0x7f8d400f98c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:47.766 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.761+0000 7f8d460316c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f8d400fa4f0 con 0x7f8d40110040 2026-02-13T03:33:47.767 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.761+0000 7f8d460316c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8d400fa660 con 0x7f8d401109f0 2026-02-13T03:33:47.767 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.761+0000 7f8d460316c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8d400fa820 con 0x7f8d4010eec0 2026-02-13T03:33:47.767 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.761+0000 7f8d3f7fe6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8d4010eec0 0x7f8d400f9060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:47.767 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.761+0000 7f8d3f7fe6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8d4010eec0 0x7f8d400f9060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.133:3300/0 says I am v2:10.20.193.133:42522/0 (socket says 10.20.193.133:42522) 2026-02-13T03:33:47.767 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.761+0000 7f8d3f7fe6c0 1 -- 10.20.193.133:0/2903127572 learned_addr learned my addr 10.20.193.133:0/2903127572 (peer_addr_for_me v2:10.20.193.133:0/0) 2026-02-13T03:33:47.767 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.761+0000 7f8d3ffff6c0 1 --2- 10.20.193.133:0/2903127572 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8d401109f0 0x7f8d400f98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:47.767 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.761+0000 7f8d3f7fe6c0 1 -- 10.20.193.133:0/2903127572 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8d401109f0 msgr2=0x7f8d400f98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:47.767 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.761+0000 7f8d3f7fe6c0 1 --2- 10.20.193.133:0/2903127572 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8d401109f0 0x7f8d400f98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:47.767 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.761+0000 7f8d3f7fe6c0 1 -- 10.20.193.133:0/2903127572 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8d40110040 msgr2=0x7f8d40171380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:47.767 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.761+0000 7f8d3f7fe6c0 1 --2- 10.20.193.133:0/2903127572 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8d40110040 0x7f8d40171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:47.767 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.761+0000 7f8d3f7fe6c0 1 -- 10.20.193.133:0/2903127572 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d2c009590 con 0x7f8d4010eec0 2026-02-13T03:33:47.768 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.761+0000 7f8d3f7fe6c0 1 --2- 10.20.193.133:0/2903127572 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8d4010eec0 0x7f8d400f9060 secure :-1 s=READY pgs=36 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d2c02ff00 tx=0x7f8d2c004670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:47.768 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.761+0000 7f8d3cff96c0 1 -- 10.20.193.133:0/2903127572 <== mon.1 v2:10.20.193.133:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8d2c002ba0 con 0x7f8d4010eec0 2026-02-13T03:33:47.768 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.761+0000 7f8d460316c0 1 -- 10.20.193.133:0/2903127572 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d400faaa0 con 0x7f8d4010eec0 2026-02-13T03:33:47.768 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.761+0000 7f8d3cff96c0 1 -- 10.20.193.133:0/2903127572 <== mon.1 v2:10.20.193.133:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f8d2c007740 con 0x7f8d4010eec0 2026-02-13T03:33:47.768 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.761+0000 7f8d3cff96c0 1 -- 10.20.193.133:0/2903127572 <== mon.1 v2:10.20.193.133:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8d2c031620 con 0x7f8d4010eec0 2026-02-13T03:33:47.768 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.761+0000 7f8d460316c0 1 -- 10.20.193.133:0/2903127572 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d400faf70 con 0x7f8d4010eec0 2026-02-13T03:33:47.768 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.762+0000 7f8d460316c0 1 -- 10.20.193.133:0/2903127572 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d401753f0 con 0x7f8d4010eec0 2026-02-13T03:33:47.769 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.763+0000 7f8d3cff96c0 1 -- 10.20.193.133:0/2903127572 <== mon.1 v2:10.20.193.133:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f8d2c002d00 con 0x7f8d4010eec0 2026-02-13T03:33:47.769 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.763+0000 7f8d3cff96c0 1 --2- 10.20.193.133:0/2903127572 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f8d140b5600 0x7f8d140d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:47.769 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.763+0000 7f8d3cff96c0 1 -- 10.20.193.133:0/2903127572 <== mon.1 v2:10.20.193.133:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6153+0+0 (secure 0 0 0) 0x7f8d2c107620 con 0x7f8d4010eec0 2026-02-13T03:33:47.769 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.763+0000 7f8d3effd6c0 1 --2- 10.20.193.133:0/2903127572 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f8d140b5600 0x7f8d140d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:47.769 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.764+0000 7f8d3cff96c0 1 -- 10.20.193.133:0/2903127572 <== mon.1 v2:10.20.193.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8d2c0ca7f0 con 0x7f8d4010eec0 2026-02-13T03:33:47.770 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.764+0000 7f8d3effd6c0 1 --2- 10.20.193.133:0/2903127572 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f8d140b5600 0x7f8d140d5ab0 secure :-1 s=READY pgs=133 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d30005980 tx=0x7f8d30005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:47.864 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:47.862+0000 7f8d460316c0 1 -- 10.20.193.133:0/2903127572 --> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial133:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f8d400efc40 con 0x7f8d140b5600 2026-02-13T03:33:48.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:47 trial133 ceph-mon[26943]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:33:48.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:47 trial133 ceph-mon[26943]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:48.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:47 trial133 ceph-mon[26943]: Cluster is now healthy 2026-02-13T03:33:48.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:47 trial133 ceph-mon[26943]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T03:33:48.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:47 trial133 ceph-mon[26943]: from='osd.10 [v2:10.20.193.132:6824/921326908,v1:10.20.193.132:6825/921326908]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T03:33:48.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:47 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:48.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:47 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:48.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:47 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:48.049 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:47 trial132 ceph-mon[26888]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:33:48.049 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:47 trial132 ceph-mon[26888]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:48.049 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:47 trial132 ceph-mon[26888]: Cluster is now healthy 2026-02-13T03:33:48.049 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:47 trial132 ceph-mon[26888]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T03:33:48.049 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:47 trial132 ceph-mon[26888]: from='osd.10 [v2:10.20.193.132:6824/921326908,v1:10.20.193.132:6825/921326908]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T03:33:48.050 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:47 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:48.050 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:47 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:48.050 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:47 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:48.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:47 trial096 ceph-mon[24671]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:33:48.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:47 trial096 ceph-mon[24671]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:48.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:47 trial096 ceph-mon[24671]: Cluster is now healthy 2026-02-13T03:33:48.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:47 trial096 ceph-mon[24671]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T03:33:48.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:47 trial096 ceph-mon[24671]: from='osd.10 [v2:10.20.193.132:6824/921326908,v1:10.20.193.132:6825/921326908]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T03:33:48.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:47 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:48.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:47 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:48.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:47 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:48.983 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:33:48 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:33:48.685+0000 7f2f2f0616c0 -1 osd.10 0 waiting for initial osdmap 2026-02-13T03:33:48.983 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:33:48 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:33:48.692+0000 7f2f2af256c0 -1 osd.10 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:33:48.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:33:48.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-13T03:33:48.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: osdmap e54: 11 total, 10 up, 11 in 2026-02-13T03:33:48.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:33:48.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial132", "root=default"]} : dispatch 2026-02-13T03:33:48.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='osd.10 [v2:10.20.193.132:6824/921326908,v1:10.20.193.132:6825/921326908]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial132", "root=default"]} : dispatch 2026-02-13T03:33:48.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial133:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:33:48.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:48.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:48.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:48.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:48.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:48.984 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:48.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:48.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:48.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:48.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:48.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:48.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:48.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:48.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:48.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:48.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:48.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:48.985 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:48.986 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:48.986 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='client.? 10.20.193.133:0/2475280925' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28fa6f6e-6515-49ae-930f-22e18eecefde"} : dispatch 2026-02-13T03:33:48.986 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28fa6f6e-6515-49ae-930f-22e18eecefde"} : dispatch 2026-02-13T03:33:48.986 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial132", "root=default"]}]': finished 2026-02-13T03:33:48.986 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28fa6f6e-6515-49ae-930f-22e18eecefde"}]': finished 2026-02-13T03:33:48.986 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: osdmap e55: 12 total, 10 up, 12 in 2026-02-13T03:33:48.986 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:33:48.986 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:48.986 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:48 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:33:49.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:33:49.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-13T03:33:49.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: osdmap e54: 11 total, 10 up, 11 in 2026-02-13T03:33:49.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:33:49.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial132", "root=default"]} : dispatch 2026-02-13T03:33:49.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='osd.10 [v2:10.20.193.132:6824/921326908,v1:10.20.193.132:6825/921326908]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial132", "root=default"]} : dispatch 2026-02-13T03:33:49.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial133:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:33:49.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:49.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:49.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:49.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:49.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:49.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:49.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:49.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:49.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:49.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:49.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:49.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:49.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:49.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:49.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:49.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:49.177 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:49.177 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:49.177 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:49.177 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='client.? 10.20.193.133:0/2475280925' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28fa6f6e-6515-49ae-930f-22e18eecefde"} : dispatch 2026-02-13T03:33:49.177 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28fa6f6e-6515-49ae-930f-22e18eecefde"} : dispatch 2026-02-13T03:33:49.177 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial132", "root=default"]}]': finished 2026-02-13T03:33:49.177 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28fa6f6e-6515-49ae-930f-22e18eecefde"}]': finished 2026-02-13T03:33:49.177 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: osdmap e55: 12 total, 10 up, 12 in 2026-02-13T03:33:49.177 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:33:49.177 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:49.177 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:48 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:33:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:33:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-13T03:33:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: osdmap e54: 11 total, 10 up, 11 in 2026-02-13T03:33:49.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:33:49.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial132", "root=default"]} : dispatch 2026-02-13T03:33:49.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='osd.10 [v2:10.20.193.132:6824/921326908,v1:10.20.193.132:6825/921326908]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial132", "root=default"]} : dispatch 2026-02-13T03:33:49.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial133:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:33:49.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:49.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:49.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:49.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:49.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:49.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:49.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:49.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:49.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:49.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:49.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:49.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:49.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:49.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:49.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:49.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:49.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:49.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:49.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:49.266 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='client.? 10.20.193.133:0/2475280925' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28fa6f6e-6515-49ae-930f-22e18eecefde"} : dispatch 2026-02-13T03:33:49.266 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28fa6f6e-6515-49ae-930f-22e18eecefde"} : dispatch 2026-02-13T03:33:49.266 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial132", "root=default"]}]': finished 2026-02-13T03:33:49.266 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28fa6f6e-6515-49ae-930f-22e18eecefde"}]': finished 2026-02-13T03:33:49.266 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: osdmap e55: 12 total, 10 up, 12 in 2026-02-13T03:33:49.266 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:33:49.266 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:49.266 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:48 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:33:50.137 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:49 trial133 ceph-mon[26943]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:33:50.137 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:49 trial133 ceph-mon[26943]: from='client.? 10.20.193.133:0/1171653877' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:33:50.137 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:49 trial133 ceph-mon[26943]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:50.137 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:49 trial133 ceph-mon[26943]: Cluster is now healthy 2026-02-13T03:33:50.137 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:49 trial133 ceph-mon[26943]: osd.10 [v2:10.20.193.132:6824/921326908,v1:10.20.193.132:6825/921326908] boot 2026-02-13T03:33:50.137 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:49 trial133 ceph-mon[26943]: osdmap e56: 12 total, 11 up, 12 in 2026-02-13T03:33:50.137 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:49 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:33:50.137 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:49 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:50.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:49 trial096 ceph-mon[24671]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:33:50.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:49 trial096 ceph-mon[24671]: from='client.? 10.20.193.133:0/1171653877' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:33:50.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:49 trial096 ceph-mon[24671]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:50.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:49 trial096 ceph-mon[24671]: Cluster is now healthy 2026-02-13T03:33:50.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:49 trial096 ceph-mon[24671]: osd.10 [v2:10.20.193.132:6824/921326908,v1:10.20.193.132:6825/921326908] boot 2026-02-13T03:33:50.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:49 trial096 ceph-mon[24671]: osdmap e56: 12 total, 11 up, 12 in 2026-02-13T03:33:50.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:49 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:33:50.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:49 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:50.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:49 trial132 ceph-mon[26888]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:33:50.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:49 trial132 ceph-mon[26888]: from='client.? 10.20.193.133:0/1171653877' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:33:50.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:49 trial132 ceph-mon[26888]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:50.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:49 trial132 ceph-mon[26888]: Cluster is now healthy 2026-02-13T03:33:50.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:49 trial132 ceph-mon[26888]: osd.10 [v2:10.20.193.132:6824/921326908,v1:10.20.193.132:6825/921326908] boot 2026-02-13T03:33:50.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:49 trial132 ceph-mon[26888]: osdmap e56: 12 total, 11 up, 12 in 2026-02-13T03:33:50.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:49 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:33:50.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:49 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:50.958 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:50 trial133 ceph-mon[26943]: purged_snaps scrub starts 2026-02-13T03:33:50.958 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:50 trial133 ceph-mon[26943]: purged_snaps scrub ok 2026-02-13T03:33:50.958 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:50 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:50.958 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:50 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:50.958 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:50 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:50.958 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:50 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:50.958 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:50 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:50.958 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:50 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:50.959 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:50 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:50.959 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:50 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:50.959 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:50 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:50.959 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:50 trial133 ceph-mon[26943]: osdmap e57: 12 total, 11 up, 12 in 2026-02-13T03:33:50.959 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:50 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:51.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:50 trial096 ceph-mon[24671]: purged_snaps scrub starts 2026-02-13T03:33:51.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:50 trial096 ceph-mon[24671]: purged_snaps scrub ok 2026-02-13T03:33:51.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:50 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:51.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:50 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:51.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:50 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:51.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:50 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:51.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:50 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:51.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:50 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:51.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:50 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:51.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:50 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:51.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:50 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:51.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:50 trial096 ceph-mon[24671]: osdmap e57: 12 total, 11 up, 12 in 2026-02-13T03:33:51.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:50 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:51.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:50 trial132 ceph-mon[26888]: purged_snaps scrub starts 2026-02-13T03:33:51.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:50 trial132 ceph-mon[26888]: purged_snaps scrub ok 2026-02-13T03:33:51.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:50 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:51.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:50 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:51.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:50 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:51.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:50 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:51.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:50 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:51.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:50 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:51.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:50 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:51.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:50 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:51.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:50 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:51.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:50 trial132 ceph-mon[26888]: osdmap e57: 12 total, 11 up, 12 in 2026-02-13T03:33:51.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:50 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:52.057 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:51 trial133 ceph-mon[26943]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:33:52.058 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:51 trial133 ceph-mon[26943]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:33:52.058 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:51 trial133 ceph-mon[26943]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:33:52.058 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:51 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-13T03:33:52.058 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:51 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:52.058 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:51 trial133 ceph-mon[26943]: osdmap e58: 12 total, 11 up, 12 in 2026-02-13T03:33:52.058 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:51 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:52.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:51 trial096 ceph-mon[24671]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:33:52.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:51 trial096 ceph-mon[24671]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:33:52.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:51 trial096 ceph-mon[24671]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:33:52.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:51 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-13T03:33:52.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:51 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:52.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:51 trial096 ceph-mon[24671]: osdmap e58: 12 total, 11 up, 12 in 2026-02-13T03:33:52.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:51 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:52.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:51 trial132 ceph-mon[26888]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:33:52.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:51 trial132 ceph-mon[26888]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:33:52.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:51 trial132 ceph-mon[26888]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:33:52.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:51 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-13T03:33:52.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:51 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:52.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:51 trial132 ceph-mon[26888]: osdmap e58: 12 total, 11 up, 12 in 2026-02-13T03:33:52.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:51 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:53.077 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:52 trial133 ceph-mon[26943]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:33:53.077 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:52 trial133 ceph-mon[26943]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:53.077 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:52 trial133 ceph-mon[26943]: osdmap e59: 12 total, 11 up, 12 in 2026-02-13T03:33:53.077 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:53.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:52 trial096 ceph-mon[24671]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:33:53.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:52 trial096 ceph-mon[24671]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:53.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:52 trial096 ceph-mon[24671]: osdmap e59: 12 total, 11 up, 12 in 2026-02-13T03:33:53.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:53.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:52 trial132 ceph-mon[26888]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:33:53.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:52 trial132 ceph-mon[26888]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:53.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:52 trial132 ceph-mon[26888]: osdmap e59: 12 total, 11 up, 12 in 2026-02-13T03:33:53.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:54.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:54.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:54.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:54.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:53 trial096 ceph-mon[24671]: osdmap e60: 12 total, 11 up, 12 in 2026-02-13T03:33:54.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:54.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:54.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:54.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:54.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:53 trial132 ceph-mon[26888]: osdmap e60: 12 total, 11 up, 12 in 2026-02-13T03:33:54.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:54.255 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:54.255 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:54.255 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:54.255 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:53 trial133 ceph-mon[26943]: osdmap e60: 12 total, 11 up, 12 in 2026-02-13T03:33:54.255 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:54.341 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:54.338+0000 7f8d3cff96c0 1 -- 10.20.193.133:0/2903127572 <== mgr.14116 v2:10.20.193.96:6800/1736050816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8d400efc40 con 0x7f8d140b5600 2026-02-13T03:33:54.341 INFO:teuthology.orchestra.run.trial133.stdout:Created osd(s) 11 on host 'trial133' 2026-02-13T03:33:54.343 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:54.340+0000 7f8d460316c0 1 -- 10.20.193.133:0/2903127572 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f8d140b5600 msgr2=0x7f8d140d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:54.344 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:54.340+0000 7f8d460316c0 1 --2- 10.20.193.133:0/2903127572 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f8d140b5600 0x7f8d140d5ab0 secure :-1 s=READY pgs=133 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d30005980 tx=0x7f8d30005910 comp rx=0 tx=0).stop 2026-02-13T03:33:54.344 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:54.340+0000 7f8d460316c0 1 -- 10.20.193.133:0/2903127572 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8d4010eec0 msgr2=0x7f8d400f9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:54.344 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:54.340+0000 7f8d460316c0 1 --2- 10.20.193.133:0/2903127572 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8d4010eec0 0x7f8d400f9060 secure :-1 s=READY pgs=36 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d2c02ff00 tx=0x7f8d2c004670 comp rx=0 tx=0).stop 2026-02-13T03:33:54.344 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:54.340+0000 7f8d460316c0 1 -- 10.20.193.133:0/2903127572 shutdown_connections 2026-02-13T03:33:54.344 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:54.340+0000 7f8d460316c0 1 --2- 10.20.193.133:0/2903127572 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f8d140b5600 0x7f8d140d5ab0 unknown :-1 s=CLOSED pgs=133 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:54.344 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:54.340+0000 7f8d460316c0 1 --2- 10.20.193.133:0/2903127572 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8d401109f0 0x7f8d400f98c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:54.344 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:54.340+0000 7f8d460316c0 1 --2- 10.20.193.133:0/2903127572 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8d40110040 0x7f8d40171380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:54.344 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:54.340+0000 7f8d460316c0 1 --2- 10.20.193.133:0/2903127572 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8d4010eec0 0x7f8d400f9060 unknown :-1 s=CLOSED pgs=36 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:54.344 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:54.340+0000 7f8d460316c0 1 -- 10.20.193.133:0/2903127572 >> 10.20.193.133:0/2903127572 conn(0x7f8d400ec5c0 msgr2=0x7f8d400ef530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:54.344 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:54.340+0000 7f8d460316c0 1 -- 10.20.193.133:0/2903127572 shutdown_connections 2026-02-13T03:33:54.345 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:54.340+0000 7f8d460316c0 1 -- 10.20.193.133:0/2903127572 wait complete. 2026-02-13T03:33:54.385 DEBUG:teuthology.orchestra.run.trial133:osd.11> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.11.service 2026-02-13T03:33:54.388 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2026-02-13T03:33:54.388 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T03:33:54.508 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:33:54.631 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.627+0000 7f4262f2b6c0 1 -- 10.20.193.96:0/1522503198 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f425c10cc50 msgr2=0x7f425c10d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:54.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.627+0000 7f4262f2b6c0 1 --2- 10.20.193.96:0/1522503198 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f425c10cc50 0x7f425c10d040 secure :-1 s=READY pgs=183 gs=1 cs=0 l=1 c_cookie=1955351018269714954 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f424c009970 tx=0x7f424c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:33:54.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.627+0000 7f4262f2b6c0 1 -- 10.20.193.96:0/1522503198 shutdown_connections 2026-02-13T03:33:54.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.627+0000 7f4262f2b6c0 1 --2- 10.20.193.96:0/1522503198 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f425c10e780 0x7f425c16f110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:54.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.627+0000 7f4262f2b6c0 1 --2- 10.20.193.96:0/1522503198 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f425c10ddd0 0x7f425c10e240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:54.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.627+0000 7f4262f2b6c0 1 --2- 10.20.193.96:0/1522503198 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f425c10cc50 0x7f425c10d040 unknown :-1 s=CLOSED pgs=183 gs=1 cs=0 l=1 c_cookie=1955351018269714954 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:54.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.627+0000 7f4262f2b6c0 1 -- 10.20.193.96:0/1522503198 >> 10.20.193.96:0/1522503198 conn(0x7f425c0ea370 msgr2=0x7f425c10a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:54.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.627+0000 7f4262f2b6c0 1 -- 10.20.193.96:0/1522503198 shutdown_connections 2026-02-13T03:33:54.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.627+0000 7f4262f2b6c0 1 -- 10.20.193.96:0/1522503198 wait complete. 2026-02-13T03:33:54.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.627+0000 7f4262f2b6c0 1 Processor -- start 2026-02-13T03:33:54.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f4262f2b6c0 1 -- start start 2026-02-13T03:33:54.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f4262f2b6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f425c10cc50 0x7f425c0f6300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:54.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f4262f2b6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f425c10ddd0 0x7f425c16f110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:54.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f4262f2b6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f425c10e780 0x7f425c0f6b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:54.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f4262f2b6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f425c0f7700 con 0x7f425c10cc50 2026-02-13T03:33:54.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f4262f2b6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f425c0f7870 con 0x7f425c10e780 2026-02-13T03:33:54.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f4262f2b6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f425c0f7a30 con 0x7f425c10ddd0 2026-02-13T03:33:54.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f4260c9c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f425c10cc50 0x7f425c0f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:54.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f4260c9c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f425c10cc50 0x7f425c0f6300 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:54324/0 (socket says 10.20.193.96:54324) 2026-02-13T03:33:54.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f4260c9c6c0 1 -- 10.20.193.96:0/1909722763 learned_addr learned my addr 10.20.193.96:0/1909722763 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:33:54.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f426149d6c0 1 --2- 10.20.193.96:0/1909722763 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f425c10e780 0x7f425c0f6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:54.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f4253fff6c0 1 --2- 10.20.193.96:0/1909722763 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f425c10ddd0 0x7f425c16f110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:54.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f4260c9c6c0 1 -- 10.20.193.96:0/1909722763 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f425c10ddd0 msgr2=0x7f425c16f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:54.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f4260c9c6c0 1 --2- 10.20.193.96:0/1909722763 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f425c10ddd0 0x7f425c16f110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:54.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f4260c9c6c0 1 -- 10.20.193.96:0/1909722763 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f425c10e780 msgr2=0x7f425c0f6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:54.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f4260c9c6c0 1 --2- 10.20.193.96:0/1909722763 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f425c10e780 0x7f425c0f6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:54.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f4260c9c6c0 1 -- 10.20.193.96:0/1909722763 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f424c009590 con 0x7f425c10cc50 2026-02-13T03:33:54.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f4253fff6c0 1 --2- 10.20.193.96:0/1909722763 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f425c10ddd0 0x7f425c16f110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:33:54.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f426149d6c0 1 --2- 10.20.193.96:0/1909722763 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f425c10e780 0x7f425c0f6b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:33:54.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f4260c9c6c0 1 --2- 10.20.193.96:0/1909722763 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f425c10cc50 0x7f425c0f6300 secure :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f424c006010 tx=0x7f424c0046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:54.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f4251ffb6c0 1 -- 10.20.193.96:0/1909722763 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f424c002c20 con 0x7f425c10cc50 2026-02-13T03:33:54.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f4251ffb6c0 1 -- 10.20.193.96:0/1909722763 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f424c002d80 con 0x7f425c10cc50 2026-02-13T03:33:54.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f4262f2b6c0 1 -- 10.20.193.96:0/1909722763 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f425c0f7cb0 con 0x7f425c10cc50 2026-02-13T03:33:54.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f4251ffb6c0 1 -- 10.20.193.96:0/1909722763 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f424c0313c0 con 0x7f425c10cc50 2026-02-13T03:33:54.635 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.628+0000 7f4262f2b6c0 1 -- 10.20.193.96:0/1909722763 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f425c0f8130 con 0x7f425c10cc50 2026-02-13T03:33:54.635 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.629+0000 7f4262f2b6c0 1 -- 10.20.193.96:0/1909722763 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f425c0f8350 con 0x7f425c10cc50 2026-02-13T03:33:54.636 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.630+0000 7f4251ffb6c0 1 -- 10.20.193.96:0/1909722763 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f424c007ad0 con 0x7f425c10cc50 2026-02-13T03:33:54.636 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.631+0000 7f4251ffb6c0 1 --2- 10.20.193.96:0/1909722763 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f42380b5600 0x7f42380d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:54.636 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.631+0000 7f4253fff6c0 1 --2- 10.20.193.96:0/1909722763 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f42380b5600 0x7f42380d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:54.636 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.631+0000 7f4251ffb6c0 1 -- 10.20.193.96:0/1909722763 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6586+0+0 (secure 0 0 0) 0x7f424c1077f0 con 0x7f425c10cc50 2026-02-13T03:33:54.636 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.631+0000 7f4253fff6c0 1 --2- 10.20.193.96:0/1909722763 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f42380b5600 0x7f42380d5ab0 secure :-1 s=READY pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4244004750 tx=0x7f4244005e50 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:54.636 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.631+0000 7f4251ffb6c0 1 -- 10.20.193.96:0/1909722763 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f424c0ca8a0 con 0x7f425c10cc50 2026-02-13T03:33:54.725 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.723+0000 7f4262f2b6c0 1 -- 10.20.193.96:0/1909722763 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f425c172a90 con 0x7f425c10cc50 2026-02-13T03:33:54.725 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.723+0000 7f4251ffb6c0 1 -- 10.20.193.96:0/1909722763 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v60) ==== 74+0+133 (secure 0 0 0) 0x7f424c0cd9c0 con 0x7f425c10cc50 2026-02-13T03:33:54.726 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:33:54.727 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.724+0000 7f4262f2b6c0 1 -- 10.20.193.96:0/1909722763 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f42380b5600 msgr2=0x7f42380d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:54.727 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.724+0000 7f4262f2b6c0 1 --2- 10.20.193.96:0/1909722763 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f42380b5600 0x7f42380d5ab0 secure :-1 s=READY pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4244004750 tx=0x7f4244005e50 comp rx=0 tx=0).stop 2026-02-13T03:33:54.727 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.724+0000 7f4262f2b6c0 1 -- 10.20.193.96:0/1909722763 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f425c10cc50 msgr2=0x7f425c0f6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:54.727 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.724+0000 7f4262f2b6c0 1 --2- 10.20.193.96:0/1909722763 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f425c10cc50 0x7f425c0f6300 secure :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f424c006010 tx=0x7f424c0046e0 comp rx=0 tx=0).stop 2026-02-13T03:33:54.727 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.724+0000 7f4262f2b6c0 1 -- 10.20.193.96:0/1909722763 shutdown_connections 2026-02-13T03:33:54.727 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.724+0000 7f4262f2b6c0 1 --2- 10.20.193.96:0/1909722763 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f42380b5600 0x7f42380d5ab0 unknown :-1 s=CLOSED pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:54.727 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.724+0000 7f4262f2b6c0 1 --2- 10.20.193.96:0/1909722763 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f425c10e780 0x7f425c0f6b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:54.727 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.724+0000 7f4262f2b6c0 1 --2- 10.20.193.96:0/1909722763 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f425c10ddd0 0x7f425c16f110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:54.728 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.724+0000 7f4262f2b6c0 1 --2- 10.20.193.96:0/1909722763 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f425c10cc50 0x7f425c0f6300 unknown :-1 s=CLOSED pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:54.728 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.724+0000 7f4262f2b6c0 1 -- 10.20.193.96:0/1909722763 >> 10.20.193.96:0/1909722763 conn(0x7f425c0ea370 msgr2=0x7f425c0ec8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:54.728 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.724+0000 7f4262f2b6c0 1 -- 10.20.193.96:0/1909722763 shutdown_connections 2026-02-13T03:33:54.728 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:54.724+0000 7f4262f2b6c0 1 -- 10.20.193.96:0/1909722763 wait complete. 2026-02-13T03:33:54.766 INFO:teuthology.orchestra.run.trial096.stdout:{"epoch":60,"num_osds":12,"num_up_osds":11,"osd_up_since":1770953629,"num_in_osds":12,"osd_in_since":1770953628,"num_remapped_pgs":0} 2026-02-13T03:33:55.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:54 trial096 ceph-mon[24671]: pgmap v157: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail; 212 KiB/s, 0 objects/s recovering 2026-02-13T03:33:55.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:54 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:55.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:54 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:55.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:54 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:55.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:54 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:55.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:54 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:55.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:54 trial096 ceph-mon[24671]: pgmap v159: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail; 176 KiB/s, 0 objects/s recovering 2026-02-13T03:33:55.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:54 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:55.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:54 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:55.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:54 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:55.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:54 trial096 ceph-mon[24671]: from='osd.11 [v2:10.20.193.133:6824/4255173938,v1:10.20.193.133:6825/4255173938]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T03:33:55.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:54 trial096 ceph-mon[24671]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T03:33:55.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:54 trial096 ceph-mon[24671]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:55.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:54 trial096 ceph-mon[24671]: Cluster is now healthy 2026-02-13T03:33:55.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:54 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:55.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:54 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:55.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:54 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:55.176 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:54 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1909722763' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T03:33:55.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:54 trial132 ceph-mon[26888]: pgmap v157: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail; 212 KiB/s, 0 objects/s recovering 2026-02-13T03:33:55.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:54 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:55.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:54 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:55.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:54 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:55.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:54 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:55.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:54 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:55.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:54 trial132 ceph-mon[26888]: pgmap v159: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail; 176 KiB/s, 0 objects/s recovering 2026-02-13T03:33:55.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:54 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:55.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:54 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:55.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:54 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:55.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:54 trial132 ceph-mon[26888]: from='osd.11 [v2:10.20.193.133:6824/4255173938,v1:10.20.193.133:6825/4255173938]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T03:33:55.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:54 trial132 ceph-mon[26888]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T03:33:55.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:54 trial132 ceph-mon[26888]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:55.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:54 trial132 ceph-mon[26888]: Cluster is now healthy 2026-02-13T03:33:55.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:54 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:55.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:54 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:55.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:54 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:55.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:54 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1909722763' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T03:33:55.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:54 trial133 ceph-mon[26943]: pgmap v157: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail; 212 KiB/s, 0 objects/s recovering 2026-02-13T03:33:55.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:54 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:55.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:54 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:55.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:54 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:55.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:54 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:55.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:54 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:55.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:54 trial133 ceph-mon[26943]: pgmap v159: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail; 176 KiB/s, 0 objects/s recovering 2026-02-13T03:33:55.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:54 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:55.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:54 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:55.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:54 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:55.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:54 trial133 ceph-mon[26943]: from='osd.11 [v2:10.20.193.133:6824/4255173938,v1:10.20.193.133:6825/4255173938]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T03:33:55.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:54 trial133 ceph-mon[26943]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T03:33:55.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:54 trial133 ceph-mon[26943]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:33:55.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:54 trial133 ceph-mon[26943]: Cluster is now healthy 2026-02-13T03:33:55.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:54 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:55.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:54 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:55.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:54 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:55.265 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:54 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1909722763' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T03:33:55.767 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T03:33:55.887 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:33:56.004 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.000+0000 7f1f796f06c0 1 -- 10.20.193.96:0/2186505749 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1f74110040 msgr2=0x7f1f741104b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:56.005 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.000+0000 7f1f796f06c0 1 --2- 10.20.193.96:0/2186505749 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1f74110040 0x7f1f741104b0 secure :-1 s=READY pgs=185 gs=1 cs=0 l=1 c_cookie=11614924259852382469 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f5c009970 tx=0x7f1f5c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:33:56.005 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.000+0000 7f1f796f06c0 1 -- 10.20.193.96:0/2186505749 shutdown_connections 2026-02-13T03:33:56.005 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.000+0000 7f1f796f06c0 1 --2- 10.20.193.96:0/2186505749 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1f741109f0 0x7f1f74171380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:56.005 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.000+0000 7f1f796f06c0 1 --2- 10.20.193.96:0/2186505749 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1f74110040 0x7f1f741104b0 unknown :-1 s=CLOSED pgs=185 gs=1 cs=0 l=1 c_cookie=11614924259852382469 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:56.005 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.000+0000 7f1f796f06c0 1 --2- 10.20.193.96:0/2186505749 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1f7410eec0 0x7f1f7410f2b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:56.005 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.000+0000 7f1f796f06c0 1 -- 10.20.193.96:0/2186505749 >> 10.20.193.96:0/2186505749 conn(0x7f1f740ec5c0 msgr2=0x7f1f7410c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:56.005 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.000+0000 7f1f796f06c0 1 -- 10.20.193.96:0/2186505749 shutdown_connections 2026-02-13T03:33:56.005 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.000+0000 7f1f796f06c0 1 -- 10.20.193.96:0/2186505749 wait complete. 2026-02-13T03:33:56.005 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f796f06c0 1 Processor -- start 2026-02-13T03:33:56.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f796f06c0 1 -- start start 2026-02-13T03:33:56.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f796f06c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1f7410eec0 0x7f1f740f8570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:56.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f796f06c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1f74110040 0x7f1f74171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:56.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f796f06c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1f741109f0 0x7f1f740f8dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:56.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f796f06c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1f740f9a00 con 0x7f1f741109f0 2026-02-13T03:33:56.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f796f06c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1f740f9b70 con 0x7f1f74110040 2026-02-13T03:33:56.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f796f06c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1f740f9d30 con 0x7f1f7410eec0 2026-02-13T03:33:56.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f737fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1f741109f0 0x7f1f740f8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:56.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f737fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1f741109f0 0x7f1f740f8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:54334/0 (socket says 10.20.193.96:54334) 2026-02-13T03:33:56.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f737fe6c0 1 -- 10.20.193.96:0/1332207845 learned_addr learned my addr 10.20.193.96:0/1332207845 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:33:56.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f72ffd6c0 1 --2- 10.20.193.96:0/1332207845 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1f7410eec0 0x7f1f740f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:56.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f727fc6c0 1 --2- 10.20.193.96:0/1332207845 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1f74110040 0x7f1f74171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:56.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f737fe6c0 1 -- 10.20.193.96:0/1332207845 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1f7410eec0 msgr2=0x7f1f740f8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:56.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f737fe6c0 1 --2- 10.20.193.96:0/1332207845 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1f7410eec0 0x7f1f740f8570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:56.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f737fe6c0 1 -- 10.20.193.96:0/1332207845 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1f74110040 msgr2=0x7f1f74171380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:56.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f737fe6c0 1 --2- 10.20.193.96:0/1332207845 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1f74110040 0x7f1f74171380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:56.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f737fe6c0 1 -- 10.20.193.96:0/1332207845 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5c009590 con 0x7f1f741109f0 2026-02-13T03:33:56.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f727fc6c0 1 --2- 10.20.193.96:0/1332207845 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1f74110040 0x7f1f74171380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:33:56.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f737fe6c0 1 --2- 10.20.193.96:0/1332207845 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1f741109f0 0x7f1f740f8dd0 secure :-1 s=READY pgs=186 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f6400c6c0 tx=0x7f1f6400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:56.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f53fff6c0 1 -- 10.20.193.96:0/1332207845 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1f64003a30 con 0x7f1f741109f0 2026-02-13T03:33:56.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f796f06c0 1 -- 10.20.193.96:0/1332207845 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f740fa010 con 0x7f1f741109f0 2026-02-13T03:33:56.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f53fff6c0 1 -- 10.20.193.96:0/1332207845 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f1f64005500 con 0x7f1f741109f0 2026-02-13T03:33:56.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f53fff6c0 1 -- 10.20.193.96:0/1332207845 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1f6400dd80 con 0x7f1f741109f0 2026-02-13T03:33:56.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.001+0000 7f1f796f06c0 1 -- 10.20.193.96:0/1332207845 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f740fa4f0 con 0x7f1f741109f0 2026-02-13T03:33:56.008 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.002+0000 7f1f796f06c0 1 -- 10.20.193.96:0/1332207845 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f741754a0 con 0x7f1f741109f0 2026-02-13T03:33:56.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.003+0000 7f1f53fff6c0 1 -- 10.20.193.96:0/1332207845 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f1f64005080 con 0x7f1f741109f0 2026-02-13T03:33:56.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.004+0000 7f1f53fff6c0 1 --2- 10.20.193.96:0/1332207845 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f1f480b5600 0x7f1f480d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:56.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.004+0000 7f1f72ffd6c0 1 --2- 10.20.193.96:0/1332207845 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f1f480b5600 0x7f1f480d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:56.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.004+0000 7f1f53fff6c0 1 -- 10.20.193.96:0/1332207845 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6624+0+0 (secure 0 0 0) 0x7f1f640e42c0 con 0x7f1f741109f0 2026-02-13T03:33:56.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.004+0000 7f1f72ffd6c0 1 --2- 10.20.193.96:0/1332207845 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f1f480b5600 0x7f1f480d5ab0 secure :-1 s=READY pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f68004750 tx=0x7f1f68009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:56.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.004+0000 7f1f53fff6c0 1 -- 10.20.193.96:0/1332207845 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1f640a7320 con 0x7f1f741109f0 2026-02-13T03:33:56.075 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:33:55 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:33:55.963+0000 7fac1c0676c0 -1 osd.11 0 waiting for initial osdmap 2026-02-13T03:33:56.075 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:33:55 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:33:55.968+0000 7fac13f236c0 -1 osd.11 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:33:56.075 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:55 trial133 ceph-mon[26943]: pgmap v160: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail; 173 KiB/s, 0 objects/s recovering 2026-02-13T03:33:56.075 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:55 trial133 ceph-mon[26943]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-13T03:33:56.075 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:55 trial133 ceph-mon[26943]: from='osd.11 [v2:10.20.193.133:6824/4255173938,v1:10.20.193.133:6825/4255173938]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial133", "root=default"]} : dispatch 2026-02-13T03:33:56.075 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:55 trial133 ceph-mon[26943]: osdmap e61: 12 total, 11 up, 12 in 2026-02-13T03:33:56.075 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:55 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:56.076 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:55 trial133 ceph-mon[26943]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial133", "root=default"]} : dispatch 2026-02-13T03:33:56.076 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:55 trial133 ceph-mon[26943]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:56.076 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:55 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:56.076 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:55 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:56.076 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:55 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:56.076 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:55 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:56.076 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:55 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:56.076 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:55 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:56.076 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:55 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:56.076 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:55 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:56.076 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:55 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:56.076 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:55 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:56.077 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:55 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:56.077 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:55 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:56.077 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:55 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:56.097 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.095+0000 7f1f796f06c0 1 -- 10.20.193.96:0/1332207845 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f1f74174af0 con 0x7f1f741109f0 2026-02-13T03:33:56.097 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.095+0000 7f1f53fff6c0 1 -- 10.20.193.96:0/1332207845 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v62) ==== 74+0+133 (secure 0 0 0) 0x7f1f64005360 con 0x7f1f741109f0 2026-02-13T03:33:56.098 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:55 trial096 ceph-mon[24671]: pgmap v160: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail; 173 KiB/s, 0 objects/s recovering 2026-02-13T03:33:56.098 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:55 trial096 ceph-mon[24671]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-13T03:33:56.098 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:55 trial096 ceph-mon[24671]: from='osd.11 [v2:10.20.193.133:6824/4255173938,v1:10.20.193.133:6825/4255173938]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial133", "root=default"]} : dispatch 2026-02-13T03:33:56.098 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:55 trial096 ceph-mon[24671]: osdmap e61: 12 total, 11 up, 12 in 2026-02-13T03:33:56.098 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:55 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:56.098 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:55 trial096 ceph-mon[24671]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial133", "root=default"]} : dispatch 2026-02-13T03:33:56.098 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:55 trial096 ceph-mon[24671]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:56.098 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:55 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:56.098 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:55 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:56.099 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:55 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:56.099 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:55 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:56.099 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:55 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:56.099 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:55 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:56.099 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:55 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:56.099 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:55 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:56.099 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:55 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:56.099 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:55 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:56.099 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:55 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:56.099 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:55 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:56.099 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:55 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:56.100 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:33:56.101 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.096+0000 7f1f796f06c0 1 -- 10.20.193.96:0/1332207845 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f1f480b5600 msgr2=0x7f1f480d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:56.101 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.096+0000 7f1f796f06c0 1 --2- 10.20.193.96:0/1332207845 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f1f480b5600 0x7f1f480d5ab0 secure :-1 s=READY pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f68004750 tx=0x7f1f68009390 comp rx=0 tx=0).stop 2026-02-13T03:33:56.101 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.096+0000 7f1f796f06c0 1 -- 10.20.193.96:0/1332207845 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1f741109f0 msgr2=0x7f1f740f8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:56.101 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.096+0000 7f1f796f06c0 1 --2- 10.20.193.96:0/1332207845 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1f741109f0 0x7f1f740f8dd0 secure :-1 s=READY pgs=186 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f6400c6c0 tx=0x7f1f6400cb90 comp rx=0 tx=0).stop 2026-02-13T03:33:56.101 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.096+0000 7f1f796f06c0 1 -- 10.20.193.96:0/1332207845 shutdown_connections 2026-02-13T03:33:56.101 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.096+0000 7f1f796f06c0 1 --2- 10.20.193.96:0/1332207845 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f1f480b5600 0x7f1f480d5ab0 unknown :-1 s=CLOSED pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:56.101 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.096+0000 7f1f796f06c0 1 --2- 10.20.193.96:0/1332207845 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1f741109f0 0x7f1f740f8dd0 unknown :-1 s=CLOSED pgs=186 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:56.101 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.096+0000 7f1f796f06c0 1 --2- 10.20.193.96:0/1332207845 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1f74110040 0x7f1f74171380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:56.101 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.096+0000 7f1f796f06c0 1 --2- 10.20.193.96:0/1332207845 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1f7410eec0 0x7f1f740f8570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:56.102 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.096+0000 7f1f796f06c0 1 -- 10.20.193.96:0/1332207845 >> 10.20.193.96:0/1332207845 conn(0x7f1f740ec5c0 msgr2=0x7f1f740eeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:56.102 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.096+0000 7f1f796f06c0 1 -- 10.20.193.96:0/1332207845 shutdown_connections 2026-02-13T03:33:56.102 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:56.096+0000 7f1f796f06c0 1 -- 10.20.193.96:0/1332207845 wait complete. 2026-02-13T03:33:56.138 INFO:teuthology.orchestra.run.trial096.stdout:{"epoch":62,"num_osds":12,"num_up_osds":11,"osd_up_since":1770953629,"num_in_osds":12,"osd_in_since":1770953628,"num_remapped_pgs":0} 2026-02-13T03:33:56.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:55 trial132 ceph-mon[26888]: pgmap v160: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail; 173 KiB/s, 0 objects/s recovering 2026-02-13T03:33:56.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:55 trial132 ceph-mon[26888]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-13T03:33:56.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:55 trial132 ceph-mon[26888]: from='osd.11 [v2:10.20.193.133:6824/4255173938,v1:10.20.193.133:6825/4255173938]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial133", "root=default"]} : dispatch 2026-02-13T03:33:56.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:55 trial132 ceph-mon[26888]: osdmap e61: 12 total, 11 up, 12 in 2026-02-13T03:33:56.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:55 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:56.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:55 trial132 ceph-mon[26888]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial133", "root=default"]} : dispatch 2026-02-13T03:33:56.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:55 trial132 ceph-mon[26888]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:33:56.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:55 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:56.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:55 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:56.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:55 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:56.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:55 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:56.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:55 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:56.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:55 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-13T03:33:56.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:55 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:56.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:55 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:56.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:55 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:56.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:55 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:56.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:55 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:56.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:55 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:56.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:55 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:57.139 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T03:33:57.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:56 trial132 ceph-mon[26888]: pgmap v162: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:33:57.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:56 trial132 ceph-mon[26888]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial133", "root=default"]}]': finished 2026-02-13T03:33:57.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:56 trial132 ceph-mon[26888]: osdmap e62: 12 total, 11 up, 12 in 2026-02-13T03:33:57.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:56 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:57.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:56 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:57.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:56 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1332207845' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T03:33:57.258 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:33:57.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:56 trial133 ceph-mon[26943]: pgmap v162: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:33:57.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:56 trial133 ceph-mon[26943]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial133", "root=default"]}]': finished 2026-02-13T03:33:57.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:56 trial133 ceph-mon[26943]: osdmap e62: 12 total, 11 up, 12 in 2026-02-13T03:33:57.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:56 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:57.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:56 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:57.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:56 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1332207845' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T03:33:57.280 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:56 trial096 ceph-mon[24671]: pgmap v162: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:33:57.280 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:56 trial096 ceph-mon[24671]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial133", "root=default"]}]': finished 2026-02-13T03:33:57.280 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:56 trial096 ceph-mon[24671]: osdmap e62: 12 total, 11 up, 12 in 2026-02-13T03:33:57.280 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:56 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:57.280 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:56 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:57.281 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:56 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1332207845' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T03:33:57.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.368+0000 7fe6f8ac36c0 1 -- 10.20.193.96:0/748942188 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe6f4110050 msgr2=0x7fe6f41104c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:57.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.368+0000 7fe6f8ac36c0 1 --2- 10.20.193.96:0/748942188 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe6f4110050 0x7fe6f41104c0 secure :-1 s=READY pgs=187 gs=1 cs=0 l=1 c_cookie=1443323275509731662 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6dc009970 tx=0x7fe6dc02ed20 comp rx=0 tx=0).stop 2026-02-13T03:33:57.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.368+0000 7fe6f8ac36c0 1 -- 10.20.193.96:0/748942188 shutdown_connections 2026-02-13T03:33:57.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.368+0000 7fe6f8ac36c0 1 --2- 10.20.193.96:0/748942188 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe6f4110a00 0x7fe6f4171390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:57.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.368+0000 7fe6f8ac36c0 1 --2- 10.20.193.96:0/748942188 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe6f4110050 0x7fe6f41104c0 unknown :-1 s=CLOSED pgs=187 gs=1 cs=0 l=1 c_cookie=1443323275509731662 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:57.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.368+0000 7fe6f8ac36c0 1 --2- 10.20.193.96:0/748942188 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe6f410eed0 0x7fe6f410f2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:57.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.368+0000 7fe6f8ac36c0 1 -- 10.20.193.96:0/748942188 >> 10.20.193.96:0/748942188 conn(0x7fe6f40ec5f0 msgr2=0x7fe6f410ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:57.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.369+0000 7fe6f8ac36c0 1 -- 10.20.193.96:0/748942188 shutdown_connections 2026-02-13T03:33:57.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.369+0000 7fe6f8ac36c0 1 -- 10.20.193.96:0/748942188 wait complete. 2026-02-13T03:33:57.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.369+0000 7fe6f8ac36c0 1 Processor -- start 2026-02-13T03:33:57.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.369+0000 7fe6f8ac36c0 1 -- start start 2026-02-13T03:33:57.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.369+0000 7fe6f8ac36c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe6f410eed0 0x7fe6f40f8fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:57.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.369+0000 7fe6f8ac36c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe6f4110050 0x7fe6f4171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:57.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.369+0000 7fe6f8ac36c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe6f4110a00 0x7fe6f40f9830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:57.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.369+0000 7fe6f8ac36c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f40fa3d0 con 0x7fe6f4110a00 2026-02-13T03:33:57.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.369+0000 7fe6f8ac36c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f40fa540 con 0x7fe6f4110050 2026-02-13T03:33:57.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.369+0000 7fe6f8ac36c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f40fa700 con 0x7fe6f410eed0 2026-02-13T03:33:57.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.369+0000 7fe6f2d766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe6f4110a00 0x7fe6f40f9830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:57.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.369+0000 7fe6f2d766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe6f4110a00 0x7fe6f40f9830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:54354/0 (socket says 10.20.193.96:54354) 2026-02-13T03:33:57.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.369+0000 7fe6f2d766c0 1 -- 10.20.193.96:0/1483306989 learned_addr learned my addr 10.20.193.96:0/1483306989 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:33:57.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.369+0000 7fe6f25756c0 1 --2- 10.20.193.96:0/1483306989 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe6f410eed0 0x7fe6f40f8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:57.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.369+0000 7fe6f2d766c0 1 -- 10.20.193.96:0/1483306989 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe6f410eed0 msgr2=0x7fe6f40f8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:57.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.369+0000 7fe6f2d766c0 1 --2- 10.20.193.96:0/1483306989 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe6f410eed0 0x7fe6f40f8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:57.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.369+0000 7fe6f2d766c0 1 -- 10.20.193.96:0/1483306989 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe6f4110050 msgr2=0x7fe6f4171390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:57.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.369+0000 7fe6f2d766c0 1 --2- 10.20.193.96:0/1483306989 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe6f4110050 0x7fe6f4171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:57.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.369+0000 7fe6f2d766c0 1 -- 10.20.193.96:0/1483306989 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6dc009590 con 0x7fe6f4110a00 2026-02-13T03:33:57.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.369+0000 7fe6f2d766c0 1 --2- 10.20.193.96:0/1483306989 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe6f4110a00 0x7fe6f40f9830 secure :-1 s=READY pgs=188 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6e4006ea0 tx=0x7fe6e400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:57.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.370+0000 7fe6db7fe6c0 1 -- 10.20.193.96:0/1483306989 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6e4003a30 con 0x7fe6f4110a00 2026-02-13T03:33:57.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.370+0000 7fe6db7fe6c0 1 -- 10.20.193.96:0/1483306989 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fe6e4005510 con 0x7fe6f4110a00 2026-02-13T03:33:57.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.370+0000 7fe6f8ac36c0 1 -- 10.20.193.96:0/1483306989 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6f40fa9e0 con 0x7fe6f4110a00 2026-02-13T03:33:57.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.370+0000 7fe6db7fe6c0 1 -- 10.20.193.96:0/1483306989 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6e400dd70 con 0x7fe6f4110a00 2026-02-13T03:33:57.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.370+0000 7fe6f8ac36c0 1 -- 10.20.193.96:0/1483306989 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6f40fae70 con 0x7fe6f4110a00 2026-02-13T03:33:57.376 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.370+0000 7fe6f8ac36c0 1 -- 10.20.193.96:0/1483306989 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6f4175400 con 0x7fe6f4110a00 2026-02-13T03:33:57.377 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.372+0000 7fe6db7fe6c0 1 -- 10.20.193.96:0/1483306989 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7fe6e4003b90 con 0x7fe6f4110a00 2026-02-13T03:33:57.377 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.373+0000 7fe6db7fe6c0 1 --2- 10.20.193.96:0/1483306989 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe6cc0b5600 0x7fe6cc0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:57.377 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.373+0000 7fe6f25756c0 1 --2- 10.20.193.96:0/1483306989 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe6cc0b5600 0x7fe6cc0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:57.377 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.373+0000 7fe6db7fe6c0 1 -- 10.20.193.96:0/1483306989 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6904+0+0 (secure 0 0 0) 0x7fe6e40e4670 con 0x7fe6f4110a00 2026-02-13T03:33:57.377 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.373+0000 7fe6db7fe6c0 1 -- 10.20.193.96:0/1483306989 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe6e40e4b60 con 0x7fe6f4110a00 2026-02-13T03:33:57.377 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.373+0000 7fe6f25756c0 1 --2- 10.20.193.96:0/1483306989 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe6cc0b5600 0x7fe6cc0d5ab0 secure :-1 s=READY pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6e8004750 tx=0x7fe6e8005e60 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:57.467 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.464+0000 7fe6f8ac36c0 1 -- 10.20.193.96:0/1483306989 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe6f4174a50 con 0x7fe6f4110a00 2026-02-13T03:33:57.467 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.464+0000 7fe6db7fe6c0 1 -- 10.20.193.96:0/1483306989 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v63) ==== 74+0+133 (secure 0 0 0) 0x7fe6e40a7590 con 0x7fe6f4110a00 2026-02-13T03:33:57.467 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:33:57.468 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.466+0000 7fe6f8ac36c0 1 -- 10.20.193.96:0/1483306989 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe6cc0b5600 msgr2=0x7fe6cc0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:57.468 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.466+0000 7fe6f8ac36c0 1 --2- 10.20.193.96:0/1483306989 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe6cc0b5600 0x7fe6cc0d5ab0 secure :-1 s=READY pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6e8004750 tx=0x7fe6e8005e60 comp rx=0 tx=0).stop 2026-02-13T03:33:57.469 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.466+0000 7fe6f8ac36c0 1 -- 10.20.193.96:0/1483306989 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe6f4110a00 msgr2=0x7fe6f40f9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:57.469 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.466+0000 7fe6f8ac36c0 1 --2- 10.20.193.96:0/1483306989 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe6f4110a00 0x7fe6f40f9830 secure :-1 s=READY pgs=188 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6e4006ea0 tx=0x7fe6e400cca0 comp rx=0 tx=0).stop 2026-02-13T03:33:57.469 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.466+0000 7fe6f8ac36c0 1 -- 10.20.193.96:0/1483306989 shutdown_connections 2026-02-13T03:33:57.469 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.466+0000 7fe6f8ac36c0 1 --2- 10.20.193.96:0/1483306989 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe6cc0b5600 0x7fe6cc0d5ab0 unknown :-1 s=CLOSED pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:57.469 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.466+0000 7fe6f8ac36c0 1 --2- 10.20.193.96:0/1483306989 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe6f4110a00 0x7fe6f40f9830 unknown :-1 s=CLOSED pgs=188 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:57.469 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.466+0000 7fe6f8ac36c0 1 --2- 10.20.193.96:0/1483306989 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe6f4110050 0x7fe6f4171390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:57.469 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.466+0000 7fe6f8ac36c0 1 --2- 10.20.193.96:0/1483306989 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe6f410eed0 0x7fe6f40f8fd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:57.469 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.466+0000 7fe6f8ac36c0 1 -- 10.20.193.96:0/1483306989 >> 10.20.193.96:0/1483306989 conn(0x7fe6f40ec5f0 msgr2=0x7fe6f40ef4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:57.469 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.466+0000 7fe6f8ac36c0 1 -- 10.20.193.96:0/1483306989 shutdown_connections 2026-02-13T03:33:57.469 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.466+0000 7fe6f8ac36c0 1 -- 10.20.193.96:0/1483306989 wait complete. 2026-02-13T03:33:57.509 INFO:teuthology.orchestra.run.trial096.stdout:{"epoch":63,"num_osds":12,"num_up_osds":12,"osd_up_since":1770953636,"num_in_osds":12,"osd_in_since":1770953628,"num_remapped_pgs":0} 2026-02-13T03:33:57.510 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T03:33:57.627 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:33:57.743 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78e02436c0 1 -- 10.20.193.96:0/172773159 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f78d810fc20 msgr2=0x7f78d8114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:57.743 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78e02436c0 1 --2- 10.20.193.96:0/172773159 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f78d810fc20 0x7f78d8114c60 secure :-1 s=READY pgs=189 gs=1 cs=0 l=1 c_cookie=15532649799703790770 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78cc0099a0 tx=0x7f78cc02ed20 comp rx=0 tx=0).stop 2026-02-13T03:33:57.743 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78e02436c0 1 -- 10.20.193.96:0/172773159 shutdown_connections 2026-02-13T03:33:57.744 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78e02436c0 1 --2- 10.20.193.96:0/172773159 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f78d8115440 0x7f78d8175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:57.744 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78e02436c0 1 --2- 10.20.193.96:0/172773159 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f78d810fc20 0x7f78d8114c60 unknown :-1 s=CLOSED pgs=189 gs=1 cs=0 l=1 c_cookie=15532649799703790770 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:57.744 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78e02436c0 1 --2- 10.20.193.96:0/172773159 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f78d810f230 0x7f78d810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:57.744 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78e02436c0 1 -- 10.20.193.96:0/172773159 >> 10.20.193.96:0/172773159 conn(0x7f78d80ecb30 msgr2=0x7f78d810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:57.744 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78e02436c0 1 -- 10.20.193.96:0/172773159 shutdown_connections 2026-02-13T03:33:57.744 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78e02436c0 1 -- 10.20.193.96:0/172773159 wait complete. 2026-02-13T03:33:57.744 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78e02436c0 1 Processor -- start 2026-02-13T03:33:57.744 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78e02436c0 1 -- start start 2026-02-13T03:33:57.744 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78e02436c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f78d810f230 0x7f78d811d150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:57.744 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78e02436c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f78d8115440 0x7f78d811d690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:57.744 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78e02436c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f78d8122a50 0x7f78d8122ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:57.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78e02436c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f78d8123460 con 0x7f78d810f230 2026-02-13T03:33:57.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78e02436c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f78d81235d0 con 0x7f78d8122a50 2026-02-13T03:33:57.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78e02436c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f78d8123790 con 0x7f78d8115440 2026-02-13T03:33:57.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78ddfb46c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f78d810f230 0x7f78d811d150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:57.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78ddfb46c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f78d810f230 0x7f78d811d150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:54362/0 (socket says 10.20.193.96:54362) 2026-02-13T03:33:57.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78ddfb46c0 1 -- 10.20.193.96:0/1968803318 learned_addr learned my addr 10.20.193.96:0/1968803318 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:33:57.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78de7b56c0 1 --2- 10.20.193.96:0/1968803318 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f78d8122a50 0x7f78d8122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:57.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78dd7b36c0 1 --2- 10.20.193.96:0/1968803318 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f78d8115440 0x7f78d811d690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:57.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78ddfb46c0 1 -- 10.20.193.96:0/1968803318 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f78d8115440 msgr2=0x7f78d811d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:57.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78ddfb46c0 1 --2- 10.20.193.96:0/1968803318 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f78d8115440 0x7f78d811d690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:57.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78ddfb46c0 1 -- 10.20.193.96:0/1968803318 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f78d8122a50 msgr2=0x7f78d8122ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:57.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78ddfb46c0 1 --2- 10.20.193.96:0/1968803318 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f78d8122a50 0x7f78d8122ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:57.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.739+0000 7f78ddfb46c0 1 -- 10.20.193.96:0/1968803318 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78cc009590 con 0x7f78d810f230 2026-02-13T03:33:57.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.740+0000 7f78ddfb46c0 1 --2- 10.20.193.96:0/1968803318 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f78d810f230 0x7f78d811d150 secure :-1 s=READY pgs=190 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78c8009490 tx=0x7f78c800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:57.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.740+0000 7f78c6ffd6c0 1 -- 10.20.193.96:0/1968803318 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78c8004a80 con 0x7f78d810f230 2026-02-13T03:33:57.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.740+0000 7f78e02436c0 1 -- 10.20.193.96:0/1968803318 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d8163c40 con 0x7f78d810f230 2026-02-13T03:33:57.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.740+0000 7f78c6ffd6c0 1 -- 10.20.193.96:0/1968803318 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f78c8009030 con 0x7f78d810f230 2026-02-13T03:33:57.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.740+0000 7f78c6ffd6c0 1 -- 10.20.193.96:0/1968803318 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78c800cea0 con 0x7f78d810f230 2026-02-13T03:33:57.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.740+0000 7f78e02436c0 1 -- 10.20.193.96:0/1968803318 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d8164120 con 0x7f78d810f230 2026-02-13T03:33:57.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.740+0000 7f78e02436c0 1 -- 10.20.193.96:0/1968803318 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78d8110500 con 0x7f78d810f230 2026-02-13T03:33:57.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.742+0000 7f78c6ffd6c0 1 -- 10.20.193.96:0/1968803318 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f78c8004060 con 0x7f78d810f230 2026-02-13T03:33:57.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.742+0000 7f78c6ffd6c0 1 --2- 10.20.193.96:0/1968803318 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f78b40b5680 0x7f78b40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:57.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.742+0000 7f78c6ffd6c0 1 -- 10.20.193.96:0/1968803318 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6904+0+0 (secure 0 0 0) 0x7f78c80e36a0 con 0x7f78d810f230 2026-02-13T03:33:57.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.742+0000 7f78dd7b36c0 1 --2- 10.20.193.96:0/1968803318 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f78b40b5680 0x7f78b40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:57.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.742+0000 7f78c6ffd6c0 1 -- 10.20.193.96:0/1968803318 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f78c80e3b90 con 0x7f78d810f230 2026-02-13T03:33:57.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.743+0000 7f78dd7b36c0 1 --2- 10.20.193.96:0/1968803318 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f78b40b5680 0x7f78b40d5b30 secure :-1 s=READY pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78cc0023e0 tx=0x7f78cc005c80 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:57.834 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.832+0000 7f78e02436c0 1 -- 10.20.193.96:0/1968803318 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78d811e2d0 con 0x7f78d810f230 2026-02-13T03:33:57.835 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.832+0000 7f78c6ffd6c0 1 -- 10.20.193.96:0/1968803318 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+18175 (secure 0 0 0) 0x7f78c80a65c0 con 0x7f78d810f230 2026-02-13T03:33:57.835 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:33:57.836 INFO:teuthology.orchestra.run.trial096.stdout:{"epoch":63,"fsid":"7c123de8-088c-11f1-84f7-d404e6e7d460","created":"2026-02-13T03:31:45.642136+0000","modified":"2026-02-13T03:33:56.962006+0000","last_up_change":"2026-02-13T03:33:56.962006+0000","last_in_change":"2026-02-13T03:33:48.669890+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T03:32:50.622231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b4f15df-2bc8-4596-a5de-6b2c54cdf01c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6802","nonce":1861813169},{"type":"v1","addr":"10.20.193.96:6803","nonce":1861813169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6804","nonce":1861813169},{"type":"v1","addr":"10.20.193.96:6805","nonce":1861813169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6808","nonce":1861813169},{"type":"v1","addr":"10.20.193.96:6809","nonce":1861813169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6806","nonce":1861813169},{"type":"v1","addr":"10.20.193.96:6807","nonce":1861813169}]},"public_addr":"10.20.193.96:6803/1861813169","cluster_addr":"10.20.193.96:6805/1861813169","heartbeat_back_addr":"10.20.193.96:6809/1861813169","heartbeat_front_addr":"10.20.193.96:6807/1861813169","state":["exists","up"]},{"osd":1,"uuid":"4238865b-e38e-494d-b2cd-4ee08715f004","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6800","nonce":3550689941},{"type":"v1","addr":"10.20.193.132:6801","nonce":3550689941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6802","nonce":3550689941},{"type":"v1","addr":"10.20.193.132:6803","nonce":3550689941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6806","nonce":3550689941},{"type":"v1","addr":"10.20.193.132:6807","nonce":3550689941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6804","nonce":3550689941},{"type":"v1","addr":"10.20.193.132:6805","nonce":3550689941}]},"public_addr":"10.20.193.132:6801/3550689941","cluster_addr":"10.20.193.132:6803/3550689941","heartbeat_back_addr":"10.20.193.132:6807/3550689941","heartbeat_front_addr":"10.20.193.132:6805/3550689941","state":["exists","up"]},{"osd":2,"uuid":"85769516-916b-43ce-aec8-36a3011ae085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6800","nonce":4145071410},{"type":"v1","addr":"10.20.193.133:6801","nonce":4145071410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6802","nonce":4145071410},{"type":"v1","addr":"10.20.193.133:6803","nonce":4145071410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6806","nonce":4145071410},{"type":"v1","addr":"10.20.193.133:6807","nonce":4145071410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6804","nonce":4145071410},{"type":"v1","addr":"10.20.193.133:6805","nonce":4145071410}]},"public_addr":"10.20.193.133:6801/4145071410","cluster_addr":"10.20.193.133:6803/4145071410","heartbeat_back_addr":"10.20.193.133:6807/4145071410","heartbeat_front_addr":"10.20.193.133:6805/4145071410","state":["exists","up"]},{"osd":3,"uuid":"2fb1e80f-f91e-4f43-a277-ae0f650cbbf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6810","nonce":2289717362},{"type":"v1","addr":"10.20.193.96:6811","nonce":2289717362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6812","nonce":2289717362},{"type":"v1","addr":"10.20.193.96:6813","nonce":2289717362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6816","nonce":2289717362},{"type":"v1","addr":"10.20.193.96:6817","nonce":2289717362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6814","nonce":2289717362},{"type":"v1","addr":"10.20.193.96:6815","nonce":2289717362}]},"public_addr":"10.20.193.96:6811/2289717362","cluster_addr":"10.20.193.96:6813/2289717362","heartbeat_back_addr":"10.20.193.96:6817/2289717362","heartbeat_front_addr":"10.20.193.96:6815/2289717362","state":["exists","up"]},{"osd":4,"uuid":"fc59010d-7a40-47e0-8111-85c564c60c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6808","nonce":421645986},{"type":"v1","addr":"10.20.193.132:6809","nonce":421645986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6810","nonce":421645986},{"type":"v1","addr":"10.20.193.132:6811","nonce":421645986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6814","nonce":421645986},{"type":"v1","addr":"10.20.193.132:6815","nonce":421645986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6812","nonce":421645986},{"type":"v1","addr":"10.20.193.132:6813","nonce":421645986}]},"public_addr":"10.20.193.132:6809/421645986","cluster_addr":"10.20.193.132:6811/421645986","heartbeat_back_addr":"10.20.193.132:6815/421645986","heartbeat_front_addr":"10.20.193.132:6813/421645986","state":["exists","up"]},{"osd":5,"uuid":"301e3dbb-5341-4fda-9c71-7f2fa3f983b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6808","nonce":3625077127},{"type":"v1","addr":"10.20.193.133:6809","nonce":3625077127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6810","nonce":3625077127},{"type":"v1","addr":"10.20.193.133:6811","nonce":3625077127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6814","nonce":3625077127},{"type":"v1","addr":"10.20.193.133:6815","nonce":3625077127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6812","nonce":3625077127},{"type":"v1","addr":"10.20.193.133:6813","nonce":3625077127}]},"public_addr":"10.20.193.133:6809/3625077127","cluster_addr":"10.20.193.133:6811/3625077127","heartbeat_back_addr":"10.20.193.133:6815/3625077127","heartbeat_front_addr":"10.20.193.133:6813/3625077127","state":["exists","up"]},{"osd":6,"uuid":"5d25b12d-8499-4f12-91ca-ce4953256678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6818","nonce":4035362295},{"type":"v1","addr":"10.20.193.96:6819","nonce":4035362295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6820","nonce":4035362295},{"type":"v1","addr":"10.20.193.96:6821","nonce":4035362295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6824","nonce":4035362295},{"type":"v1","addr":"10.20.193.96:6825","nonce":4035362295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6822","nonce":4035362295},{"type":"v1","addr":"10.20.193.96:6823","nonce":4035362295}]},"public_addr":"10.20.193.96:6819/4035362295","cluster_addr":"10.20.193.96:6821/4035362295","heartbeat_back_addr":"10.20.193.96:6825/4035362295","heartbeat_front_addr":"10.20.193.96:6823/4035362295","state":["exists","up"]},{"osd":7,"uuid":"c7d1b3d6-d6c9-4ee2-a767-45dc6a68e941","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6816","nonce":2832704836},{"type":"v1","addr":"10.20.193.132:6817","nonce":2832704836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6818","nonce":2832704836},{"type":"v1","addr":"10.20.193.132:6819","nonce":2832704836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6822","nonce":2832704836},{"type":"v1","addr":"10.20.193.132:6823","nonce":2832704836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6820","nonce":2832704836},{"type":"v1","addr":"10.20.193.132:6821","nonce":2832704836}]},"public_addr":"10.20.193.132:6817/2832704836","cluster_addr":"10.20.193.132:6819/2832704836","heartbeat_back_addr":"10.20.193.132:6823/2832704836","heartbeat_front_addr":"10.20.193.132:6821/2832704836","state":["exists","up"]},{"osd":8,"uuid":"27d57241-5de9-4678-a519-7d218f165183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6816","nonce":3678366387},{"type":"v1","addr":"10.20.193.133:6817","nonce":3678366387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6818","nonce":3678366387},{"type":"v1","addr":"10.20.193.133:6819","nonce":3678366387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6822","nonce":3678366387},{"type":"v1","addr":"10.20.193.133:6823","nonce":3678366387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6820","nonce":3678366387},{"type":"v1","addr":"10.20.193.133:6821","nonce":3678366387}]},"public_addr":"10.20.193.133:6817/3678366387","cluster_addr":"10.20.193.133:6819/3678366387","heartbeat_back_addr":"10.20.193.133:6823/3678366387","heartbeat_front_addr":"10.20.193.133:6821/3678366387","state":["exists","up"]},{"osd":9,"uuid":"93c1ae3e-3b87-4e71-b876-dcd60bbefd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6826","nonce":1024808447},{"type":"v1","addr":"10.20.193.96:6827","nonce":1024808447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6828","nonce":1024808447},{"type":"v1","addr":"10.20.193.96:6829","nonce":1024808447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6832","nonce":1024808447},{"type":"v1","addr":"10.20.193.96:6833","nonce":1024808447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6830","nonce":1024808447},{"type":"v1","addr":"10.20.193.96:6831","nonce":1024808447}]},"public_addr":"10.20.193.96:6827/1024808447","cluster_addr":"10.20.193.96:6829/1024808447","heartbeat_back_addr":"10.20.193.96:6833/1024808447","heartbeat_front_addr":"10.20.193.96:6831/1024808447","state":["exists","up"]},{"osd":10,"uuid":"0e027d3a-fcab-46b0-8719-d335e01449da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6824","nonce":921326908},{"type":"v1","addr":"10.20.193.132:6825","nonce":921326908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6826","nonce":921326908},{"type":"v1","addr":"10.20.193.132:6827","nonce":921326908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6830","nonce":921326908},{"type":"v1","addr":"10.20.193.132:6831","nonce":921326908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6828","nonce":921326908},{"type":"v1","addr":"10.20.193.132:6829","nonce":921326908}]},"public_addr":"10.20.193.132:6825/921326908","cluster_addr":"10.20.193.132:6827/921326908","heartbeat_back_addr":"10.20.193.132:6831/921326908","heartbeat_front_addr":"10.20.193.132:6829/921326908","state":["exists","up"]},{"osd":11,"uuid":"28fa6f6e-6515-49ae-930f-22e18eecefde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6824","nonce":4255173938},{"type":"v1","addr":"10.20.193.133:6825","nonce":4255173938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6826","nonce":4255173938},{"type":"v1","addr":"10.20.193.133:6827","nonce":4255173938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6830","nonce":4255173938},{"type":"v1","addr":"10.20.193.133:6831","nonce":4255173938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6828","nonce":4255173938},{"type":"v1","addr":"10.20.193.133:6829","nonce":4255173938}]},"public_addr":"10.20.193.133:6825/4255173938","cluster_addr":"10.20.193.133:6827/4255173938","heartbeat_back_addr":"10.20.193.133:6831/4255173938","heartbeat_front_addr":"10.20.193.133:6829/4255173938","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:32:33.954605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:32:41.279739+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:32:48.625772+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:32:56.120770+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:03.397402+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:10.481915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:18.008023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:25.421134+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:32.867800+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:40.330823+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:47.773798+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.96:0/2938583287":"2026-02-14T03:31:51.784882+0000","10.20.193.96:0/3118819056":"2026-02-14T03:31:51.784882+0000","10.20.193.96:6801/955566313":"2026-02-14T03:31:51.784882+0000","10.20.193.96:6800/955566313":"2026-02-14T03:31:51.784882+0000","10.20.193.96:0/135845931":"2026-02-14T03:31:51.784882+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T03:33:57.837 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.834+0000 7f78e02436c0 1 -- 10.20.193.96:0/1968803318 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f78b40b5680 msgr2=0x7f78b40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:57.837 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.834+0000 7f78e02436c0 1 --2- 10.20.193.96:0/1968803318 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f78b40b5680 0x7f78b40d5b30 secure :-1 s=READY pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78cc0023e0 tx=0x7f78cc005c80 comp rx=0 tx=0).stop 2026-02-13T03:33:57.837 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.834+0000 7f78e02436c0 1 -- 10.20.193.96:0/1968803318 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f78d810f230 msgr2=0x7f78d811d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:57.837 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.834+0000 7f78e02436c0 1 --2- 10.20.193.96:0/1968803318 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f78d810f230 0x7f78d811d150 secure :-1 s=READY pgs=190 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78c8009490 tx=0x7f78c800bca0 comp rx=0 tx=0).stop 2026-02-13T03:33:57.837 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.834+0000 7f78e02436c0 1 -- 10.20.193.96:0/1968803318 shutdown_connections 2026-02-13T03:33:57.837 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.834+0000 7f78e02436c0 1 --2- 10.20.193.96:0/1968803318 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f78b40b5680 0x7f78b40d5b30 unknown :-1 s=CLOSED pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:57.838 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.834+0000 7f78e02436c0 1 --2- 10.20.193.96:0/1968803318 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f78d8122a50 0x7f78d8122ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:57.838 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.834+0000 7f78e02436c0 1 --2- 10.20.193.96:0/1968803318 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f78d8115440 0x7f78d811d690 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:57.838 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.834+0000 7f78e02436c0 1 --2- 10.20.193.96:0/1968803318 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f78d810f230 0x7f78d811d150 unknown :-1 s=CLOSED pgs=190 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:57.838 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.834+0000 7f78e02436c0 1 -- 10.20.193.96:0/1968803318 >> 10.20.193.96:0/1968803318 conn(0x7f78d80ecb30 msgr2=0x7f78d810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:57.838 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.834+0000 7f78e02436c0 1 -- 10.20.193.96:0/1968803318 shutdown_connections 2026-02-13T03:33:57.839 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:57.834+0000 7f78e02436c0 1 -- 10.20.193.96:0/1968803318 wait complete. 2026-02-13T03:33:57.877 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-13T03:32:50.622231+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-13T03:33:57.877 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-13T03:33:57.995 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:33:58.109 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:57 trial096 ceph-mon[24671]: purged_snaps scrub starts 2026-02-13T03:33:58.109 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:57 trial096 ceph-mon[24671]: purged_snaps scrub ok 2026-02-13T03:33:58.109 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:57 trial096 ceph-mon[24671]: pgmap v164: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:33:58.109 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:57 trial096 ceph-mon[24671]: osd.11 [v2:10.20.193.133:6824/4255173938,v1:10.20.193.133:6825/4255173938] boot 2026-02-13T03:33:58.109 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:57 trial096 ceph-mon[24671]: osdmap e63: 12 total, 12 up, 12 in 2026-02-13T03:33:58.110 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:57 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:58.110 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:57 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1483306989' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T03:33:58.110 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:57 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1968803318' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:33:58.121 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f305c9816c0 1 -- 10.20.193.96:0/537101187 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f305410f230 msgr2=0x7f305410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:58.121 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f305c9816c0 1 --2- 10.20.193.96:0/537101187 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f305410f230 0x7f305410f600 secure :-1 s=READY pgs=191 gs=1 cs=0 l=1 c_cookie=13701483973777675086 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f304c0099a0 tx=0x7f304c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:33:58.121 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f305c9816c0 1 -- 10.20.193.96:0/537101187 shutdown_connections 2026-02-13T03:33:58.121 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f305c9816c0 1 --2- 10.20.193.96:0/537101187 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3054115440 0x7f3054175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:58.121 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f305c9816c0 1 --2- 10.20.193.96:0/537101187 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f305410fc20 0x7f3054114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:58.121 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f305c9816c0 1 --2- 10.20.193.96:0/537101187 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f305410f230 0x7f305410f600 unknown :-1 s=CLOSED pgs=191 gs=1 cs=0 l=1 c_cookie=13701483973777675086 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:58.121 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f305c9816c0 1 -- 10.20.193.96:0/537101187 >> 10.20.193.96:0/537101187 conn(0x7f30540ecb30 msgr2=0x7f305410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:58.121 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f305c9816c0 1 -- 10.20.193.96:0/537101187 shutdown_connections 2026-02-13T03:33:58.121 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f305c9816c0 1 -- 10.20.193.96:0/537101187 wait complete. 2026-02-13T03:33:58.122 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f305c9816c0 1 Processor -- start 2026-02-13T03:33:58.122 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f305c9816c0 1 -- start start 2026-02-13T03:33:58.122 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f305c9816c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f305410f230 0x7f305411d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:58.122 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f305c9816c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3054115440 0x7f305411d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:58.122 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f305c9816c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3054122b50 0x7f3054122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:58.122 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f305c9816c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3054123560 con 0x7f3054115440 2026-02-13T03:33:58.122 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f305c9816c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f30541236d0 con 0x7f305410f230 2026-02-13T03:33:58.122 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f305c9816c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3054123890 con 0x7f3054122b50 2026-02-13T03:33:58.122 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f3059ef16c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3054115440 0x7f305411d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:58.122 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f3059ef16c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3054115440 0x7f305411d790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:54382/0 (socket says 10.20.193.96:54382) 2026-02-13T03:33:58.122 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f3059ef16c0 1 -- 10.20.193.96:0/2025633595 learned_addr learned my addr 10.20.193.96:0/2025633595 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:33:58.122 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f305a6f26c0 1 --2- 10.20.193.96:0/2025633595 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f305410f230 0x7f305411d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:58.123 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f305aef36c0 1 --2- 10.20.193.96:0/2025633595 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3054122b50 0x7f3054122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:58.123 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f3059ef16c0 1 -- 10.20.193.96:0/2025633595 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3054122b50 msgr2=0x7f3054122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:58.123 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f3059ef16c0 1 --2- 10.20.193.96:0/2025633595 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3054122b50 0x7f3054122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:58.123 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f3059ef16c0 1 -- 10.20.193.96:0/2025633595 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f305410f230 msgr2=0x7f305411d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:58.123 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f3059ef16c0 1 --2- 10.20.193.96:0/2025633595 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f305410f230 0x7f305411d250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:58.123 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f3059ef16c0 1 -- 10.20.193.96:0/2025633595 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f304c009590 con 0x7f3054115440 2026-02-13T03:33:58.123 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.117+0000 7f305aef36c0 1 --2- 10.20.193.96:0/2025633595 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3054122b50 0x7f3054122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:33:58.123 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.118+0000 7f3059ef16c0 1 --2- 10.20.193.96:0/2025633595 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3054115440 0x7f305411d790 secure :-1 s=READY pgs=192 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f304000b6c0 tx=0x7f304000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:58.123 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.118+0000 7f303f7fe6c0 1 -- 10.20.193.96:0/2025633595 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3040004250 con 0x7f3054115440 2026-02-13T03:33:58.123 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.118+0000 7f303f7fe6c0 1 -- 10.20.193.96:0/2025633595 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f3040009070 con 0x7f3054115440 2026-02-13T03:33:58.123 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.118+0000 7f305c9816c0 1 -- 10.20.193.96:0/2025633595 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3054163d40 con 0x7f3054115440 2026-02-13T03:33:58.123 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.118+0000 7f303f7fe6c0 1 -- 10.20.193.96:0/2025633595 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f304000ccd0 con 0x7f3054115440 2026-02-13T03:33:58.123 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.118+0000 7f305c9816c0 1 -- 10.20.193.96:0/2025633595 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30541641d0 con 0x7f3054115440 2026-02-13T03:33:58.124 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.118+0000 7f305c9816c0 1 -- 10.20.193.96:0/2025633595 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3054110500 con 0x7f3054115440 2026-02-13T03:33:58.125 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.119+0000 7f303f7fe6c0 1 -- 10.20.193.96:0/2025633595 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f30400028c0 con 0x7f3054115440 2026-02-13T03:33:58.125 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.120+0000 7f303f7fe6c0 1 --2- 10.20.193.96:0/2025633595 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f30300b5680 0x7f30300d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:58.125 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.120+0000 7f305a6f26c0 1 --2- 10.20.193.96:0/2025633595 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f30300b5680 0x7f30300d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:58.125 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.120+0000 7f303f7fe6c0 1 -- 10.20.193.96:0/2025633595 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6904+0+0 (secure 0 0 0) 0x7f30400e3650 con 0x7f3054115440 2026-02-13T03:33:58.125 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.120+0000 7f303f7fe6c0 1 -- 10.20.193.96:0/2025633595 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f30400a9f90 con 0x7f3054115440 2026-02-13T03:33:58.125 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.120+0000 7f305a6f26c0 1 --2- 10.20.193.96:0/2025633595 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f30300b5680 0x7f30300d5b30 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f304c0023e0 tx=0x7f304c009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:58.212 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.209+0000 7f305c9816c0 1 -- 10.20.193.96:0/2025633595 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f305411e3d0 con 0x7f3054115440 2026-02-13T03:33:58.212 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.210+0000 7f303f7fe6c0 1 -- 10.20.193.96:0/2025633595 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) ==== 93+0+10 (secure 0 0 0) 0x7f30400a96e0 con 0x7f3054115440 2026-02-13T03:33:58.212 INFO:teuthology.orchestra.run.trial096.stdout:pg_num: 1 2026-02-13T03:33:58.213 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.211+0000 7f305c9816c0 1 -- 10.20.193.96:0/2025633595 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f30300b5680 msgr2=0x7f30300d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:58.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.211+0000 7f305c9816c0 1 --2- 10.20.193.96:0/2025633595 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f30300b5680 0x7f30300d5b30 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f304c0023e0 tx=0x7f304c009260 comp rx=0 tx=0).stop 2026-02-13T03:33:58.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.211+0000 7f305c9816c0 1 -- 10.20.193.96:0/2025633595 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3054115440 msgr2=0x7f305411d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:58.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.211+0000 7f305c9816c0 1 --2- 10.20.193.96:0/2025633595 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3054115440 0x7f305411d790 secure :-1 s=READY pgs=192 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f304000b6c0 tx=0x7f304000bb90 comp rx=0 tx=0).stop 2026-02-13T03:33:58.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.211+0000 7f305c9816c0 1 -- 10.20.193.96:0/2025633595 shutdown_connections 2026-02-13T03:33:58.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.211+0000 7f305c9816c0 1 --2- 10.20.193.96:0/2025633595 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f30300b5680 0x7f30300d5b30 unknown :-1 s=CLOSED pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:58.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.211+0000 7f305c9816c0 1 --2- 10.20.193.96:0/2025633595 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3054122b50 0x7f3054122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:58.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.211+0000 7f305c9816c0 1 --2- 10.20.193.96:0/2025633595 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3054115440 0x7f305411d790 unknown :-1 s=CLOSED pgs=192 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:58.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.211+0000 7f305c9816c0 1 --2- 10.20.193.96:0/2025633595 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f305410f230 0x7f305411d250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:58.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.211+0000 7f305c9816c0 1 -- 10.20.193.96:0/2025633595 >> 10.20.193.96:0/2025633595 conn(0x7f30540ecb30 msgr2=0x7f305410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:58.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.211+0000 7f305c9816c0 1 -- 10.20.193.96:0/2025633595 shutdown_connections 2026-02-13T03:33:58.215 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:58.211+0000 7f305c9816c0 1 -- 10.20.193.96:0/2025633595 wait complete. 2026-02-13T03:33:58.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:57 trial132 ceph-mon[26888]: purged_snaps scrub starts 2026-02-13T03:33:58.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:57 trial132 ceph-mon[26888]: purged_snaps scrub ok 2026-02-13T03:33:58.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:57 trial132 ceph-mon[26888]: pgmap v164: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:33:58.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:57 trial132 ceph-mon[26888]: osd.11 [v2:10.20.193.133:6824/4255173938,v1:10.20.193.133:6825/4255173938] boot 2026-02-13T03:33:58.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:57 trial132 ceph-mon[26888]: osdmap e63: 12 total, 12 up, 12 in 2026-02-13T03:33:58.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:57 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:58.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:57 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1483306989' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T03:33:58.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:57 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1968803318' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:33:58.253 INFO:tasks.cephadm:Adding mds.a on trial096 2026-02-13T03:33:58.253 INFO:tasks.cephadm:Adding mds.d on trial096 2026-02-13T03:33:58.253 INFO:tasks.cephadm:Adding mds.g on trial096 2026-02-13T03:33:58.253 INFO:tasks.cephadm:Adding mds.j on trial096 2026-02-13T03:33:58.253 INFO:tasks.cephadm:Adding mds.b on trial132 2026-02-13T03:33:58.253 INFO:tasks.cephadm:Adding mds.e on trial132 2026-02-13T03:33:58.253 INFO:tasks.cephadm:Adding mds.h on trial132 2026-02-13T03:33:58.253 INFO:tasks.cephadm:Adding mds.k on trial132 2026-02-13T03:33:58.254 INFO:tasks.cephadm:Adding mds.c on trial133 2026-02-13T03:33:58.254 INFO:tasks.cephadm:Adding mds.f on trial133 2026-02-13T03:33:58.254 INFO:tasks.cephadm:Adding mds.i on trial133 2026-02-13T03:33:58.254 INFO:tasks.cephadm:Adding mds.l on trial133 2026-02-13T03:33:58.254 DEBUG:teuthology.orchestra.run.trial133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph orch apply mds all '12;trial096=a;trial096=d;trial096=g;trial096=j;trial132=b;trial132=e;trial132=h;trial132=k;trial133=c;trial133=f;trial133=i;trial133=l' 2026-02-13T03:33:58.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:57 trial133 ceph-mon[26943]: purged_snaps scrub starts 2026-02-13T03:33:58.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:57 trial133 ceph-mon[26943]: purged_snaps scrub ok 2026-02-13T03:33:58.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:57 trial133 ceph-mon[26943]: pgmap v164: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:33:58.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:57 trial133 ceph-mon[26943]: osd.11 [v2:10.20.193.133:6824/4255173938,v1:10.20.193.133:6825/4255173938] boot 2026-02-13T03:33:58.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:57 trial133 ceph-mon[26943]: osdmap e63: 12 total, 12 up, 12 in 2026-02-13T03:33:58.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:57 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:33:58.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:57 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1483306989' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T03:33:58.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:57 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1968803318' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:33:58.376 INFO:teuthology.orchestra.run.trial133.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.c/config 2026-02-13T03:33:58.493 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a6693c6c0 1 -- 10.20.193.133:0/1232912974 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0a6010eed0 msgr2=0x7f0a6010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:58.493 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a6693c6c0 1 --2- 10.20.193.133:0/1232912974 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0a6010eed0 0x7f0a6010f2c0 secure :-1 s=READY pgs=44 gs=1 cs=0 l=1 c_cookie=6117640242702573298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a4c009970 tx=0x7f0a4c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:33:58.493 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a6693c6c0 1 -- 10.20.193.133:0/1232912974 shutdown_connections 2026-02-13T03:33:58.493 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a6693c6c0 1 --2- 10.20.193.133:0/1232912974 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0a60110a00 0x7f0a60171390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:58.493 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a6693c6c0 1 --2- 10.20.193.133:0/1232912974 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0a60110050 0x7f0a601104c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:58.493 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a6693c6c0 1 --2- 10.20.193.133:0/1232912974 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0a6010eed0 0x7f0a6010f2c0 unknown :-1 s=CLOSED pgs=44 gs=1 cs=0 l=1 c_cookie=6117640242702573298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:58.493 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a6693c6c0 1 -- 10.20.193.133:0/1232912974 >> 10.20.193.133:0/1232912974 conn(0x7f0a600ec5f0 msgr2=0x7f0a6010ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:58.493 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a6693c6c0 1 -- 10.20.193.133:0/1232912974 shutdown_connections 2026-02-13T03:33:58.494 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a6693c6c0 1 -- 10.20.193.133:0/1232912974 wait complete. 2026-02-13T03:33:58.494 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a6693c6c0 1 Processor -- start 2026-02-13T03:33:58.494 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a6693c6c0 1 -- start start 2026-02-13T03:33:58.494 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a6693c6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0a6010eed0 0x7f0a600f8520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:58.494 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a6693c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0a60110050 0x7f0a60171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:58.494 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a6693c6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0a60110a00 0x7f0a600f8d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:58.494 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a6693c6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0a600f99b0 con 0x7f0a60110050 2026-02-13T03:33:58.494 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a6693c6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0a600f9b20 con 0x7f0a6010eed0 2026-02-13T03:33:58.494 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a6693c6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0a600f9ce0 con 0x7f0a60110a00 2026-02-13T03:33:58.494 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a64eb26c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0a60110a00 0x7f0a600f8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:58.494 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a64eb26c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0a60110a00 0x7f0a600f8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.133:3300/0 says I am v2:10.20.193.133:60390/0 (socket says 10.20.193.133:60390) 2026-02-13T03:33:58.494 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a64eb26c0 1 -- 10.20.193.133:0/2961878415 learned_addr learned my addr 10.20.193.133:0/2961878415 (peer_addr_for_me v2:10.20.193.133:0/0) 2026-02-13T03:33:58.495 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a5ffff6c0 1 --2- 10.20.193.133:0/2961878415 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0a6010eed0 0x7f0a600f8520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:58.495 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a5f7fe6c0 1 --2- 10.20.193.133:0/2961878415 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0a60110050 0x7f0a60171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:58.495 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a64eb26c0 1 -- 10.20.193.133:0/2961878415 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0a6010eed0 msgr2=0x7f0a600f8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:58.495 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a64eb26c0 1 --2- 10.20.193.133:0/2961878415 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0a6010eed0 0x7f0a600f8520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:58.495 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a64eb26c0 1 -- 10.20.193.133:0/2961878415 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0a60110050 msgr2=0x7f0a60171390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:58.495 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a64eb26c0 1 --2- 10.20.193.133:0/2961878415 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0a60110050 0x7f0a60171390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:58.495 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.488+0000 7f0a64eb26c0 1 -- 10.20.193.133:0/2961878415 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a4c009590 con 0x7f0a60110a00 2026-02-13T03:33:58.495 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.489+0000 7f0a64eb26c0 1 --2- 10.20.193.133:0/2961878415 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0a60110a00 0x7f0a600f8d80 secure :-1 s=READY pgs=45 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a54006ea0 tx=0x7f0a5400ce50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:58.495 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.489+0000 7f0a5d7fa6c0 1 -- 10.20.193.133:0/2961878415 <== mon.1 v2:10.20.193.133:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0a54003c40 con 0x7f0a60110a00 2026-02-13T03:33:58.495 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.489+0000 7f0a5d7fa6c0 1 -- 10.20.193.133:0/2961878415 <== mon.1 v2:10.20.193.133:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f0a54003da0 con 0x7f0a60110a00 2026-02-13T03:33:58.495 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.489+0000 7f0a5d7fa6c0 1 -- 10.20.193.133:0/2961878415 <== mon.1 v2:10.20.193.133:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0a540081c0 con 0x7f0a60110a00 2026-02-13T03:33:58.495 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.489+0000 7f0a6693c6c0 1 -- 10.20.193.133:0/2961878415 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a600f9fc0 con 0x7f0a60110a00 2026-02-13T03:33:58.496 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.489+0000 7f0a6693c6c0 1 -- 10.20.193.133:0/2961878415 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a600fa450 con 0x7f0a60110a00 2026-02-13T03:33:58.496 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.489+0000 7f0a6693c6c0 1 -- 10.20.193.133:0/2961878415 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a60175450 con 0x7f0a60110a00 2026-02-13T03:33:58.497 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.490+0000 7f0a5d7fa6c0 1 -- 10.20.193.133:0/2961878415 <== mon.1 v2:10.20.193.133:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f0a54005860 con 0x7f0a60110a00 2026-02-13T03:33:58.497 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.491+0000 7f0a5d7fa6c0 1 --2- 10.20.193.133:0/2961878415 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f0a340b5600 0x7f0a340d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:58.497 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.491+0000 7f0a5d7fa6c0 1 -- 10.20.193.133:0/2961878415 <== mon.1 v2:10.20.193.133:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6904+0+0 (secure 0 0 0) 0x7f0a540e4720 con 0x7f0a60110a00 2026-02-13T03:33:58.497 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.491+0000 7f0a5ffff6c0 1 --2- 10.20.193.133:0/2961878415 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f0a340b5600 0x7f0a340d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:58.497 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.491+0000 7f0a5ffff6c0 1 --2- 10.20.193.133:0/2961878415 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f0a340b5600 0x7f0a340d5ab0 secure :-1 s=READY pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a4c0023e0 tx=0x7f0a4c005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:58.497 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.491+0000 7f0a5d7fa6c0 1 -- 10.20.193.133:0/2961878415 <== mon.1 v2:10.20.193.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0a540a7600 con 0x7f0a60110a00 2026-02-13T03:33:58.590 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.587+0000 7f0a6693c6c0 1 -- 10.20.193.133:0/2961878415 --> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial096=a;trial096=d;trial096=g;trial096=j;trial132=b;trial132=e;trial132=h;trial132=k;trial133=c;trial133=f;trial133=i;trial133=l", "target": ["mon-mgr", ""]}) -- 0x7f0a6004ca20 con 0x7f0a340b5600 2026-02-13T03:33:58.597 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.594+0000 7f0a5d7fa6c0 1 -- 10.20.193.133:0/2961878415 <== mgr.14116 v2:10.20.193.96:6800/1736050816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f0a6004ca20 con 0x7f0a340b5600 2026-02-13T03:33:58.597 INFO:teuthology.orchestra.run.trial133.stdout:Scheduled mds.all update... 2026-02-13T03:33:58.598 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.595+0000 7f0a6693c6c0 1 -- 10.20.193.133:0/2961878415 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f0a340b5600 msgr2=0x7f0a340d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:58.598 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.595+0000 7f0a6693c6c0 1 --2- 10.20.193.133:0/2961878415 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f0a340b5600 0x7f0a340d5ab0 secure :-1 s=READY pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a4c0023e0 tx=0x7f0a4c005c00 comp rx=0 tx=0).stop 2026-02-13T03:33:58.598 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.595+0000 7f0a6693c6c0 1 -- 10.20.193.133:0/2961878415 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0a60110a00 msgr2=0x7f0a600f8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:58.599 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.595+0000 7f0a6693c6c0 1 --2- 10.20.193.133:0/2961878415 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0a60110a00 0x7f0a600f8d80 secure :-1 s=READY pgs=45 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a54006ea0 tx=0x7f0a5400ce50 comp rx=0 tx=0).stop 2026-02-13T03:33:58.599 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.595+0000 7f0a6693c6c0 1 -- 10.20.193.133:0/2961878415 shutdown_connections 2026-02-13T03:33:58.599 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.595+0000 7f0a6693c6c0 1 --2- 10.20.193.133:0/2961878415 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f0a340b5600 0x7f0a340d5ab0 unknown :-1 s=CLOSED pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:58.599 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.595+0000 7f0a6693c6c0 1 --2- 10.20.193.133:0/2961878415 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0a60110a00 0x7f0a600f8d80 unknown :-1 s=CLOSED pgs=45 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:58.599 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.595+0000 7f0a6693c6c0 1 --2- 10.20.193.133:0/2961878415 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0a60110050 0x7f0a60171390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:58.599 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.595+0000 7f0a6693c6c0 1 --2- 10.20.193.133:0/2961878415 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0a6010eed0 0x7f0a600f8520 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:58.599 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.595+0000 7f0a6693c6c0 1 -- 10.20.193.133:0/2961878415 >> 10.20.193.133:0/2961878415 conn(0x7f0a600ec5f0 msgr2=0x7f0a600eeb30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:58.599 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.595+0000 7f0a6693c6c0 1 -- 10.20.193.133:0/2961878415 shutdown_connections 2026-02-13T03:33:58.599 INFO:teuthology.orchestra.run.trial133.stderr:2026-02-13T03:33:58.595+0000 7f0a6693c6c0 1 -- 10.20.193.133:0/2961878415 wait complete. 2026-02-13T03:33:58.667 DEBUG:teuthology.orchestra.run.trial096:mds.a> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.a.service 2026-02-13T03:33:58.670 DEBUG:teuthology.orchestra.run.trial096:mds.d> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.d.service 2026-02-13T03:33:58.713 DEBUG:teuthology.orchestra.run.trial096:mds.g> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.g.service 2026-02-13T03:33:58.756 DEBUG:teuthology.orchestra.run.trial096:mds.j> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.j.service 2026-02-13T03:33:58.799 DEBUG:teuthology.orchestra.run.trial132:mds.b> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.b.service 2026-02-13T03:33:58.801 DEBUG:teuthology.orchestra.run.trial132:mds.e> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.e.service 2026-02-13T03:33:58.844 DEBUG:teuthology.orchestra.run.trial132:mds.h> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.h.service 2026-02-13T03:33:58.887 DEBUG:teuthology.orchestra.run.trial132:mds.k> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.k.service 2026-02-13T03:33:58.930 DEBUG:teuthology.orchestra.run.trial133:mds.c> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.c.service 2026-02-13T03:33:58.933 DEBUG:teuthology.orchestra.run.trial133:mds.f> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.f.service 2026-02-13T03:33:58.977 DEBUG:teuthology.orchestra.run.trial133:mds.i> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.i.service 2026-02-13T03:33:59.020 DEBUG:teuthology.orchestra.run.trial133:mds.l> sudo journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.l.service 2026-02-13T03:33:59.063 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2026-02-13T03:33:59.063 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T03:33:59.164 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:58 trial133 ceph-mon[26943]: osdmap e64: 12 total, 12 up, 12 in 2026-02-13T03:33:59.165 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:58 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2025633595' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T03:33:59.165 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:58 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:59.165 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:58 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:59.165 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:58 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:59.165 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:58 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:59.165 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:58 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:59.165 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:58 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:59.165 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:58 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:59.165 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:58 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:59.181 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:33:59.230 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:58 trial096 ceph-mon[24671]: osdmap e64: 12 total, 12 up, 12 in 2026-02-13T03:33:59.230 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:58 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2025633595' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T03:33:59.230 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:58 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:59.230 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:58 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:59.230 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:58 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:59.230 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:58 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:59.230 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:58 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:59.230 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:58 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:59.230 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:58 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:59.230 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:58 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:59.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:58 trial132 ceph-mon[26888]: osdmap e64: 12 total, 12 up, 12 in 2026-02-13T03:33:59.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:58 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2025633595' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T03:33:59.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:58 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:59.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:58 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:33:59.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:58 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:59.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:58 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:33:59.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:58 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:33:59.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:58 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:33:59.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:58 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:33:59.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:58 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:33:59.295 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.290+0000 7fc99ea086c0 1 -- 10.20.193.96:0/1932905976 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc99810d9a0 msgr2=0x7fc9981129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:59.295 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.290+0000 7fc99ea086c0 1 --2- 10.20.193.96:0/1932905976 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc99810d9a0 0x7fc9981129e0 secure :-1 s=READY pgs=193 gs=1 cs=0 l=1 c_cookie=5869871727229885221 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9880099a0 tx=0x7fc98802ed20 comp rx=0 tx=0).stop 2026-02-13T03:33:59.295 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.290+0000 7fc99ea086c0 1 -- 10.20.193.96:0/1932905976 shutdown_connections 2026-02-13T03:33:59.295 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.290+0000 7fc99ea086c0 1 --2- 10.20.193.96:0/1932905976 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc9981131c0 0x7fc998173b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:59.295 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.290+0000 7fc99ea086c0 1 --2- 10.20.193.96:0/1932905976 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc99810d9a0 0x7fc9981129e0 unknown :-1 s=CLOSED pgs=193 gs=1 cs=0 l=1 c_cookie=5869871727229885221 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:59.295 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.290+0000 7fc99ea086c0 1 --2- 10.20.193.96:0/1932905976 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fc99810cfb0 0x7fc99810d380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:59.295 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.290+0000 7fc99ea086c0 1 -- 10.20.193.96:0/1932905976 >> 10.20.193.96:0/1932905976 conn(0x7fc9980ea8b0 msgr2=0x7fc99810acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:59.295 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.290+0000 7fc99ea086c0 1 -- 10.20.193.96:0/1932905976 shutdown_connections 2026-02-13T03:33:59.295 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.290+0000 7fc99ea086c0 1 -- 10.20.193.96:0/1932905976 wait complete. 2026-02-13T03:33:59.296 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc99ea086c0 1 Processor -- start 2026-02-13T03:33:59.296 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc99ea086c0 1 -- start start 2026-02-13T03:33:59.296 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc99ea086c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc99810cfb0 0x7fc9980f4bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:59.296 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc99ea086c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc9981131c0 0x7fc998173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:59.296 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc99ea086c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fc9980f51f0 0x7fc9980fa4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:59.296 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc99ea086c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc9980f58e0 con 0x7fc9981131c0 2026-02-13T03:33:59.296 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc99ea086c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc9980faa00 con 0x7fc99810cfb0 2026-02-13T03:33:59.296 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc99ea086c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc9980fabc0 con 0x7fc9980f51f0 2026-02-13T03:33:59.296 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc9977fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc9981131c0 0x7fc998173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:59.296 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc9977fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc9981131c0 0x7fc998173a60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:54398/0 (socket says 10.20.193.96:54398) 2026-02-13T03:33:59.296 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc9977fe6c0 1 -- 10.20.193.96:0/3176016452 learned_addr learned my addr 10.20.193.96:0/3176016452 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:33:59.296 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc997fff6c0 1 --2- 10.20.193.96:0/3176016452 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc99810cfb0 0x7fc9980f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:59.297 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc99cf7e6c0 1 --2- 10.20.193.96:0/3176016452 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fc9980f51f0 0x7fc9980fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:59.297 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc9977fe6c0 1 -- 10.20.193.96:0/3176016452 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fc9980f51f0 msgr2=0x7fc9980fa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:59.297 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc9977fe6c0 1 --2- 10.20.193.96:0/3176016452 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fc9980f51f0 0x7fc9980fa4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:59.297 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc9977fe6c0 1 -- 10.20.193.96:0/3176016452 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc99810cfb0 msgr2=0x7fc9980f4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:59.297 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc9977fe6c0 1 --2- 10.20.193.96:0/3176016452 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc99810cfb0 0x7fc9980f4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:59.297 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc9977fe6c0 1 -- 10.20.193.96:0/3176016452 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc988009590 con 0x7fc9981131c0 2026-02-13T03:33:59.297 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc997fff6c0 1 --2- 10.20.193.96:0/3176016452 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc99810cfb0 0x7fc9980f4bc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:33:59.297 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc9977fe6c0 1 --2- 10.20.193.96:0/3176016452 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc9981131c0 0x7fc998173a60 secure :-1 s=READY pgs=194 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc98802f230 tx=0x7fc98802fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:59.297 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc9957fa6c0 1 -- 10.20.193.96:0/3176016452 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc988002ae0 con 0x7fc9981131c0 2026-02-13T03:33:59.297 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc9957fa6c0 1 -- 10.20.193.96:0/3176016452 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fc988002c40 con 0x7fc9981131c0 2026-02-13T03:33:59.297 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc99ea086c0 1 -- 10.20.193.96:0/3176016452 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9980fae40 con 0x7fc9981131c0 2026-02-13T03:33:59.297 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc9957fa6c0 1 -- 10.20.193.96:0/3176016452 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc9880312b0 con 0x7fc9981131c0 2026-02-13T03:33:59.298 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.291+0000 7fc99ea086c0 1 -- 10.20.193.96:0/3176016452 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9980fb310 con 0x7fc9981131c0 2026-02-13T03:33:59.298 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.292+0000 7fc99ea086c0 1 -- 10.20.193.96:0/3176016452 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc99810e280 con 0x7fc9981131c0 2026-02-13T03:33:59.299 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.293+0000 7fc9957fa6c0 1 -- 10.20.193.96:0/3176016452 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7fc988007980 con 0x7fc9981131c0 2026-02-13T03:33:59.299 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.294+0000 7fc9957fa6c0 1 --2- 10.20.193.96:0/3176016452 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fc96c0b5680 0x7fc96c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:33:59.299 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.294+0000 7fc997fff6c0 1 --2- 10.20.193.96:0/3176016452 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fc96c0b5680 0x7fc96c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:33:59.299 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.294+0000 7fc9957fa6c0 1 -- 10.20.193.96:0/3176016452 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6904+0+0 (secure 0 0 0) 0x7fc988107720 con 0x7fc9981131c0 2026-02-13T03:33:59.299 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.294+0000 7fc9957fa6c0 1 -- 10.20.193.96:0/3176016452 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc9880ca600 con 0x7fc9981131c0 2026-02-13T03:33:59.299 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.294+0000 7fc997fff6c0 1 --2- 10.20.193.96:0/3176016452 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fc96c0b5680 0x7fc96c0d5b30 secure :-1 s=READY pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc984004750 tx=0x7fc984009630 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:33:59.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.408+0000 7fc99ea086c0 1 -- 10.20.193.96:0/3176016452 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc99810d380 con 0x7fc9981131c0 2026-02-13T03:33:59.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.408+0000 7fc9957fa6c0 1 -- 10.20.193.96:0/3176016452 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fc988002db0 con 0x7fc9981131c0 2026-02-13T03:33:59.410 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:33:59.411 INFO:teuthology.orchestra.run.trial096.stdout:{"epoch":1,"btime":"2026-02-13T03:31:45:641938+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2026-02-13T03:33:59.412 INFO:teuthology.orchestra.run.trial096.stderr:dumped fsmap epoch 1 2026-02-13T03:33:59.412 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.409+0000 7fc99ea086c0 1 -- 10.20.193.96:0/3176016452 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fc96c0b5680 msgr2=0x7fc96c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:59.412 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.409+0000 7fc99ea086c0 1 --2- 10.20.193.96:0/3176016452 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fc96c0b5680 0x7fc96c0d5b30 secure :-1 s=READY pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc984004750 tx=0x7fc984009630 comp rx=0 tx=0).stop 2026-02-13T03:33:59.412 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.409+0000 7fc99ea086c0 1 -- 10.20.193.96:0/3176016452 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc9981131c0 msgr2=0x7fc998173a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:33:59.412 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.409+0000 7fc99ea086c0 1 --2- 10.20.193.96:0/3176016452 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc9981131c0 0x7fc998173a60 secure :-1 s=READY pgs=194 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc98802f230 tx=0x7fc98802fc60 comp rx=0 tx=0).stop 2026-02-13T03:33:59.412 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.409+0000 7fc99ea086c0 1 -- 10.20.193.96:0/3176016452 shutdown_connections 2026-02-13T03:33:59.412 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.409+0000 7fc99ea086c0 1 --2- 10.20.193.96:0/3176016452 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fc96c0b5680 0x7fc96c0d5b30 unknown :-1 s=CLOSED pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:59.412 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.409+0000 7fc99ea086c0 1 --2- 10.20.193.96:0/3176016452 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fc9980f51f0 0x7fc9980fa4c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:59.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.409+0000 7fc99ea086c0 1 --2- 10.20.193.96:0/3176016452 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc9981131c0 0x7fc998173a60 unknown :-1 s=CLOSED pgs=194 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:59.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.409+0000 7fc99ea086c0 1 --2- 10.20.193.96:0/3176016452 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc99810cfb0 0x7fc9980f4bc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:33:59.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.409+0000 7fc99ea086c0 1 -- 10.20.193.96:0/3176016452 >> 10.20.193.96:0/3176016452 conn(0x7fc9980ea8b0 msgr2=0x7fc99810f800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:33:59.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.409+0000 7fc99ea086c0 1 -- 10.20.193.96:0/3176016452 shutdown_connections 2026-02-13T03:33:59.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:33:59.409+0000 7fc99ea086c0 1 -- 10.20.193.96:0/3176016452 wait complete. 2026-02-13T03:34:00.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:59 trial132 ceph-mon[26888]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:00.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:59 trial132 ceph-mon[26888]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial096=a;trial096=d;trial096=g;trial096=j;trial132=b;trial132=e;trial132=h;trial132=k;trial133=c;trial133=f;trial133=i;trial133=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:34:00.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:59 trial132 ceph-mon[26888]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:00.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:59 trial132 ceph-mon[26888]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:34:00.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:59 trial132 ceph-mon[26888]: Cluster is now healthy 2026-02-13T03:34:00.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:59 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:00.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:59 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:00.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:59 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:00.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:33:59 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3176016452' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:34:00.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:59 trial133 ceph-mon[26943]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:00.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:59 trial133 ceph-mon[26943]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial096=a;trial096=d;trial096=g;trial096=j;trial132=b;trial132=e;trial132=h;trial132=k;trial133=c;trial133=f;trial133=i;trial133=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:34:00.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:59 trial133 ceph-mon[26943]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:00.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:59 trial133 ceph-mon[26943]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:34:00.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:59 trial133 ceph-mon[26943]: Cluster is now healthy 2026-02-13T03:34:00.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:59 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:00.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:59 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:00.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:59 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:00.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:33:59 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3176016452' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:34:00.264 INFO:journalctl@ceph.mds.l.trial133.stdout:Feb 13 03:34:00 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-l[55035]: starting mds.l at 2026-02-13T03:34:00.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:59 trial096 ceph-mon[24671]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:00.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:59 trial096 ceph-mon[24671]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial096=a;trial096=d;trial096=g;trial096=j;trial132=b;trial132=e;trial132=h;trial132=k;trial133=c;trial133=f;trial133=i;trial133=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:34:00.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:59 trial096 ceph-mon[24671]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:00.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:59 trial096 ceph-mon[24671]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:34:00.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:59 trial096 ceph-mon[24671]: Cluster is now healthy 2026-02-13T03:34:00.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:59 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:00.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:59 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:00.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:59 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:00.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:33:59 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3176016452' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:34:00.978 INFO:journalctl@ceph.mds.k.trial132.stdout:Feb 13 03:34:00 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-k[54477]: starting mds.k at 2026-02-13T03:34:01.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:00 trial132 ceph-mon[26888]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:01.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:00 trial132 ceph-mon[26888]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:34:01.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:00 trial132 ceph-mon[26888]: mds.? [v2:10.20.193.133:6832/1760340814,v1:10.20.193.133:6833/1760340814] up:boot 2026-02-13T03:34:01.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:00 trial132 ceph-mon[26888]: fsmap 1 up:standby 2026-02-13T03:34:01.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:00 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-13T03:34:01.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:00 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:01.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:00 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:01.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:00 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:01.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:00 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:01.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:00 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:01.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:00 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:01.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:00 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:01.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:00 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:01.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:00 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:01.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:00 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:01.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:00 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:01.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:00 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:01.244 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:00 trial096 ceph-mon[24671]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:01.244 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:00 trial096 ceph-mon[24671]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:34:01.244 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:00 trial096 ceph-mon[24671]: mds.? [v2:10.20.193.133:6832/1760340814,v1:10.20.193.133:6833/1760340814] up:boot 2026-02-13T03:34:01.244 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:00 trial096 ceph-mon[24671]: fsmap 1 up:standby 2026-02-13T03:34:01.244 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:00 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-13T03:34:01.244 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:00 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:01.245 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:00 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:01.245 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:00 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:01.245 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:00 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:01.245 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:00 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:01.245 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:00 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:01.245 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:00 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:01.245 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:00 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:01.245 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:00 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:01.245 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:00 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:01.245 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:00 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:01.245 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:00 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:01.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:00 trial133 ceph-mon[26943]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:01.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:00 trial133 ceph-mon[26943]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:34:01.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:00 trial133 ceph-mon[26943]: mds.? [v2:10.20.193.133:6832/1760340814,v1:10.20.193.133:6833/1760340814] up:boot 2026-02-13T03:34:01.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:00 trial133 ceph-mon[26943]: fsmap 1 up:standby 2026-02-13T03:34:01.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:00 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-13T03:34:01.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:00 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:01.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:00 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:01.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:00 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:01.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:00 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:01.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:00 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:01.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:00 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:01.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:00 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:01.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:00 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:01.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:00 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:01.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:00 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:01.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:00 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:01.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:00 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:01.452 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T03:34:01.638 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:01.750 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.746+0000 7f9b42efd6c0 1 -- 10.20.193.96:0/2299441843 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9b3c10f230 msgr2=0x7f9b3c10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:01.750 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.746+0000 7f9b42efd6c0 1 --2- 10.20.193.96:0/2299441843 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9b3c10f230 0x7f9b3c10f600 secure :-1 s=READY pgs=197 gs=1 cs=0 l=1 c_cookie=12200722177963182213 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b2c0099a0 tx=0x7f9b2c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:01.750 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.746+0000 7f9b42efd6c0 1 -- 10.20.193.96:0/2299441843 shutdown_connections 2026-02-13T03:34:01.750 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.746+0000 7f9b42efd6c0 1 --2- 10.20.193.96:0/2299441843 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9b3c115440 0x7f9b3c175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:01.751 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.746+0000 7f9b42efd6c0 1 --2- 10.20.193.96:0/2299441843 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9b3c10fc20 0x7f9b3c114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:01.751 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.746+0000 7f9b42efd6c0 1 --2- 10.20.193.96:0/2299441843 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9b3c10f230 0x7f9b3c10f600 unknown :-1 s=CLOSED pgs=197 gs=1 cs=0 l=1 c_cookie=12200722177963182213 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:01.751 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.746+0000 7f9b42efd6c0 1 -- 10.20.193.96:0/2299441843 >> 10.20.193.96:0/2299441843 conn(0x7f9b3c0ecb30 msgr2=0x7f9b3c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:01.751 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.746+0000 7f9b42efd6c0 1 -- 10.20.193.96:0/2299441843 shutdown_connections 2026-02-13T03:34:01.751 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.746+0000 7f9b42efd6c0 1 -- 10.20.193.96:0/2299441843 wait complete. 2026-02-13T03:34:01.751 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.746+0000 7f9b42efd6c0 1 Processor -- start 2026-02-13T03:34:01.751 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.746+0000 7f9b42efd6c0 1 -- start start 2026-02-13T03:34:01.751 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.746+0000 7f9b42efd6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9b3c10f230 0x7f9b3c11d1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:01.751 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.747+0000 7f9b42efd6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9b3c115440 0x7f9b3c11d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:01.751 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.747+0000 7f9b42efd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9b3c122af0 0x7f9b3c122f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:01.751 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.747+0000 7f9b42efd6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c123500 con 0x7f9b3c122af0 2026-02-13T03:34:01.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.747+0000 7f9b42efd6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c123670 con 0x7f9b3c10f230 2026-02-13T03:34:01.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.747+0000 7f9b42efd6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c123830 con 0x7f9b3c115440 2026-02-13T03:34:01.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.747+0000 7f9b4146f6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9b3c122af0 0x7f9b3c122f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:01.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.747+0000 7f9b33fff6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9b3c115440 0x7f9b3c11d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:01.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.747+0000 7f9b4146f6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9b3c122af0 0x7f9b3c122f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:54452/0 (socket says 10.20.193.96:54452) 2026-02-13T03:34:01.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.747+0000 7f9b4146f6c0 1 -- 10.20.193.96:0/295376424 learned_addr learned my addr 10.20.193.96:0/295376424 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:01.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.747+0000 7f9b40c6e6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9b3c10f230 0x7f9b3c11d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:01.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.747+0000 7f9b4146f6c0 1 -- 10.20.193.96:0/295376424 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9b3c115440 msgr2=0x7f9b3c11d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:01.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.747+0000 7f9b4146f6c0 1 --2- 10.20.193.96:0/295376424 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9b3c115440 0x7f9b3c11d730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:01.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.747+0000 7f9b4146f6c0 1 -- 10.20.193.96:0/295376424 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9b3c10f230 msgr2=0x7f9b3c11d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:01.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.747+0000 7f9b4146f6c0 1 --2- 10.20.193.96:0/295376424 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9b3c10f230 0x7f9b3c11d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:01.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.747+0000 7f9b4146f6c0 1 -- 10.20.193.96:0/295376424 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2c009590 con 0x7f9b3c122af0 2026-02-13T03:34:01.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.747+0000 7f9b4146f6c0 1 --2- 10.20.193.96:0/295376424 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9b3c122af0 0x7f9b3c122f90 secure :-1 s=READY pgs=198 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b38006ea0 tx=0x7f9b3800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:01.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.747+0000 7f9b31ffb6c0 1 -- 10.20.193.96:0/295376424 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b38003c40 con 0x7f9b3c122af0 2026-02-13T03:34:01.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.747+0000 7f9b42efd6c0 1 -- 10.20.193.96:0/295376424 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b3c163ce0 con 0x7f9b3c122af0 2026-02-13T03:34:01.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.747+0000 7f9b31ffb6c0 1 -- 10.20.193.96:0/295376424 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f9b38003da0 con 0x7f9b3c122af0 2026-02-13T03:34:01.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.747+0000 7f9b31ffb6c0 1 -- 10.20.193.96:0/295376424 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b380081c0 con 0x7f9b3c122af0 2026-02-13T03:34:01.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.747+0000 7f9b42efd6c0 1 -- 10.20.193.96:0/295376424 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b3c164170 con 0x7f9b3c122af0 2026-02-13T03:34:01.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.748+0000 7f9b42efd6c0 1 -- 10.20.193.96:0/295376424 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b3c110500 con 0x7f9b3c122af0 2026-02-13T03:34:01.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.749+0000 7f9b31ffb6c0 1 -- 10.20.193.96:0/295376424 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f9b38005860 con 0x7f9b3c122af0 2026-02-13T03:34:01.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.749+0000 7f9b31ffb6c0 1 --2- 10.20.193.96:0/295376424 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9b180b5600 0x7f9b180d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:01.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.749+0000 7f9b31ffb6c0 1 -- 10.20.193.96:0/295376424 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6904+0+0 (secure 0 0 0) 0x7f9b380e45c0 con 0x7f9b3c122af0 2026-02-13T03:34:01.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.749+0000 7f9b40c6e6c0 1 --2- 10.20.193.96:0/295376424 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9b180b5600 0x7f9b180d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:01.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.750+0000 7f9b40c6e6c0 1 --2- 10.20.193.96:0/295376424 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9b180b5600 0x7f9b180d5ab0 secure :-1 s=READY pgs=149 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b2c005b40 tx=0x7f9b2c0023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:01.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.750+0000 7f9b31ffb6c0 1 -- 10.20.193.96:0/295376424 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9b380a74e0 con 0x7f9b3c122af0 2026-02-13T03:34:01.867 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.865+0000 7f9b42efd6c0 1 -- 10.20.193.96:0/295376424 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b3c10f600 con 0x7f9b3c122af0 2026-02-13T03:34:01.867 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.865+0000 7f9b31ffb6c0 1 -- 10.20.193.96:0/295376424 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2266 (secure 0 0 0) 0x7f9b380aa690 con 0x7f9b3c122af0 2026-02-13T03:34:01.868 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:01.868 INFO:teuthology.orchestra.run.trial096.stdout:{"epoch":3,"btime":"2026-02-13T03:34:01:051994+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.133:6833/1760340814","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6832","nonce":1760340814},{"type":"v1","addr":"10.20.193.133:6833","nonce":1760340814}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.132:6833/4227189143","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6832","nonce":4227189143},{"type":"v1","addr":"10.20.193.132:6833","nonce":4227189143}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2026-02-13T03:34:01.868 INFO:teuthology.orchestra.run.trial096.stderr:dumped fsmap epoch 3 2026-02-13T03:34:01.869 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.867+0000 7f9b42efd6c0 1 -- 10.20.193.96:0/295376424 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9b180b5600 msgr2=0x7f9b180d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:01.870 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.867+0000 7f9b42efd6c0 1 --2- 10.20.193.96:0/295376424 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9b180b5600 0x7f9b180d5ab0 secure :-1 s=READY pgs=149 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b2c005b40 tx=0x7f9b2c0023a0 comp rx=0 tx=0).stop 2026-02-13T03:34:01.870 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.867+0000 7f9b42efd6c0 1 -- 10.20.193.96:0/295376424 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9b3c122af0 msgr2=0x7f9b3c122f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:01.870 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.867+0000 7f9b42efd6c0 1 --2- 10.20.193.96:0/295376424 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9b3c122af0 0x7f9b3c122f90 secure :-1 s=READY pgs=198 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b38006ea0 tx=0x7f9b3800ce50 comp rx=0 tx=0).stop 2026-02-13T03:34:01.870 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.867+0000 7f9b42efd6c0 1 -- 10.20.193.96:0/295376424 shutdown_connections 2026-02-13T03:34:01.870 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.867+0000 7f9b42efd6c0 1 --2- 10.20.193.96:0/295376424 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9b180b5600 0x7f9b180d5ab0 unknown :-1 s=CLOSED pgs=149 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:01.870 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.867+0000 7f9b42efd6c0 1 --2- 10.20.193.96:0/295376424 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9b3c122af0 0x7f9b3c122f90 unknown :-1 s=CLOSED pgs=198 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:01.870 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.867+0000 7f9b42efd6c0 1 --2- 10.20.193.96:0/295376424 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9b3c115440 0x7f9b3c11d730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:01.870 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.867+0000 7f9b42efd6c0 1 --2- 10.20.193.96:0/295376424 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9b3c10f230 0x7f9b3c11d1f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:01.870 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.867+0000 7f9b42efd6c0 1 -- 10.20.193.96:0/295376424 >> 10.20.193.96:0/295376424 conn(0x7f9b3c0ecb30 msgr2=0x7f9b3c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:01.870 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.867+0000 7f9b42efd6c0 1 -- 10.20.193.96:0/295376424 shutdown_connections 2026-02-13T03:34:01.871 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:01.867+0000 7f9b42efd6c0 1 -- 10.20.193.96:0/295376424 wait complete. 2026-02-13T03:34:02.118 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:02 trial096 ceph-mon[24671]: mds.? [v2:10.20.193.132:6832/4227189143,v1:10.20.193.132:6833/4227189143] up:boot 2026-02-13T03:34:02.119 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:02 trial096 ceph-mon[24671]: fsmap 2 up:standby 2026-02-13T03:34:02.119 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:02 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-13T03:34:02.119 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:02 trial096 ceph-mon[24671]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:02.119 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:02 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:02.119 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:02 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:02.119 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:02 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:02.119 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:02 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:02.119 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:02 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:02.119 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:02 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:02.119 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:02 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/295376424' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:34:02.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:02 trial132 ceph-mon[26888]: mds.? [v2:10.20.193.132:6832/4227189143,v1:10.20.193.132:6833/4227189143] up:boot 2026-02-13T03:34:02.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:02 trial132 ceph-mon[26888]: fsmap 2 up:standby 2026-02-13T03:34:02.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:02 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-13T03:34:02.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:02 trial132 ceph-mon[26888]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:02.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:02 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:02.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:02 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:02.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:02 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:02.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:02 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:02.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:02 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:02.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:02 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:02.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:02 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/295376424' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:34:02.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:02 trial133 ceph-mon[26943]: mds.? [v2:10.20.193.132:6832/4227189143,v1:10.20.193.132:6833/4227189143] up:boot 2026-02-13T03:34:02.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:02 trial133 ceph-mon[26943]: fsmap 2 up:standby 2026-02-13T03:34:02.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:02 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-13T03:34:02.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:02 trial133 ceph-mon[26943]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:02.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:02 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:02.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:02 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:02.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:02 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:02.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:02 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:02.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:02 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:02.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:02 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:02.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:02 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/295376424' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:34:02.674 INFO:journalctl@ceph.mds.d.trial096.stdout:Feb 13 03:34:02 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-d[60776]: starting mds.d at 2026-02-13T03:34:03.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:03 trial132 ceph-mon[26888]: mds.? [v2:10.20.193.96:6834/392543675,v1:10.20.193.96:6835/392543675] up:boot 2026-02-13T03:34:03.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:03 trial132 ceph-mon[26888]: fsmap 3 up:standby 2026-02-13T03:34:03.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:03 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-13T03:34:03.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:03 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:03.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:03 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:03.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:03 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:03.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:03 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:03.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:03 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:03.234 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:03 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:03.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:03 trial096 ceph-mon[24671]: mds.? [v2:10.20.193.96:6834/392543675,v1:10.20.193.96:6835/392543675] up:boot 2026-02-13T03:34:03.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:03 trial096 ceph-mon[24671]: fsmap 3 up:standby 2026-02-13T03:34:03.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:03 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-13T03:34:03.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:03 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:03.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:03 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:03.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:03 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:03.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:03 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:03.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:03 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:03.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:03 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:03.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:03 trial133 ceph-mon[26943]: mds.? [v2:10.20.193.96:6834/392543675,v1:10.20.193.96:6835/392543675] up:boot 2026-02-13T03:34:03.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:03 trial133 ceph-mon[26943]: fsmap 3 up:standby 2026-02-13T03:34:03.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:03 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-13T03:34:03.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:03 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:03.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:03 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:03.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:03 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:03.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:03 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:03.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:03 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:03.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:03 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:03.733 INFO:journalctl@ceph.mds.e.trial132.stdout:Feb 13 03:34:03 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-e[54801]: starting mds.e at 2026-02-13T03:34:03.911 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T03:34:04.032 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:04.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.153+0000 7fa8faad36c0 1 -- 10.20.193.96:0/713444393 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa8f4115410 msgr2=0x7fa8f4175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:04.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.153+0000 7fa8faad36c0 1 --2- 10.20.193.96:0/713444393 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa8f4115410 0x7fa8f4175db0 secure :-1 s=READY pgs=201 gs=1 cs=0 l=1 c_cookie=3609242904452776010 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8f000aa70 tx=0x7fa8f002fde0 comp rx=0 tx=0).stop 2026-02-13T03:34:04.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.153+0000 7fa8faad36c0 1 -- 10.20.193.96:0/713444393 shutdown_connections 2026-02-13T03:34:04.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.153+0000 7fa8faad36c0 1 --2- 10.20.193.96:0/713444393 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa8f4115410 0x7fa8f4175db0 unknown :-1 s=CLOSED pgs=201 gs=1 cs=0 l=1 c_cookie=3609242904452776010 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:04.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.153+0000 7fa8faad36c0 1 --2- 10.20.193.96:0/713444393 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa8f410fbf0 0x7fa8f4114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:04.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.153+0000 7fa8faad36c0 1 --2- 10.20.193.96:0/713444393 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa8f410f200 0x7fa8f410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:04.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.153+0000 7fa8faad36c0 1 -- 10.20.193.96:0/713444393 >> 10.20.193.96:0/713444393 conn(0x7fa8f40ecb00 msgr2=0x7fa8f410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:04.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.153+0000 7fa8faad36c0 1 -- 10.20.193.96:0/713444393 shutdown_connections 2026-02-13T03:34:04.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.153+0000 7fa8faad36c0 1 -- 10.20.193.96:0/713444393 wait complete. 2026-02-13T03:34:04.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8faad36c0 1 Processor -- start 2026-02-13T03:34:04.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8faad36c0 1 -- start start 2026-02-13T03:34:04.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8faad36c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa8f410f200 0x7fa8f411d1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:04.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8faad36c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa8f4115410 0x7fa8f411d710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:04.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8faad36c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa8f4122ad0 0x7fa8f4122f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:04.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8faad36c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f41234e0 con 0x7fa8f410f200 2026-02-13T03:34:04.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8faad36c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f4123650 con 0x7fa8f4122ad0 2026-02-13T03:34:04.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8faad36c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f4123810 con 0x7fa8f4115410 2026-02-13T03:34:04.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8f88446c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa8f410f200 0x7fa8f411d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:04.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8f88446c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa8f410f200 0x7fa8f411d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:50858/0 (socket says 10.20.193.96:50858) 2026-02-13T03:34:04.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8f88446c0 1 -- 10.20.193.96:0/374067905 learned_addr learned my addr 10.20.193.96:0/374067905 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:04.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8ebfff6c0 1 --2- 10.20.193.96:0/374067905 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa8f4115410 0x7fa8f411d710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:04.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8f88446c0 1 -- 10.20.193.96:0/374067905 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa8f4115410 msgr2=0x7fa8f411d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:04.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8f88446c0 1 --2- 10.20.193.96:0/374067905 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa8f4115410 0x7fa8f411d710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:04.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8f90456c0 1 --2- 10.20.193.96:0/374067905 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa8f4122ad0 0x7fa8f4122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:04.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8f88446c0 1 -- 10.20.193.96:0/374067905 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa8f4122ad0 msgr2=0x7fa8f4122f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:04.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8f88446c0 1 --2- 10.20.193.96:0/374067905 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa8f4122ad0 0x7fa8f4122f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:04.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8f88446c0 1 -- 10.20.193.96:0/374067905 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f000a660 con 0x7fa8f410f200 2026-02-13T03:34:04.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8ebfff6c0 1 --2- 10.20.193.96:0/374067905 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa8f4115410 0x7fa8f411d710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:34:04.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8f90456c0 1 --2- 10.20.193.96:0/374067905 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa8f4122ad0 0x7fa8f4122f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:34:04.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8f88446c0 1 --2- 10.20.193.96:0/374067905 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa8f410f200 0x7fa8f411d1d0 secure :-1 s=READY pgs=202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8e4005dc0 tx=0x7fa8e400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:04.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8e9ffb6c0 1 -- 10.20.193.96:0/374067905 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa8e4004250 con 0x7fa8f410f200 2026-02-13T03:34:04.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8faad36c0 1 -- 10.20.193.96:0/374067905 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f4163cc0 con 0x7fa8f410f200 2026-02-13T03:34:04.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8e9ffb6c0 1 -- 10.20.193.96:0/374067905 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fa8e4009070 con 0x7fa8f410f200 2026-02-13T03:34:04.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8e9ffb6c0 1 -- 10.20.193.96:0/374067905 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa8e400cdb0 con 0x7fa8f410f200 2026-02-13T03:34:04.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.154+0000 7fa8faad36c0 1 -- 10.20.193.96:0/374067905 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f4164150 con 0x7fa8f410f200 2026-02-13T03:34:04.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.155+0000 7fa8faad36c0 1 -- 10.20.193.96:0/374067905 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8f41104d0 con 0x7fa8f410f200 2026-02-13T03:34:04.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.157+0000 7fa8e9ffb6c0 1 -- 10.20.193.96:0/374067905 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7fa8e40028c0 con 0x7fa8f410f200 2026-02-13T03:34:04.163 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.158+0000 7fa8e9ffb6c0 1 --2- 10.20.193.96:0/374067905 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa8d00b5600 0x7fa8d00d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:04.163 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.158+0000 7fa8ebfff6c0 1 --2- 10.20.193.96:0/374067905 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa8d00b5600 0x7fa8d00d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:04.163 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.158+0000 7fa8e9ffb6c0 1 -- 10.20.193.96:0/374067905 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6904+0+0 (secure 0 0 0) 0x7fa8e40e3660 con 0x7fa8f410f200 2026-02-13T03:34:04.163 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.158+0000 7fa8e9ffb6c0 1 -- 10.20.193.96:0/374067905 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa8e40a9550 con 0x7fa8f410f200 2026-02-13T03:34:04.163 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.158+0000 7fa8ebfff6c0 1 --2- 10.20.193.96:0/374067905 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa8d00b5600 0x7fa8d00d5ab0 secure :-1 s=READY pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8dc005fd0 tx=0x7fa8dc005d50 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:04.274 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.271+0000 7fa8faad36c0 1 -- 10.20.193.96:0/374067905 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8f410f5d0 con 0x7fa8f410f200 2026-02-13T03:34:04.275 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:04 trial096 ceph-mon[24671]: mds.? [v2:10.20.193.96:6836/1965017277,v1:10.20.193.96:6837/1965017277] up:boot 2026-02-13T03:34:04.275 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:04 trial096 ceph-mon[24671]: fsmap 4 up:standby 2026-02-13T03:34:04.275 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:04 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-13T03:34:04.275 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:04 trial096 ceph-mon[24671]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:04.275 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:04 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:04.275 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:04 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:04.275 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:04 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:04.275 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:04 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:04.276 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:04 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:04.276 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:04 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:04.276 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.272+0000 7fa8e9ffb6c0 1 -- 10.20.193.96:0/374067905 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4741 (secure 0 0 0) 0x7fa8e40a9730 con 0x7fa8f410f200 2026-02-13T03:34:04.276 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:04.276 INFO:teuthology.orchestra.run.trial096.stdout:{"epoch":6,"btime":"2026-02-13T03:34:04:060560+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.96:6835/392543675","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6834","nonce":392543675},{"type":"v1","addr":"10.20.193.96:6835","nonce":392543675}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.96:6837/1965017277","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6836","nonce":1965017277},{"type":"v1","addr":"10.20.193.96:6837","nonce":1965017277}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.133:6833/1760340814","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6832","nonce":1760340814},{"type":"v1","addr":"10.20.193.133:6833","nonce":1760340814}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.132:6833/4227189143","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6832","nonce":4227189143},{"type":"v1","addr":"10.20.193.132:6833","nonce":4227189143}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.132:6835/4071682208","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6834","nonce":4071682208},{"type":"v1","addr":"10.20.193.132:6835","nonce":4071682208}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2026-02-13T03:34:04.277 INFO:teuthology.orchestra.run.trial096.stderr:dumped fsmap epoch 6 2026-02-13T03:34:04.277 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.273+0000 7fa8faad36c0 1 -- 10.20.193.96:0/374067905 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa8d00b5600 msgr2=0x7fa8d00d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:04.278 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.273+0000 7fa8faad36c0 1 --2- 10.20.193.96:0/374067905 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa8d00b5600 0x7fa8d00d5ab0 secure :-1 s=READY pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8dc005fd0 tx=0x7fa8dc005d50 comp rx=0 tx=0).stop 2026-02-13T03:34:04.278 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.273+0000 7fa8faad36c0 1 -- 10.20.193.96:0/374067905 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa8f410f200 msgr2=0x7fa8f411d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:04.278 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.273+0000 7fa8faad36c0 1 --2- 10.20.193.96:0/374067905 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa8f410f200 0x7fa8f411d1d0 secure :-1 s=READY pgs=202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8e4005dc0 tx=0x7fa8e400bbb0 comp rx=0 tx=0).stop 2026-02-13T03:34:04.278 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.273+0000 7fa8faad36c0 1 -- 10.20.193.96:0/374067905 shutdown_connections 2026-02-13T03:34:04.278 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.273+0000 7fa8faad36c0 1 --2- 10.20.193.96:0/374067905 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa8d00b5600 0x7fa8d00d5ab0 unknown :-1 s=CLOSED pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:04.278 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.273+0000 7fa8faad36c0 1 --2- 10.20.193.96:0/374067905 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa8f4122ad0 0x7fa8f4122f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:04.278 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.273+0000 7fa8faad36c0 1 --2- 10.20.193.96:0/374067905 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa8f4115410 0x7fa8f411d710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:04.278 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.273+0000 7fa8faad36c0 1 --2- 10.20.193.96:0/374067905 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa8f410f200 0x7fa8f411d1d0 unknown :-1 s=CLOSED pgs=202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:04.278 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.273+0000 7fa8faad36c0 1 -- 10.20.193.96:0/374067905 >> 10.20.193.96:0/374067905 conn(0x7fa8f40ecb00 msgr2=0x7fa8f410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:04.278 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.273+0000 7fa8faad36c0 1 -- 10.20.193.96:0/374067905 shutdown_connections 2026-02-13T03:34:04.278 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:04.273+0000 7fa8faad36c0 1 -- 10.20.193.96:0/374067905 wait complete. 2026-02-13T03:34:04.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:04 trial132 ceph-mon[26888]: mds.? [v2:10.20.193.96:6836/1965017277,v1:10.20.193.96:6837/1965017277] up:boot 2026-02-13T03:34:04.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:04 trial132 ceph-mon[26888]: fsmap 4 up:standby 2026-02-13T03:34:04.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:04 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-13T03:34:04.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:04 trial132 ceph-mon[26888]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:04.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:04 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:04.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:04 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:04.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:04 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:04.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:04 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:04.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:04 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:04.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:04 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:04.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:04 trial133 ceph-mon[26943]: mds.? [v2:10.20.193.96:6836/1965017277,v1:10.20.193.96:6837/1965017277] up:boot 2026-02-13T03:34:04.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:04 trial133 ceph-mon[26943]: fsmap 4 up:standby 2026-02-13T03:34:04.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:04 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-13T03:34:04.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:04 trial133 ceph-mon[26943]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:04.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:04 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:04.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:04 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:04.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:04 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:04.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:04 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:04.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:04 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:04.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:04 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:04.514 INFO:journalctl@ceph.mds.f.trial133.stdout:Feb 13 03:34:04 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-f[55355]: starting mds.f at 2026-02-13T03:34:05.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:05 trial133 ceph-mon[26943]: mds.? [v2:10.20.193.132:6834/4071682208,v1:10.20.193.132:6835/4071682208] up:boot 2026-02-13T03:34:05.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:05 trial133 ceph-mon[26943]: fsmap 5 up:standby 2026-02-13T03:34:05.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:05 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-13T03:34:05.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:05 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:05.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:05 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:05.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:05 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:05.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:05 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:05.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:05 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:05.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:05 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:05.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:05 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/374067905' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:34:05.423 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:05 trial132 ceph-mon[26888]: mds.? [v2:10.20.193.132:6834/4071682208,v1:10.20.193.132:6835/4071682208] up:boot 2026-02-13T03:34:05.423 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:05 trial132 ceph-mon[26888]: fsmap 5 up:standby 2026-02-13T03:34:05.423 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:05 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-13T03:34:05.423 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:05 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:05.423 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:05 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:05.423 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:05 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:05.423 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:05 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:05.423 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:05 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:05.423 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:05 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:05.424 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:05 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/374067905' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:34:05.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:05 trial096 ceph-mon[24671]: mds.? [v2:10.20.193.132:6834/4071682208,v1:10.20.193.132:6835/4071682208] up:boot 2026-02-13T03:34:05.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:05 trial096 ceph-mon[24671]: fsmap 5 up:standby 2026-02-13T03:34:05.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:05 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-13T03:34:05.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:05 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:05.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:05 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:05.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:05 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:05.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:05 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:05.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:05 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:05.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:05 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:05.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:05 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/374067905' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:34:06.071 INFO:journalctl@ceph.mds.h.trial132.stdout:Feb 13 03:34:05 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-h[55128]: starting mds.h at 2026-02-13T03:34:06.317 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T03:34:06.321 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:06 trial133 ceph-mon[26943]: mds.? [v2:10.20.193.133:6834/2552443453,v1:10.20.193.133:6835/2552443453] up:boot 2026-02-13T03:34:06.322 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:06 trial133 ceph-mon[26943]: mds.? [v2:10.20.193.133:6836/1508462977,v1:10.20.193.133:6837/1508462977] up:boot 2026-02-13T03:34:06.322 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:06 trial133 ceph-mon[26943]: fsmap 7 up:standby 2026-02-13T03:34:06.322 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-13T03:34:06.322 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-13T03:34:06.322 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:06.322 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:06.322 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:06.322 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:06.322 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:06.323 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:06.323 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:06 trial133 ceph-mon[26943]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:06.323 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:06.323 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:06.323 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:06.323 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:06.323 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:06.323 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:06 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:06.343 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:06 trial096 ceph-mon[24671]: mds.? [v2:10.20.193.133:6834/2552443453,v1:10.20.193.133:6835/2552443453] up:boot 2026-02-13T03:34:06.344 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:06 trial096 ceph-mon[24671]: mds.? [v2:10.20.193.133:6836/1508462977,v1:10.20.193.133:6837/1508462977] up:boot 2026-02-13T03:34:06.344 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:06 trial096 ceph-mon[24671]: fsmap 7 up:standby 2026-02-13T03:34:06.344 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-13T03:34:06.344 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-13T03:34:06.344 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:06.344 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:06.344 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:06.344 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:06.344 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:06.344 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:06.345 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:06 trial096 ceph-mon[24671]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:06.345 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:06.345 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:06.345 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:06.345 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:06.345 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:06.345 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:06 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:06.439 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:06.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:06 trial132 ceph-mon[26888]: mds.? [v2:10.20.193.133:6834/2552443453,v1:10.20.193.133:6835/2552443453] up:boot 2026-02-13T03:34:06.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:06 trial132 ceph-mon[26888]: mds.? [v2:10.20.193.133:6836/1508462977,v1:10.20.193.133:6837/1508462977] up:boot 2026-02-13T03:34:06.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:06 trial132 ceph-mon[26888]: fsmap 7 up:standby 2026-02-13T03:34:06.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-13T03:34:06.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-13T03:34:06.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:06.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:06.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:06.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:06.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:06.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:06.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:06 trial132 ceph-mon[26888]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:06.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:06.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:06.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:06.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:06.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:06.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:06 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:06.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.548+0000 7f28649e76c0 1 -- 10.20.193.96:0/2230104820 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f285c115410 msgr2=0x7f285c175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:06.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.548+0000 7f28649e76c0 1 --2- 10.20.193.96:0/2230104820 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f285c115410 0x7f285c175db0 secure :-1 s=READY pgs=203 gs=1 cs=0 l=1 c_cookie=3704931955498568418 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f285000aa70 tx=0x7f285002fde0 comp rx=0 tx=0).stop 2026-02-13T03:34:06.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.548+0000 7f28649e76c0 1 -- 10.20.193.96:0/2230104820 shutdown_connections 2026-02-13T03:34:06.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.548+0000 7f28649e76c0 1 --2- 10.20.193.96:0/2230104820 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f285c115410 0x7f285c175db0 unknown :-1 s=CLOSED pgs=203 gs=1 cs=0 l=1 c_cookie=3704931955498568418 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:06.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.548+0000 7f28649e76c0 1 --2- 10.20.193.96:0/2230104820 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f285c10fbf0 0x7f285c114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:06.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.548+0000 7f28649e76c0 1 --2- 10.20.193.96:0/2230104820 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f285c10f200 0x7f285c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:06.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.548+0000 7f28649e76c0 1 -- 10.20.193.96:0/2230104820 >> 10.20.193.96:0/2230104820 conn(0x7f285c0ecb00 msgr2=0x7f285c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:06.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.548+0000 7f28649e76c0 1 -- 10.20.193.96:0/2230104820 shutdown_connections 2026-02-13T03:34:06.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.548+0000 7f28649e76c0 1 -- 10.20.193.96:0/2230104820 wait complete. 2026-02-13T03:34:06.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.548+0000 7f28649e76c0 1 Processor -- start 2026-02-13T03:34:06.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.548+0000 7f28649e76c0 1 -- start start 2026-02-13T03:34:06.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.548+0000 7f28649e76c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f285c10f200 0x7f285c0f4b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:06.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.548+0000 7f28649e76c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f285c115410 0x7f285c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:06.555 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.549+0000 7f28649e76c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f285c0f5140 0x7f285c0fa410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:06.555 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.549+0000 7f28649e76c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f285c0f5830 con 0x7f285c0f5140 2026-02-13T03:34:06.555 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.549+0000 7f28649e76c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f285c0fa950 con 0x7f285c10f200 2026-02-13T03:34:06.555 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.549+0000 7f28649e76c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f285c0fab10 con 0x7f285c115410 2026-02-13T03:34:06.555 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.549+0000 7f2862f596c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f285c0f5140 0x7f285c0fa410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:06.555 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.549+0000 7f2862f596c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f285c0f5140 0x7f285c0fa410 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:50874/0 (socket says 10.20.193.96:50874) 2026-02-13T03:34:06.555 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.549+0000 7f2862f596c0 1 -- 10.20.193.96:0/1097717735 learned_addr learned my addr 10.20.193.96:0/1097717735 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:06.555 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.549+0000 7f2861f576c0 1 --2- 10.20.193.96:0/1097717735 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f285c115410 0x7f285c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:06.555 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.549+0000 7f28627586c0 1 --2- 10.20.193.96:0/1097717735 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f285c10f200 0x7f285c0f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:06.555 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.549+0000 7f2862f596c0 1 -- 10.20.193.96:0/1097717735 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f285c115410 msgr2=0x7f285c175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:06.555 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.549+0000 7f2862f596c0 1 --2- 10.20.193.96:0/1097717735 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f285c115410 0x7f285c175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:06.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.549+0000 7f2862f596c0 1 -- 10.20.193.96:0/1097717735 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f285c10f200 msgr2=0x7f285c0f4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:06.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.549+0000 7f2862f596c0 1 --2- 10.20.193.96:0/1097717735 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f285c10f200 0x7f285c0f4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:06.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.549+0000 7f2862f596c0 1 -- 10.20.193.96:0/1097717735 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f285000a660 con 0x7f285c0f5140 2026-02-13T03:34:06.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.549+0000 7f2861f576c0 1 --2- 10.20.193.96:0/1097717735 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f285c115410 0x7f285c175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:34:06.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.549+0000 7f28627586c0 1 --2- 10.20.193.96:0/1097717735 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f285c10f200 0x7f285c0f4b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:34:06.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.549+0000 7f2862f596c0 1 --2- 10.20.193.96:0/1097717735 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f285c0f5140 0x7f285c0fa410 secure :-1 s=READY pgs=204 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28500027a0 tx=0x7f28500054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:06.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.549+0000 7f28477fe6c0 1 -- 10.20.193.96:0/1097717735 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2850030d10 con 0x7f285c0f5140 2026-02-13T03:34:06.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.549+0000 7f28477fe6c0 1 -- 10.20.193.96:0/1097717735 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f2850030e70 con 0x7f285c0f5140 2026-02-13T03:34:06.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.549+0000 7f28649e76c0 1 -- 10.20.193.96:0/1097717735 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f285c0fad90 con 0x7f285c0f5140 2026-02-13T03:34:06.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.549+0000 7f28477fe6c0 1 -- 10.20.193.96:0/1097717735 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f28500086b0 con 0x7f285c0f5140 2026-02-13T03:34:06.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.549+0000 7f28649e76c0 1 -- 10.20.193.96:0/1097717735 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f285c0fb1c0 con 0x7f285c0f5140 2026-02-13T03:34:06.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.550+0000 7f28649e76c0 1 -- 10.20.193.96:0/1097717735 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f285c1104d0 con 0x7f285c0f5140 2026-02-13T03:34:06.557 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.551+0000 7f28477fe6c0 1 -- 10.20.193.96:0/1097717735 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f2850032030 con 0x7f285c0f5140 2026-02-13T03:34:06.558 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.551+0000 7f28477fe6c0 1 --2- 10.20.193.96:0/1097717735 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f28380b5600 0x7f28380d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:06.558 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.551+0000 7f28627586c0 1 --2- 10.20.193.96:0/1097717735 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f28380b5600 0x7f28380d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:06.558 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.551+0000 7f28477fe6c0 1 -- 10.20.193.96:0/1097717735 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6904+0+0 (secure 0 0 0) 0x7f2850108a70 con 0x7f285c0f5140 2026-02-13T03:34:06.558 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.552+0000 7f28627586c0 1 --2- 10.20.193.96:0/1097717735 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f28380b5600 0x7f28380d5ab0 secure :-1 s=READY pgs=157 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2854004750 tx=0x7f2854009060 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:06.558 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.552+0000 7f28477fe6c0 1 -- 10.20.193.96:0/1097717735 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f28500cb990 con 0x7f285c0f5140 2026-02-13T03:34:06.668 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.665+0000 7f28649e76c0 1 -- 10.20.193.96:0/1097717735 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f285c10f5d0 con 0x7f285c0f5140 2026-02-13T03:34:06.668 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.665+0000 7f28477fe6c0 1 -- 10.20.193.96:0/1097717735 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+7222 (secure 0 0 0) 0x7f28500ceb40 con 0x7f285c0f5140 2026-02-13T03:34:06.669 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:06.669 INFO:teuthology.orchestra.run.trial096.stdout:{"epoch":8,"btime":"2026-02-13T03:34:06:079445+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.96:6835/392543675","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6834","nonce":392543675},{"type":"v1","addr":"10.20.193.96:6835","nonce":392543675}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.96:6837/1965017277","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6836","nonce":1965017277},{"type":"v1","addr":"10.20.193.96:6837","nonce":1965017277}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.133:6833/1760340814","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6832","nonce":1760340814},{"type":"v1","addr":"10.20.193.133:6833","nonce":1760340814}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.132:6833/4227189143","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6832","nonce":4227189143},{"type":"v1","addr":"10.20.193.132:6833","nonce":4227189143}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.133:6835/2552443453","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6834","nonce":2552443453},{"type":"v1","addr":"10.20.193.133:6835","nonce":2552443453}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.133:6837/1508462977","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6836","nonce":1508462977},{"type":"v1","addr":"10.20.193.133:6837","nonce":1508462977}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.132:6835/4071682208","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6834","nonce":4071682208},{"type":"v1","addr":"10.20.193.132:6835","nonce":4071682208}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24473,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.132:6837/768182548","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6836","nonce":768182548},{"type":"v1","addr":"10.20.193.132:6837","nonce":768182548}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2026-02-13T03:34:06.670 INFO:teuthology.orchestra.run.trial096.stderr:dumped fsmap epoch 8 2026-02-13T03:34:06.671 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.666+0000 7f28649e76c0 1 -- 10.20.193.96:0/1097717735 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f28380b5600 msgr2=0x7f28380d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:06.671 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.666+0000 7f28649e76c0 1 --2- 10.20.193.96:0/1097717735 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f28380b5600 0x7f28380d5ab0 secure :-1 s=READY pgs=157 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2854004750 tx=0x7f2854009060 comp rx=0 tx=0).stop 2026-02-13T03:34:06.671 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.666+0000 7f28649e76c0 1 -- 10.20.193.96:0/1097717735 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f285c0f5140 msgr2=0x7f285c0fa410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:06.671 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.666+0000 7f28649e76c0 1 --2- 10.20.193.96:0/1097717735 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f285c0f5140 0x7f285c0fa410 secure :-1 s=READY pgs=204 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28500027a0 tx=0x7f28500054b0 comp rx=0 tx=0).stop 2026-02-13T03:34:06.671 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.666+0000 7f28649e76c0 1 -- 10.20.193.96:0/1097717735 shutdown_connections 2026-02-13T03:34:06.671 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.666+0000 7f28649e76c0 1 --2- 10.20.193.96:0/1097717735 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f28380b5600 0x7f28380d5ab0 unknown :-1 s=CLOSED pgs=157 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:06.671 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.666+0000 7f28649e76c0 1 --2- 10.20.193.96:0/1097717735 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f285c0f5140 0x7f285c0fa410 unknown :-1 s=CLOSED pgs=204 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:06.671 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.666+0000 7f28649e76c0 1 --2- 10.20.193.96:0/1097717735 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f285c115410 0x7f285c175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:06.671 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.666+0000 7f28649e76c0 1 --2- 10.20.193.96:0/1097717735 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f285c10f200 0x7f285c0f4b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:06.671 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.666+0000 7f28649e76c0 1 -- 10.20.193.96:0/1097717735 >> 10.20.193.96:0/1097717735 conn(0x7f285c0ecb00 msgr2=0x7f285c113a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:06.672 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.666+0000 7f28649e76c0 1 -- 10.20.193.96:0/1097717735 shutdown_connections 2026-02-13T03:34:06.672 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:06.666+0000 7f28649e76c0 1 -- 10.20.193.96:0/1097717735 wait complete. 2026-02-13T03:34:07.014 INFO:journalctl@ceph.mds.i.trial133.stdout:Feb 13 03:34:06 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-i[55996]: starting mds.i at 2026-02-13T03:34:07.359 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:07 trial096 ceph-mon[24671]: mds.? [v2:10.20.193.132:6836/768182548,v1:10.20.193.132:6837/768182548] up:boot 2026-02-13T03:34:07.359 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:07 trial096 ceph-mon[24671]: fsmap 8 up:standby 2026-02-13T03:34:07.360 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:07 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-13T03:34:07.360 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:07 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1097717735' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:34:07.360 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:07 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:07.360 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:07 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:07.360 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:07 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:07.360 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:07 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:07.360 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:07 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:07.360 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:07 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:07.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:07 trial132 ceph-mon[26888]: mds.? [v2:10.20.193.132:6836/768182548,v1:10.20.193.132:6837/768182548] up:boot 2026-02-13T03:34:07.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:07 trial132 ceph-mon[26888]: fsmap 8 up:standby 2026-02-13T03:34:07.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:07 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-13T03:34:07.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:07 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1097717735' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:34:07.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:07 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:07.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:07 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:07.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:07 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:07.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:07 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:07.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:07 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:07.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:07 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:07.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:07 trial133 ceph-mon[26943]: mds.? [v2:10.20.193.132:6836/768182548,v1:10.20.193.132:6837/768182548] up:boot 2026-02-13T03:34:07.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:07 trial133 ceph-mon[26943]: fsmap 8 up:standby 2026-02-13T03:34:07.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:07 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-13T03:34:07.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:07 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1097717735' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:34:07.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:07 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:07.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:07 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:07.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:07 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:07.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:07 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:07.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:07 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:07.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:07 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:07.924 INFO:journalctl@ceph.mds.g.trial096.stdout:Feb 13 03:34:07 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-g[61313]: starting mds.g at 2026-02-13T03:34:08.288 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:08 trial096 ceph-mon[24671]: mds.? [v2:10.20.193.133:6838/3735956625,v1:10.20.193.133:6839/3735956625] up:boot 2026-02-13T03:34:08.288 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:08 trial096 ceph-mon[24671]: fsmap 9 up:standby 2026-02-13T03:34:08.288 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:08 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-13T03:34:08.289 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:08 trial096 ceph-mon[24671]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:08.289 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:08 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:08.289 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:08 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:08.289 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:08 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:08.289 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:08 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:08.289 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:08 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:08.289 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:08 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:08.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:08 trial132 ceph-mon[26888]: mds.? [v2:10.20.193.133:6838/3735956625,v1:10.20.193.133:6839/3735956625] up:boot 2026-02-13T03:34:08.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:08 trial132 ceph-mon[26888]: fsmap 9 up:standby 2026-02-13T03:34:08.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:08 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-13T03:34:08.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:08 trial132 ceph-mon[26888]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:08.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:08 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:08.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:08 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:08.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:08 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:08.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:08 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:08.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:08 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:08.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:08 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:08.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:08 trial133 ceph-mon[26943]: mds.? [v2:10.20.193.133:6838/3735956625,v1:10.20.193.133:6839/3735956625] up:boot 2026-02-13T03:34:08.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:08 trial133 ceph-mon[26943]: fsmap 9 up:standby 2026-02-13T03:34:08.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:08 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-13T03:34:08.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:08 trial133 ceph-mon[26943]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:08.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:08 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:08.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:08 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:08.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:08 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:08.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:08 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:08.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:08 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:08.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:08 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:08.674 INFO:journalctl@ceph.mds.a.trial096.stdout:Feb 13 03:34:08 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-a[61637]: starting mds.a at 2026-02-13T03:34:08.710 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T03:34:08.829 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:08.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.947+0000 7fe77c2076c0 1 -- 10.20.193.96:0/1220446491 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe774115440 msgr2=0x7fe774175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:08.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.947+0000 7fe77c2076c0 1 --2- 10.20.193.96:0/1220446491 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe774115440 0x7fe774175de0 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=14388491741394176665 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe77000aa70 tx=0x7fe77002fde0 comp rx=0 tx=0).stop 2026-02-13T03:34:08.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.947+0000 7fe77c2076c0 1 -- 10.20.193.96:0/1220446491 shutdown_connections 2026-02-13T03:34:08.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.947+0000 7fe77c2076c0 1 --2- 10.20.193.96:0/1220446491 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe774115440 0x7fe774175de0 unknown :-1 s=CLOSED pgs=209 gs=1 cs=0 l=1 c_cookie=14388491741394176665 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:08.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.947+0000 7fe77c2076c0 1 --2- 10.20.193.96:0/1220446491 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe77410fc20 0x7fe774114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:08.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.947+0000 7fe77c2076c0 1 --2- 10.20.193.96:0/1220446491 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe77410f230 0x7fe77410f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:08.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.947+0000 7fe77c2076c0 1 -- 10.20.193.96:0/1220446491 >> 10.20.193.96:0/1220446491 conn(0x7fe7740ecb30 msgr2=0x7fe77410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:08.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.947+0000 7fe77c2076c0 1 -- 10.20.193.96:0/1220446491 shutdown_connections 2026-02-13T03:34:08.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.947+0000 7fe77c2076c0 1 -- 10.20.193.96:0/1220446491 wait complete. 2026-02-13T03:34:08.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe77c2076c0 1 Processor -- start 2026-02-13T03:34:08.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe77c2076c0 1 -- start start 2026-02-13T03:34:08.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe77c2076c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe77410f230 0x7fe77411d120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:08.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe77c2076c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe774115440 0x7fe77411d660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:08.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe77c2076c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe774122a20 0x7fe774122ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:08.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe77c2076c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe774123430 con 0x7fe774115440 2026-02-13T03:34:08.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe77c2076c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe7741235a0 con 0x7fe774122a20 2026-02-13T03:34:08.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe77c2076c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe774123760 con 0x7fe77410f230 2026-02-13T03:34:08.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe7797776c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe774115440 0x7fe77411d660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:08.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe7797776c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe774115440 0x7fe77411d660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:50932/0 (socket says 10.20.193.96:50932) 2026-02-13T03:34:08.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe7797776c0 1 -- 10.20.193.96:0/592332065 learned_addr learned my addr 10.20.193.96:0/592332065 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:08.955 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe779f786c0 1 --2- 10.20.193.96:0/592332065 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe77410f230 0x7fe77411d120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:08.955 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe7797776c0 1 -- 10.20.193.96:0/592332065 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe77410f230 msgr2=0x7fe77411d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:08.955 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe7797776c0 1 --2- 10.20.193.96:0/592332065 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe77410f230 0x7fe77411d120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:08.955 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe77a7796c0 1 --2- 10.20.193.96:0/592332065 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe774122a20 0x7fe774122ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:08.955 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe7797776c0 1 -- 10.20.193.96:0/592332065 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe774122a20 msgr2=0x7fe774122ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:08.955 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe7797776c0 1 --2- 10.20.193.96:0/592332065 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe774122a20 0x7fe774122ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:08.955 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe7797776c0 1 -- 10.20.193.96:0/592332065 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe77000a660 con 0x7fe774115440 2026-02-13T03:34:08.955 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe77a7796c0 1 --2- 10.20.193.96:0/592332065 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe774122a20 0x7fe774122ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:34:08.955 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe7797776c0 1 --2- 10.20.193.96:0/592332065 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe774115440 0x7fe77411d660 secure :-1 s=READY pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe768005dc0 tx=0x7fe76800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:08.955 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe762ffd6c0 1 -- 10.20.193.96:0/592332065 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe768004250 con 0x7fe774115440 2026-02-13T03:34:08.955 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe762ffd6c0 1 -- 10.20.193.96:0/592332065 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fe768009070 con 0x7fe774115440 2026-02-13T03:34:08.955 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe77c2076c0 1 -- 10.20.193.96:0/592332065 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe774163c10 con 0x7fe774115440 2026-02-13T03:34:08.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe762ffd6c0 1 -- 10.20.193.96:0/592332065 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe76800cdb0 con 0x7fe774115440 2026-02-13T03:34:08.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.948+0000 7fe77c2076c0 1 -- 10.20.193.96:0/592332065 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7741640f0 con 0x7fe774115440 2026-02-13T03:34:08.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.949+0000 7fe77c2076c0 1 -- 10.20.193.96:0/592332065 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe774110500 con 0x7fe774115440 2026-02-13T03:34:08.957 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.950+0000 7fe762ffd6c0 1 -- 10.20.193.96:0/592332065 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7fe7680028c0 con 0x7fe774115440 2026-02-13T03:34:08.957 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.951+0000 7fe762ffd6c0 1 --2- 10.20.193.96:0/592332065 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe7500b5680 0x7fe7500d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:08.957 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.951+0000 7fe779f786c0 1 --2- 10.20.193.96:0/592332065 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe7500b5680 0x7fe7500d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:08.957 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.951+0000 7fe762ffd6c0 1 -- 10.20.193.96:0/592332065 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6904+0+0 (secure 0 0 0) 0x7fe7680e35e0 con 0x7fe774115440 2026-02-13T03:34:08.957 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.951+0000 7fe779f786c0 1 --2- 10.20.193.96:0/592332065 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe7500b5680 0x7fe7500d5b30 secure :-1 s=READY pgs=160 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe764005980 tx=0x7fe764005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:08.957 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:08.951+0000 7fe762ffd6c0 1 -- 10.20.193.96:0/592332065 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe7680a64c0 con 0x7fe774115440 2026-02-13T03:34:09.066 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:09.063+0000 7fe77c2076c0 1 -- 10.20.193.96:0/592332065 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe77410f600 con 0x7fe774115440 2026-02-13T03:34:09.067 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:09.064+0000 7fe762ffd6c0 1 -- 10.20.193.96:0/592332065 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8877 (secure 0 0 0) 0x7fe7680a9670 con 0x7fe774115440 2026-02-13T03:34:09.067 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:09.068 INFO:teuthology.orchestra.run.trial096.stdout:{"epoch":10,"btime":"2026-02-13T03:34:08:086006+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.96:6835/392543675","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6834","nonce":392543675},{"type":"v1","addr":"10.20.193.96:6835","nonce":392543675}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.96:6837/1965017277","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6836","nonce":1965017277},{"type":"v1","addr":"10.20.193.96:6837","nonce":1965017277}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14763,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.96:6839/3941321429","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6838","nonce":3941321429},{"type":"v1","addr":"10.20.193.96:6839","nonce":3941321429}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.133:6833/1760340814","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6832","nonce":1760340814},{"type":"v1","addr":"10.20.193.133:6833","nonce":1760340814}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.132:6833/4227189143","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6832","nonce":4227189143},{"type":"v1","addr":"10.20.193.132:6833","nonce":4227189143}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.133:6835/2552443453","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6834","nonce":2552443453},{"type":"v1","addr":"10.20.193.133:6835","nonce":2552443453}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.133:6837/1508462977","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6836","nonce":1508462977},{"type":"v1","addr":"10.20.193.133:6837","nonce":1508462977}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.132:6835/4071682208","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6834","nonce":4071682208},{"type":"v1","addr":"10.20.193.132:6835","nonce":4071682208}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.133:6839/3735956625","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6838","nonce":3735956625},{"type":"v1","addr":"10.20.193.133:6839","nonce":3735956625}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24473,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.132:6837/768182548","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6836","nonce":768182548},{"type":"v1","addr":"10.20.193.132:6837","nonce":768182548}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2026-02-13T03:34:09.068 INFO:teuthology.orchestra.run.trial096.stderr:dumped fsmap epoch 10 2026-02-13T03:34:09.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:09.065+0000 7fe77c2076c0 1 -- 10.20.193.96:0/592332065 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe7500b5680 msgr2=0x7fe7500d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:09.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:09.065+0000 7fe77c2076c0 1 --2- 10.20.193.96:0/592332065 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe7500b5680 0x7fe7500d5b30 secure :-1 s=READY pgs=160 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe764005980 tx=0x7fe764005910 comp rx=0 tx=0).stop 2026-02-13T03:34:09.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:09.065+0000 7fe77c2076c0 1 -- 10.20.193.96:0/592332065 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe774115440 msgr2=0x7fe77411d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:09.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:09.065+0000 7fe77c2076c0 1 --2- 10.20.193.96:0/592332065 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe774115440 0x7fe77411d660 secure :-1 s=READY pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe768005dc0 tx=0x7fe76800bbb0 comp rx=0 tx=0).stop 2026-02-13T03:34:09.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:09.065+0000 7fe77c2076c0 1 -- 10.20.193.96:0/592332065 shutdown_connections 2026-02-13T03:34:09.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:09.065+0000 7fe77c2076c0 1 --2- 10.20.193.96:0/592332065 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe7500b5680 0x7fe7500d5b30 unknown :-1 s=CLOSED pgs=160 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:09.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:09.065+0000 7fe77c2076c0 1 --2- 10.20.193.96:0/592332065 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe774122a20 0x7fe774122ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:09.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:09.065+0000 7fe77c2076c0 1 --2- 10.20.193.96:0/592332065 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe774115440 0x7fe77411d660 unknown :-1 s=CLOSED pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:09.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:09.065+0000 7fe77c2076c0 1 --2- 10.20.193.96:0/592332065 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe77410f230 0x7fe77411d120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:09.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:09.065+0000 7fe77c2076c0 1 -- 10.20.193.96:0/592332065 >> 10.20.193.96:0/592332065 conn(0x7fe7740ecb30 msgr2=0x7fe77410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:09.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:09.065+0000 7fe77c2076c0 1 -- 10.20.193.96:0/592332065 shutdown_connections 2026-02-13T03:34:09.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:09.065+0000 7fe77c2076c0 1 -- 10.20.193.96:0/592332065 wait complete. 2026-02-13T03:34:09.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:09 trial096 ceph-mon[24671]: mds.? [v2:10.20.193.96:6838/3941321429,v1:10.20.193.96:6839/3941321429] up:boot 2026-02-13T03:34:09.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:09 trial096 ceph-mon[24671]: fsmap 10 up:standby 2026-02-13T03:34:09.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:09 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-13T03:34:09.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:09 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:09.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:09 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:09.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:09 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:09.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:09 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:09.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:09 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:09.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:09 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:09.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:09 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/592332065' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:34:09.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:09 trial132 ceph-mon[26888]: mds.? [v2:10.20.193.96:6838/3941321429,v1:10.20.193.96:6839/3941321429] up:boot 2026-02-13T03:34:09.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:09 trial132 ceph-mon[26888]: fsmap 10 up:standby 2026-02-13T03:34:09.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:09 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-13T03:34:09.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:09 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:09.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:09 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:09.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:09 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:09.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:09 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:09.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:09 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:09.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:09 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:09.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:09 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/592332065' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:34:09.484 INFO:journalctl@ceph.mds.b.trial132.stdout:Feb 13 03:34:09 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-b[55456]: starting mds.b at 2026-02-13T03:34:09.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:09 trial133 ceph-mon[26943]: mds.? [v2:10.20.193.96:6838/3941321429,v1:10.20.193.96:6839/3941321429] up:boot 2026-02-13T03:34:09.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:09 trial133 ceph-mon[26943]: fsmap 10 up:standby 2026-02-13T03:34:09.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:09 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-13T03:34:09.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:09 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:09.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:09 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:09.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:09 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:09.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:09 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:34:09.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:09 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:34:09.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:09 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:09.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:09 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/592332065' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:34:10.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:10 trial096 ceph-mon[24671]: mds.? [v2:10.20.193.96:6840/2510084239,v1:10.20.193.96:6841/2510084239] up:boot 2026-02-13T03:34:10.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:10 trial096 ceph-mon[24671]: fsmap 11 up:standby 2026-02-13T03:34:10.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:10 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-13T03:34:10.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:10 trial096 ceph-mon[24671]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:10.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:10 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:10.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:10 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:10.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:10 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:10.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:10 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:10.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:10 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:10.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:10 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:34:10.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:10 trial132 ceph-mon[26888]: mds.? [v2:10.20.193.96:6840/2510084239,v1:10.20.193.96:6841/2510084239] up:boot 2026-02-13T03:34:10.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:10 trial132 ceph-mon[26888]: fsmap 11 up:standby 2026-02-13T03:34:10.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:10 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-13T03:34:10.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:10 trial132 ceph-mon[26888]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:10.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:10 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:10.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:10 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:10.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:10 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:10.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:10 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:10.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:10 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:10.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:10 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:34:10.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:10 trial133 ceph-mon[26943]: mds.? [v2:10.20.193.96:6840/2510084239,v1:10.20.193.96:6841/2510084239] up:boot 2026-02-13T03:34:10.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:10 trial133 ceph-mon[26943]: fsmap 11 up:standby 2026-02-13T03:34:10.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:10 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-13T03:34:10.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:10 trial133 ceph-mon[26943]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:10.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:10 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:10.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:10 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:10.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:10 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:10.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:10 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:10.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:10 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:10.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:10 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:34:11.111 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T03:34:11.230 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:11.364 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.360+0000 7f3b3efcb6c0 1 -- 10.20.193.96:0/3684477328 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3b3810fbf0 msgr2=0x7f3b38114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:11.365 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.360+0000 7f3b3efcb6c0 1 --2- 10.20.193.96:0/3684477328 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3b3810fbf0 0x7f3b38114c30 secure :-1 s=READY pgs=211 gs=1 cs=0 l=1 c_cookie=14883315368394031701 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b200099a0 tx=0x7f3b2002ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:11.365 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.360+0000 7f3b3efcb6c0 1 -- 10.20.193.96:0/3684477328 shutdown_connections 2026-02-13T03:34:11.365 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.360+0000 7f3b3efcb6c0 1 --2- 10.20.193.96:0/3684477328 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3b38115410 0x7f3b38175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:11.365 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.360+0000 7f3b3efcb6c0 1 --2- 10.20.193.96:0/3684477328 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3b3810fbf0 0x7f3b38114c30 unknown :-1 s=CLOSED pgs=211 gs=1 cs=0 l=1 c_cookie=14883315368394031701 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:11.365 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.360+0000 7f3b3efcb6c0 1 --2- 10.20.193.96:0/3684477328 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3b3810f200 0x7f3b3810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:11.365 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.360+0000 7f3b3efcb6c0 1 -- 10.20.193.96:0/3684477328 >> 10.20.193.96:0/3684477328 conn(0x7f3b380ecb00 msgr2=0x7f3b3810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:11.365 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b3efcb6c0 1 -- 10.20.193.96:0/3684477328 shutdown_connections 2026-02-13T03:34:11.365 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b3efcb6c0 1 -- 10.20.193.96:0/3684477328 wait complete. 2026-02-13T03:34:11.365 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b3efcb6c0 1 Processor -- start 2026-02-13T03:34:11.366 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b3efcb6c0 1 -- start start 2026-02-13T03:34:11.366 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:11 trial096 ceph-mon[24671]: mds.? [v2:10.20.193.132:6838/1168876815,v1:10.20.193.132:6839/1168876815] up:boot 2026-02-13T03:34:11.366 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:11 trial096 ceph-mon[24671]: fsmap 12 up:standby 2026-02-13T03:34:11.366 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-13T03:34:11.366 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:11.366 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:11.366 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:11.366 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:11.367 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:11.367 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:11.367 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:11.367 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:34:11.367 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:11.367 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:11 trial096 ceph-mon[24671]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:11.367 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:34:11.367 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:34:11.367 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:11 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:11.369 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b3efcb6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3b3810f200 0x7f3b3811d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:11.370 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b3efcb6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3b38115410 0x7f3b3811d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:11.370 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b3efcb6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3b38122b50 0x7f3b38122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:11.370 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b3efcb6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3b38123530 con 0x7f3b3810f200 2026-02-13T03:34:11.370 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b3efcb6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3b381236a0 con 0x7f3b38115410 2026-02-13T03:34:11.370 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b3efcb6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3b38123860 con 0x7f3b38122b50 2026-02-13T03:34:11.370 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b3cd3c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3b3810f200 0x7f3b3811d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:11.370 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b3cd3c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3b3810f200 0x7f3b3811d250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:50954/0 (socket says 10.20.193.96:50954) 2026-02-13T03:34:11.370 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b3cd3c6c0 1 -- 10.20.193.96:0/3170697879 learned_addr learned my addr 10.20.193.96:0/3170697879 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:11.370 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b2ffff6c0 1 --2- 10.20.193.96:0/3170697879 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3b38115410 0x7f3b3811d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:11.370 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b3d53d6c0 1 --2- 10.20.193.96:0/3170697879 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3b38122b50 0x7f3b38122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:11.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b3cd3c6c0 1 -- 10.20.193.96:0/3170697879 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3b38122b50 msgr2=0x7f3b38122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:11.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b3cd3c6c0 1 --2- 10.20.193.96:0/3170697879 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3b38122b50 0x7f3b38122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:11.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b3cd3c6c0 1 -- 10.20.193.96:0/3170697879 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3b38115410 msgr2=0x7f3b3811d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:11.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b3cd3c6c0 1 --2- 10.20.193.96:0/3170697879 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3b38115410 0x7f3b3811d790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:11.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b3cd3c6c0 1 -- 10.20.193.96:0/3170697879 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b20009590 con 0x7f3b3810f200 2026-02-13T03:34:11.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b3cd3c6c0 1 --2- 10.20.193.96:0/3170697879 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3b3810f200 0x7f3b3811d250 secure :-1 s=READY pgs=212 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b2800b710 tx=0x7f3b2800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:11.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b2dffb6c0 1 -- 10.20.193.96:0/3170697879 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b28004250 con 0x7f3b3810f200 2026-02-13T03:34:11.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b3efcb6c0 1 -- 10.20.193.96:0/3170697879 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b38163ce0 con 0x7f3b3810f200 2026-02-13T03:34:11.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b2dffb6c0 1 -- 10.20.193.96:0/3170697879 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f3b28002da0 con 0x7f3b3810f200 2026-02-13T03:34:11.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.361+0000 7f3b2dffb6c0 1 -- 10.20.193.96:0/3170697879 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b2800ce30 con 0x7f3b3810f200 2026-02-13T03:34:11.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.362+0000 7f3b3efcb6c0 1 -- 10.20.193.96:0/3170697879 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b38164210 con 0x7f3b3810f200 2026-02-13T03:34:11.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.362+0000 7f3b3efcb6c0 1 -- 10.20.193.96:0/3170697879 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b381104d0 con 0x7f3b3810f200 2026-02-13T03:34:11.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.364+0000 7f3b2dffb6c0 1 -- 10.20.193.96:0/3170697879 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f3b280028c0 con 0x7f3b3810f200 2026-02-13T03:34:11.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.364+0000 7f3b2dffb6c0 1 --2- 10.20.193.96:0/3170697879 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f3b140b5600 0x7f3b140d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:11.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.364+0000 7f3b2ffff6c0 1 --2- 10.20.193.96:0/3170697879 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f3b140b5600 0x7f3b140d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:11.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.364+0000 7f3b2dffb6c0 1 -- 10.20.193.96:0/3170697879 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6904+0+0 (secure 0 0 0) 0x7f3b280e3780 con 0x7f3b3810f200 2026-02-13T03:34:11.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.365+0000 7f3b2ffff6c0 1 --2- 10.20.193.96:0/3170697879 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f3b140b5600 0x7f3b140d5ab0 secure :-1 s=READY pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b200023e0 tx=0x7f3b20005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:11.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.365+0000 7f3b2dffb6c0 1 -- 10.20.193.96:0/3170697879 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3b280a66a0 con 0x7f3b3810f200 2026-02-13T03:34:11.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:11 trial132 ceph-mon[26888]: mds.? [v2:10.20.193.132:6838/1168876815,v1:10.20.193.132:6839/1168876815] up:boot 2026-02-13T03:34:11.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:11 trial132 ceph-mon[26888]: fsmap 12 up:standby 2026-02-13T03:34:11.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-13T03:34:11.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:11.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:11.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:11.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:11.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:11.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:11.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:11.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:34:11.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:11.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:11 trial132 ceph-mon[26888]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:11.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:34:11.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:34:11.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:11 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:11.485 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.481+0000 7f3b3efcb6c0 1 -- 10.20.193.96:0/3170697879 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b3811e3a0 con 0x7f3b3810f200 2026-02-13T03:34:11.485 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.481+0000 7f3b2dffb6c0 1 -- 10.20.193.96:0/3170697879 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+10532 (secure 0 0 0) 0x7f3b280a9850 con 0x7f3b3810f200 2026-02-13T03:34:11.486 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:11.486 INFO:teuthology.orchestra.run.trial096.stdout:{"epoch":12,"btime":"2026-02-13T03:34:10:093335+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.96:6835/392543675","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6834","nonce":392543675},{"type":"v1","addr":"10.20.193.96:6835","nonce":392543675}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.96:6837/1965017277","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6836","nonce":1965017277},{"type":"v1","addr":"10.20.193.96:6837","nonce":1965017277}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14763,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.96:6839/3941321429","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6838","nonce":3941321429},{"type":"v1","addr":"10.20.193.96:6839","nonce":3941321429}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.96:6841/2510084239","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6840","nonce":2510084239},{"type":"v1","addr":"10.20.193.96:6841","nonce":2510084239}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.133:6833/1760340814","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6832","nonce":1760340814},{"type":"v1","addr":"10.20.193.133:6833","nonce":1760340814}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.132:6833/4227189143","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6832","nonce":4227189143},{"type":"v1","addr":"10.20.193.132:6833","nonce":4227189143}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.133:6835/2552443453","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6834","nonce":2552443453},{"type":"v1","addr":"10.20.193.133:6835","nonce":2552443453}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.133:6837/1508462977","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6836","nonce":1508462977},{"type":"v1","addr":"10.20.193.133:6837","nonce":1508462977}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.132:6835/4071682208","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6834","nonce":4071682208},{"type":"v1","addr":"10.20.193.132:6835","nonce":4071682208}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.133:6839/3735956625","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6838","nonce":3735956625},{"type":"v1","addr":"10.20.193.133:6839","nonce":3735956625}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24473,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.132:6837/768182548","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6836","nonce":768182548},{"type":"v1","addr":"10.20.193.132:6837","nonce":768182548}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24494,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.132:6839/1168876815","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6838","nonce":1168876815},{"type":"v1","addr":"10.20.193.132:6839","nonce":1168876815}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[]} 2026-02-13T03:34:11.487 INFO:teuthology.orchestra.run.trial096.stderr:dumped fsmap epoch 12 2026-02-13T03:34:11.487 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.483+0000 7f3b3efcb6c0 1 -- 10.20.193.96:0/3170697879 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f3b140b5600 msgr2=0x7f3b140d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:11.487 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.483+0000 7f3b3efcb6c0 1 --2- 10.20.193.96:0/3170697879 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f3b140b5600 0x7f3b140d5ab0 secure :-1 s=READY pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b200023e0 tx=0x7f3b20005c00 comp rx=0 tx=0).stop 2026-02-13T03:34:11.487 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.483+0000 7f3b3efcb6c0 1 -- 10.20.193.96:0/3170697879 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3b3810f200 msgr2=0x7f3b3811d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:11.487 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.483+0000 7f3b3efcb6c0 1 --2- 10.20.193.96:0/3170697879 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3b3810f200 0x7f3b3811d250 secure :-1 s=READY pgs=212 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b2800b710 tx=0x7f3b2800bbe0 comp rx=0 tx=0).stop 2026-02-13T03:34:11.487 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.483+0000 7f3b3efcb6c0 1 -- 10.20.193.96:0/3170697879 shutdown_connections 2026-02-13T03:34:11.487 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.483+0000 7f3b3efcb6c0 1 --2- 10.20.193.96:0/3170697879 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f3b140b5600 0x7f3b140d5ab0 unknown :-1 s=CLOSED pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:11.488 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.483+0000 7f3b3efcb6c0 1 --2- 10.20.193.96:0/3170697879 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3b38122b50 0x7f3b38122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:11.488 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.483+0000 7f3b3efcb6c0 1 --2- 10.20.193.96:0/3170697879 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3b38115410 0x7f3b3811d790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:11.488 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.483+0000 7f3b3efcb6c0 1 --2- 10.20.193.96:0/3170697879 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3b3810f200 0x7f3b3811d250 unknown :-1 s=CLOSED pgs=212 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:11.488 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.483+0000 7f3b3efcb6c0 1 -- 10.20.193.96:0/3170697879 >> 10.20.193.96:0/3170697879 conn(0x7f3b380ecb00 msgr2=0x7f3b3810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:11.488 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.483+0000 7f3b3efcb6c0 1 -- 10.20.193.96:0/3170697879 shutdown_connections 2026-02-13T03:34:11.488 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.483+0000 7f3b3efcb6c0 1 -- 10.20.193.96:0/3170697879 wait complete. 2026-02-13T03:34:11.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:11 trial133 ceph-mon[26943]: mds.? [v2:10.20.193.132:6838/1168876815,v1:10.20.193.132:6839/1168876815] up:boot 2026-02-13T03:34:11.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:11 trial133 ceph-mon[26943]: fsmap 12 up:standby 2026-02-13T03:34:11.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-13T03:34:11.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:11.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:11.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:11.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:11.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:11.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:11.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:11.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:34:11.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:11.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:11 trial133 ceph-mon[26943]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:11.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:34:11.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:34:11.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:11 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:11.548 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph --format=json-pretty osd lspools 2026-02-13T03:34:11.666 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:11.801 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.795+0000 7fcfdd5596c0 1 -- 10.20.193.96:0/3870986701 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcfd810fbf0 msgr2=0x7fcfd8114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:11.801 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.795+0000 7fcfdd5596c0 1 --2- 10.20.193.96:0/3870986701 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcfd810fbf0 0x7fcfd8114c30 secure :-1 s=READY pgs=213 gs=1 cs=0 l=1 c_cookie=8703599144730655226 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfc00099a0 tx=0x7fcfc002ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:11.801 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.795+0000 7fcfdd5596c0 1 -- 10.20.193.96:0/3870986701 shutdown_connections 2026-02-13T03:34:11.801 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.795+0000 7fcfdd5596c0 1 --2- 10.20.193.96:0/3870986701 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fcfd8115410 0x7fcfd8175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:11.801 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.795+0000 7fcfdd5596c0 1 --2- 10.20.193.96:0/3870986701 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcfd810fbf0 0x7fcfd8114c30 unknown :-1 s=CLOSED pgs=213 gs=1 cs=0 l=1 c_cookie=8703599144730655226 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:11.801 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.795+0000 7fcfdd5596c0 1 --2- 10.20.193.96:0/3870986701 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fcfd810f200 0x7fcfd810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:11.802 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.795+0000 7fcfdd5596c0 1 -- 10.20.193.96:0/3870986701 >> 10.20.193.96:0/3870986701 conn(0x7fcfd80ecb00 msgr2=0x7fcfd810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:11.802 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.795+0000 7fcfdd5596c0 1 -- 10.20.193.96:0/3870986701 shutdown_connections 2026-02-13T03:34:11.802 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.796+0000 7fcfdd5596c0 1 -- 10.20.193.96:0/3870986701 wait complete. 2026-02-13T03:34:11.802 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.796+0000 7fcfdd5596c0 1 Processor -- start 2026-02-13T03:34:11.802 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.796+0000 7fcfdd5596c0 1 -- start start 2026-02-13T03:34:11.802 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.796+0000 7fcfdd5596c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fcfd810f200 0x7fcfd811d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:11.802 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.796+0000 7fcfdd5596c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fcfd8115410 0x7fcfd811d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:11.802 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.796+0000 7fcfdd5596c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcfd8122ae0 0x7fcfd8122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:11.802 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.796+0000 7fcfdd5596c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd81234f0 con 0x7fcfd8122ae0 2026-02-13T03:34:11.802 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.796+0000 7fcfdd5596c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd8123660 con 0x7fcfd810f200 2026-02-13T03:34:11.802 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.796+0000 7fcfdd5596c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd8123820 con 0x7fcfd8115410 2026-02-13T03:34:11.802 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.796+0000 7fcfd77fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcfd8122ae0 0x7fcfd8122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:11.803 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.796+0000 7fcfd77fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcfd8122ae0 0x7fcfd8122f80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:50978/0 (socket says 10.20.193.96:50978) 2026-02-13T03:34:11.803 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.796+0000 7fcfd77fe6c0 1 -- 10.20.193.96:0/332812259 learned_addr learned my addr 10.20.193.96:0/332812259 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:11.803 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.796+0000 7fcfd67fc6c0 1 --2- 10.20.193.96:0/332812259 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fcfd8115410 0x7fcfd811d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:11.803 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.796+0000 7fcfd6ffd6c0 1 --2- 10.20.193.96:0/332812259 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fcfd810f200 0x7fcfd811d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:11.803 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.796+0000 7fcfd77fe6c0 1 -- 10.20.193.96:0/332812259 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fcfd8115410 msgr2=0x7fcfd811d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:11.803 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.796+0000 7fcfd77fe6c0 1 --2- 10.20.193.96:0/332812259 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fcfd8115410 0x7fcfd811d720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:11.803 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.796+0000 7fcfd77fe6c0 1 -- 10.20.193.96:0/332812259 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fcfd810f200 msgr2=0x7fcfd811d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:11.803 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.796+0000 7fcfd77fe6c0 1 --2- 10.20.193.96:0/332812259 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fcfd810f200 0x7fcfd811d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:11.803 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.796+0000 7fcfd77fe6c0 1 -- 10.20.193.96:0/332812259 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc0009590 con 0x7fcfd8122ae0 2026-02-13T03:34:11.803 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.796+0000 7fcfd77fe6c0 1 --2- 10.20.193.96:0/332812259 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcfd8122ae0 0x7fcfd8122f80 secure :-1 s=READY pgs=214 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfc8006ea0 tx=0x7fcfc800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:11.803 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.797+0000 7fcfb3fff6c0 1 -- 10.20.193.96:0/332812259 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcfc8003a30 con 0x7fcfd8122ae0 2026-02-13T03:34:11.803 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.797+0000 7fcfb3fff6c0 1 -- 10.20.193.96:0/332812259 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fcfc8005510 con 0x7fcfd8122ae0 2026-02-13T03:34:11.804 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.797+0000 7fcfdd5596c0 1 -- 10.20.193.96:0/332812259 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfd8163cd0 con 0x7fcfd8122ae0 2026-02-13T03:34:11.804 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.797+0000 7fcfb3fff6c0 1 -- 10.20.193.96:0/332812259 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcfc800dd70 con 0x7fcfd8122ae0 2026-02-13T03:34:11.804 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.797+0000 7fcfdd5596c0 1 -- 10.20.193.96:0/332812259 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfd8164160 con 0x7fcfd8122ae0 2026-02-13T03:34:11.804 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.797+0000 7fcfdd5596c0 1 -- 10.20.193.96:0/332812259 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfd81104d0 con 0x7fcfd8122ae0 2026-02-13T03:34:11.805 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.798+0000 7fcfb3fff6c0 1 -- 10.20.193.96:0/332812259 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7fcfc8003b90 con 0x7fcfd8122ae0 2026-02-13T03:34:11.805 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.799+0000 7fcfb3fff6c0 1 --2- 10.20.193.96:0/332812259 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcfac0b5600 0x7fcfac0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:11.805 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.799+0000 7fcfb3fff6c0 1 -- 10.20.193.96:0/332812259 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6904+0+0 (secure 0 0 0) 0x7fcfc80e4740 con 0x7fcfd8122ae0 2026-02-13T03:34:11.805 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.799+0000 7fcfd6ffd6c0 1 --2- 10.20.193.96:0/332812259 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcfac0b5600 0x7fcfac0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:11.805 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.799+0000 7fcfd6ffd6c0 1 --2- 10.20.193.96:0/332812259 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcfac0b5600 0x7fcfac0d5ab0 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfcc005980 tx=0x7fcfcc005ee0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:11.805 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.800+0000 7fcfb3fff6c0 1 -- 10.20.193.96:0/332812259 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fcfc80a7620 con 0x7fcfd8122ae0 2026-02-13T03:34:11.900 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.897+0000 7fcfdd5596c0 1 -- 10.20.193.96:0/332812259 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fcfd811e360 con 0x7fcfd8122ae0 2026-02-13T03:34:11.900 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.897+0000 7fcfb3fff6c0 1 -- 10.20.193.96:0/332812259 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v64) ==== 84+0+65 (secure 0 0 0) 0x7fcfc80aa7d0 con 0x7fcfd8122ae0 2026-02-13T03:34:11.900 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:11.900 INFO:teuthology.orchestra.run.trial096.stdout:[ 2026-02-13T03:34:11.901 INFO:teuthology.orchestra.run.trial096.stdout: { 2026-02-13T03:34:11.901 INFO:teuthology.orchestra.run.trial096.stdout: "poolnum": 1, 2026-02-13T03:34:11.901 INFO:teuthology.orchestra.run.trial096.stdout: "poolname": ".mgr" 2026-02-13T03:34:11.901 INFO:teuthology.orchestra.run.trial096.stdout: } 2026-02-13T03:34:11.901 INFO:teuthology.orchestra.run.trial096.stdout:] 2026-02-13T03:34:11.902 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.899+0000 7fcfdd5596c0 1 -- 10.20.193.96:0/332812259 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcfac0b5600 msgr2=0x7fcfac0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:11.902 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.899+0000 7fcfdd5596c0 1 --2- 10.20.193.96:0/332812259 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcfac0b5600 0x7fcfac0d5ab0 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfcc005980 tx=0x7fcfcc005ee0 comp rx=0 tx=0).stop 2026-02-13T03:34:11.902 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.899+0000 7fcfdd5596c0 1 -- 10.20.193.96:0/332812259 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcfd8122ae0 msgr2=0x7fcfd8122f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:11.902 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.899+0000 7fcfdd5596c0 1 --2- 10.20.193.96:0/332812259 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcfd8122ae0 0x7fcfd8122f80 secure :-1 s=READY pgs=214 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfc8006ea0 tx=0x7fcfc800cca0 comp rx=0 tx=0).stop 2026-02-13T03:34:11.902 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.899+0000 7fcfdd5596c0 1 -- 10.20.193.96:0/332812259 shutdown_connections 2026-02-13T03:34:11.903 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.899+0000 7fcfdd5596c0 1 --2- 10.20.193.96:0/332812259 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcfac0b5600 0x7fcfac0d5ab0 unknown :-1 s=CLOSED pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:11.903 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.899+0000 7fcfdd5596c0 1 --2- 10.20.193.96:0/332812259 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcfd8122ae0 0x7fcfd8122f80 unknown :-1 s=CLOSED pgs=214 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:11.903 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.899+0000 7fcfdd5596c0 1 --2- 10.20.193.96:0/332812259 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fcfd8115410 0x7fcfd811d720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:11.903 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.899+0000 7fcfdd5596c0 1 --2- 10.20.193.96:0/332812259 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fcfd810f200 0x7fcfd811d1e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:11.903 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.899+0000 7fcfdd5596c0 1 -- 10.20.193.96:0/332812259 >> 10.20.193.96:0/332812259 conn(0x7fcfd80ecb00 msgr2=0x7fcfd810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:11.903 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.899+0000 7fcfdd5596c0 1 -- 10.20.193.96:0/332812259 shutdown_connections 2026-02-13T03:34:11.903 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:11.899+0000 7fcfdd5596c0 1 -- 10.20.193.96:0/332812259 wait complete. 2026-02-13T03:34:11.964 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2026-02-13T03:34:11.964 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2026-02-13T03:34:12.081 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:12.196 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:12 trial096 ceph-mon[24671]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:12.196 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:12 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:34:12.196 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:12 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3170697879' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:34:12.196 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:12 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/332812259' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-13T03:34:12.196 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:12 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:12.196 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:12 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:12.196 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:12 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:12.196 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:12 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:12.196 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:12 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:12.196 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:12 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:12.197 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:12 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:12.197 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:12 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:34:12.197 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:12 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:12.197 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:12 trial096 ceph-mon[24671]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:12.197 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:12 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:34:12.197 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:12 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:34:12.197 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:12 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:12.201 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.196+0000 7fc06f7ac6c0 1 -- 10.20.193.96:0/2828804571 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc06810f200 msgr2=0x7fc06810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:12.201 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.196+0000 7fc06f7ac6c0 1 --2- 10.20.193.96:0/2828804571 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc06810f200 0x7fc06810f5d0 secure :-1 s=READY pgs=215 gs=1 cs=0 l=1 c_cookie=16540966885767895594 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0580099a0 tx=0x7fc05802ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:12.202 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.196+0000 7fc06f7ac6c0 1 -- 10.20.193.96:0/2828804571 shutdown_connections 2026-02-13T03:34:12.202 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.196+0000 7fc06f7ac6c0 1 --2- 10.20.193.96:0/2828804571 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc068115410 0x7fc068175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:12.202 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.196+0000 7fc06f7ac6c0 1 --2- 10.20.193.96:0/2828804571 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fc06810fbf0 0x7fc068114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:12.202 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.196+0000 7fc06f7ac6c0 1 --2- 10.20.193.96:0/2828804571 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc06810f200 0x7fc06810f5d0 unknown :-1 s=CLOSED pgs=215 gs=1 cs=0 l=1 c_cookie=16540966885767895594 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:12.202 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.196+0000 7fc06f7ac6c0 1 -- 10.20.193.96:0/2828804571 >> 10.20.193.96:0/2828804571 conn(0x7fc0680ecb00 msgr2=0x7fc06810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:12.202 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.196+0000 7fc06f7ac6c0 1 -- 10.20.193.96:0/2828804571 shutdown_connections 2026-02-13T03:34:12.202 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.196+0000 7fc06f7ac6c0 1 -- 10.20.193.96:0/2828804571 wait complete. 2026-02-13T03:34:12.202 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc06f7ac6c0 1 Processor -- start 2026-02-13T03:34:12.202 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc06f7ac6c0 1 -- start start 2026-02-13T03:34:12.202 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc06f7ac6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc06810f200 0x7fc06811d2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:12.202 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc06f7ac6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc068115410 0x7fc06811d7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:12.203 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc06f7ac6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fc068122bb0 0x7fc068123050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:12.203 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc06f7ac6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc068123590 con 0x7fc068115410 2026-02-13T03:34:12.203 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc06f7ac6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc068123700 con 0x7fc06810f200 2026-02-13T03:34:12.203 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc06f7ac6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc0681238c0 con 0x7fc068122bb0 2026-02-13T03:34:12.203 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc06cd1c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc068115410 0x7fc06811d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:12.203 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc06cd1c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc068115410 0x7fc06811d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:50992/0 (socket says 10.20.193.96:50992) 2026-02-13T03:34:12.203 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc06cd1c6c0 1 -- 10.20.193.96:0/4263998874 learned_addr learned my addr 10.20.193.96:0/4263998874 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:12.203 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc06d51d6c0 1 --2- 10.20.193.96:0/4263998874 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc06810f200 0x7fc06811d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:12.203 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc06dd1e6c0 1 --2- 10.20.193.96:0/4263998874 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fc068122bb0 0x7fc068123050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:12.203 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc06cd1c6c0 1 -- 10.20.193.96:0/4263998874 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fc068122bb0 msgr2=0x7fc068123050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:12.203 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc06cd1c6c0 1 --2- 10.20.193.96:0/4263998874 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fc068122bb0 0x7fc068123050 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:12.203 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc06cd1c6c0 1 -- 10.20.193.96:0/4263998874 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc06810f200 msgr2=0x7fc06811d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:12.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc06cd1c6c0 1 --2- 10.20.193.96:0/4263998874 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc06810f200 0x7fc06811d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:12.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc06cd1c6c0 1 -- 10.20.193.96:0/4263998874 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc058009590 con 0x7fc068115410 2026-02-13T03:34:12.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc06cd1c6c0 1 --2- 10.20.193.96:0/4263998874 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc068115410 0x7fc06811d7f0 secure :-1 s=READY pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc05c005dc0 tx=0x7fc05c00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:12.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc0567fc6c0 1 -- 10.20.193.96:0/4263998874 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc05c004250 con 0x7fc068115410 2026-02-13T03:34:12.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc0567fc6c0 1 -- 10.20.193.96:0/4263998874 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fc05c009070 con 0x7fc068115410 2026-02-13T03:34:12.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc06f7ac6c0 1 -- 10.20.193.96:0/4263998874 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc068163d40 con 0x7fc068115410 2026-02-13T03:34:12.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc0567fc6c0 1 -- 10.20.193.96:0/4263998874 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc05c00cdb0 con 0x7fc068115410 2026-02-13T03:34:12.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc06f7ac6c0 1 -- 10.20.193.96:0/4263998874 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc068164270 con 0x7fc068115410 2026-02-13T03:34:12.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.197+0000 7fc06f7ac6c0 1 -- 10.20.193.96:0/4263998874 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0681104d0 con 0x7fc068115410 2026-02-13T03:34:12.205 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.199+0000 7fc0567fc6c0 1 -- 10.20.193.96:0/4263998874 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7fc05c0028c0 con 0x7fc068115410 2026-02-13T03:34:12.205 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.200+0000 7fc0567fc6c0 1 --2- 10.20.193.96:0/4263998874 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fc0440b5680 0x7fc0440d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:12.205 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.200+0000 7fc06d51d6c0 1 --2- 10.20.193.96:0/4263998874 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fc0440b5680 0x7fc0440d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:12.206 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.200+0000 7fc0567fc6c0 1 -- 10.20.193.96:0/4263998874 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6904+0+0 (secure 0 0 0) 0x7fc05c0e3550 con 0x7fc068115410 2026-02-13T03:34:12.206 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.200+0000 7fc0567fc6c0 1 -- 10.20.193.96:0/4263998874 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc05c0a95e0 con 0x7fc068115410 2026-02-13T03:34:12.206 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.200+0000 7fc06d51d6c0 1 --2- 10.20.193.96:0/4263998874 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fc0440b5680 0x7fc0440d5b30 secure :-1 s=READY pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0580023e0 tx=0x7fc058005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:12.293 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:12.290+0000 7fc06f7ac6c0 1 -- 10.20.193.96:0/4263998874 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc06810f5d0 con 0x7fc068115410 2026-02-13T03:34:12.362 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:12 trial133 ceph-mon[26943]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:12.362 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:12 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:34:12.362 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:12 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3170697879' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:34:12.362 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:12 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/332812259' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-13T03:34:12.362 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:12 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:12.362 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:12 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:12.362 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:12 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:12.362 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:12 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:12.363 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:12 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:12.363 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:12 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:12.363 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:12 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:12.363 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:12 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:34:12.363 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:12 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:12.363 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:12 trial133 ceph-mon[26943]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:12.363 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:12 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:34:12.363 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:12 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:34:12.363 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:12 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:12.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:12 trial132 ceph-mon[26888]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:12.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:12 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:34:12.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:12 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3170697879' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:34:12.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:12 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/332812259' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-13T03:34:12.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:12 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:12.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:12 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:12.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:12 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:12.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:12 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:12.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:12 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:12.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:12 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:12.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:12 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:12.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:12 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:34:12.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:12 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:12.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:12 trial132 ceph-mon[26888]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:12.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:12 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:34:12.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:12 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:34:12.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:12 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:34:13.103 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.100+0000 7fc0567fc6c0 1 -- 10.20.193.96:0/4263998874 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v65) ==== 138+0+0 (secure 0 0 0) 0x7fc05c0a97c0 con 0x7fc068115410 2026-02-13T03:34:13.104 INFO:teuthology.orchestra.run.trial096.stderr:pool 'cephfs_metadata' created 2026-02-13T03:34:13.107 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.103+0000 7fc06f7ac6c0 1 -- 10.20.193.96:0/4263998874 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fc0440b5680 msgr2=0x7fc0440d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:13.107 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.103+0000 7fc06f7ac6c0 1 --2- 10.20.193.96:0/4263998874 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fc0440b5680 0x7fc0440d5b30 secure :-1 s=READY pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0580023e0 tx=0x7fc058005c00 comp rx=0 tx=0).stop 2026-02-13T03:34:13.107 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.103+0000 7fc06f7ac6c0 1 -- 10.20.193.96:0/4263998874 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc068115410 msgr2=0x7fc06811d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:13.107 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.103+0000 7fc06f7ac6c0 1 --2- 10.20.193.96:0/4263998874 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc068115410 0x7fc06811d7f0 secure :-1 s=READY pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc05c005dc0 tx=0x7fc05c00bbb0 comp rx=0 tx=0).stop 2026-02-13T03:34:13.107 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.103+0000 7fc06f7ac6c0 1 -- 10.20.193.96:0/4263998874 shutdown_connections 2026-02-13T03:34:13.107 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.103+0000 7fc06f7ac6c0 1 --2- 10.20.193.96:0/4263998874 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fc0440b5680 0x7fc0440d5b30 unknown :-1 s=CLOSED pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:13.107 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.103+0000 7fc06f7ac6c0 1 --2- 10.20.193.96:0/4263998874 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fc068122bb0 0x7fc068123050 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:13.108 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.103+0000 7fc06f7ac6c0 1 --2- 10.20.193.96:0/4263998874 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc068115410 0x7fc06811d7f0 unknown :-1 s=CLOSED pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:13.108 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.103+0000 7fc06f7ac6c0 1 --2- 10.20.193.96:0/4263998874 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc06810f200 0x7fc06811d2b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:13.108 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.103+0000 7fc06f7ac6c0 1 -- 10.20.193.96:0/4263998874 >> 10.20.193.96:0/4263998874 conn(0x7fc0680ecb00 msgr2=0x7fc06810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:13.108 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.103+0000 7fc06f7ac6c0 1 -- 10.20.193.96:0/4263998874 shutdown_connections 2026-02-13T03:34:13.108 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.103+0000 7fc06f7ac6c0 1 -- 10.20.193.96:0/4263998874 wait complete. 2026-02-13T03:34:13.147 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2026-02-13T03:34:13.263 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:13.378 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:13 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/4263998874' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T03:34:13.378 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:13 trial096 ceph-mon[24671]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:13.379 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:13.384 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.381+0000 7efef81346c0 1 -- 10.20.193.96:0/3049859288 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efef010f200 msgr2=0x7efef010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:13.384 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.381+0000 7efef81346c0 1 --2- 10.20.193.96:0/3049859288 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efef010f200 0x7efef010f5d0 secure :-1 s=READY pgs=217 gs=1 cs=0 l=1 c_cookie=3459538803162097613 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efee00099a0 tx=0x7efee002ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:13.384 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.381+0000 7efef81346c0 1 -- 10.20.193.96:0/3049859288 shutdown_connections 2026-02-13T03:34:13.384 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.381+0000 7efef81346c0 1 --2- 10.20.193.96:0/3049859288 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efef0115410 0x7efef0175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:13.384 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.381+0000 7efef81346c0 1 --2- 10.20.193.96:0/3049859288 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efef010fbf0 0x7efef0114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:13.385 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.381+0000 7efef81346c0 1 --2- 10.20.193.96:0/3049859288 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efef010f200 0x7efef010f5d0 unknown :-1 s=CLOSED pgs=217 gs=1 cs=0 l=1 c_cookie=3459538803162097613 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:13.385 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.381+0000 7efef81346c0 1 -- 10.20.193.96:0/3049859288 >> 10.20.193.96:0/3049859288 conn(0x7efef00ecb00 msgr2=0x7efef010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:13.385 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.381+0000 7efef81346c0 1 -- 10.20.193.96:0/3049859288 shutdown_connections 2026-02-13T03:34:13.385 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.381+0000 7efef81346c0 1 -- 10.20.193.96:0/3049859288 wait complete. 2026-02-13T03:34:13.385 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:13 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/4263998874' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T03:34:13.386 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:13 trial132 ceph-mon[26888]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:13.386 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:13 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:13.388 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.381+0000 7efef81346c0 1 Processor -- start 2026-02-13T03:34:13.388 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.381+0000 7efef81346c0 1 -- start start 2026-02-13T03:34:13.388 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.382+0000 7efef81346c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efef010f200 0x7efef011d150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:13.388 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.382+0000 7efef81346c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efef0115410 0x7efef011d690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:13.388 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.382+0000 7efef81346c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efef0122a50 0x7efef0122ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:13.388 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.382+0000 7efef81346c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7efef0123460 con 0x7efef010f200 2026-02-13T03:34:13.388 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.382+0000 7efef81346c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7efef01235d0 con 0x7efef0122a50 2026-02-13T03:34:13.388 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.382+0000 7efef81346c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7efef0123790 con 0x7efef0115410 2026-02-13T03:34:13.388 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.382+0000 7efef5ea56c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efef010f200 0x7efef011d150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:13.389 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.382+0000 7efef5ea56c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efef010f200 0x7efef011d150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49688/0 (socket says 10.20.193.96:49688) 2026-02-13T03:34:13.389 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.382+0000 7efef5ea56c0 1 -- 10.20.193.96:0/3488962582 learned_addr learned my addr 10.20.193.96:0/3488962582 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:13.389 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.382+0000 7efef5ea56c0 1 -- 10.20.193.96:0/3488962582 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efef0115410 msgr2=0x7efef011d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:13.389 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.382+0000 7efef5ea56c0 1 --2- 10.20.193.96:0/3488962582 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efef0115410 0x7efef011d690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:13.389 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.382+0000 7efef5ea56c0 1 -- 10.20.193.96:0/3488962582 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efef0122a50 msgr2=0x7efef0122ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:13.389 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.382+0000 7efef5ea56c0 1 --2- 10.20.193.96:0/3488962582 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efef0122a50 0x7efef0122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:13.389 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.382+0000 7efef5ea56c0 1 -- 10.20.193.96:0/3488962582 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee0009590 con 0x7efef010f200 2026-02-13T03:34:13.389 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.382+0000 7efef5ea56c0 1 --2- 10.20.193.96:0/3488962582 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efef010f200 0x7efef011d150 secure :-1 s=READY pgs=218 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efee00098c0 tx=0x7efee002fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:13.389 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.382+0000 7efedeffd6c0 1 -- 10.20.193.96:0/3488962582 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efee0002ba0 con 0x7efef010f200 2026-02-13T03:34:13.389 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.382+0000 7efedeffd6c0 1 -- 10.20.193.96:0/3488962582 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7efee0002d00 con 0x7efef010f200 2026-02-13T03:34:13.389 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.382+0000 7efedeffd6c0 1 -- 10.20.193.96:0/3488962582 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efee0037410 con 0x7efef010f200 2026-02-13T03:34:13.389 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.382+0000 7efef81346c0 1 -- 10.20.193.96:0/3488962582 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efef0163be0 con 0x7efef010f200 2026-02-13T03:34:13.390 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.382+0000 7efef81346c0 1 -- 10.20.193.96:0/3488962582 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efef0164060 con 0x7efef010f200 2026-02-13T03:34:13.390 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.382+0000 7efef81346c0 1 -- 10.20.193.96:0/3488962582 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efef01104d0 con 0x7efef010f200 2026-02-13T03:34:13.390 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.384+0000 7efedeffd6c0 1 -- 10.20.193.96:0/3488962582 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7efee0007ad0 con 0x7efef010f200 2026-02-13T03:34:13.390 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.385+0000 7efedeffd6c0 1 --2- 10.20.193.96:0/3488962582 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efecc0b5680 0x7efecc0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:13.391 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.385+0000 7efef56a46c0 1 --2- 10.20.193.96:0/3488962582 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efecc0b5680 0x7efecc0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:13.391 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.385+0000 7efedeffd6c0 1 -- 10.20.193.96:0/3488962582 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7277+0+0 (secure 0 0 0) 0x7efee0107b70 con 0x7efef010f200 2026-02-13T03:34:13.391 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.385+0000 7efedeffd6c0 1 -- 10.20.193.96:0/3488962582 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7efee00ce340 con 0x7efef010f200 2026-02-13T03:34:13.391 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.385+0000 7efef56a46c0 1 --2- 10.20.193.96:0/3488962582 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efecc0b5680 0x7efecc0d5b30 secure :-1 s=READY pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efef0123ae0 tx=0x7efee4005cb0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:13.479 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:13.476+0000 7efef81346c0 1 -- 10.20.193.96:0/3488962582 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7efef010fbf0 con 0x7efef010f200 2026-02-13T03:34:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:13 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/4263998874' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T03:34:13.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:13 trial133 ceph-mon[26943]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:13.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:34:14.105 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.102+0000 7efedeffd6c0 1 -- 10.20.193.96:0/3488962582 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v66) ==== 170+0+0 (secure 0 0 0) 0x7efee00d03b0 con 0x7efef010f200 2026-02-13T03:34:14.105 INFO:teuthology.orchestra.run.trial096.stderr:pool 'cephfs_data' created 2026-02-13T03:34:14.107 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.103+0000 7efef81346c0 1 -- 10.20.193.96:0/3488962582 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efecc0b5680 msgr2=0x7efecc0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:14.107 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.103+0000 7efef81346c0 1 --2- 10.20.193.96:0/3488962582 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efecc0b5680 0x7efecc0d5b30 secure :-1 s=READY pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efef0123ae0 tx=0x7efee4005cb0 comp rx=0 tx=0).stop 2026-02-13T03:34:14.107 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.103+0000 7efef81346c0 1 -- 10.20.193.96:0/3488962582 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efef010f200 msgr2=0x7efef011d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:14.107 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.103+0000 7efef81346c0 1 --2- 10.20.193.96:0/3488962582 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efef010f200 0x7efef011d150 secure :-1 s=READY pgs=218 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efee00098c0 tx=0x7efee002fce0 comp rx=0 tx=0).stop 2026-02-13T03:34:14.107 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.103+0000 7efef81346c0 1 -- 10.20.193.96:0/3488962582 shutdown_connections 2026-02-13T03:34:14.107 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.103+0000 7efef81346c0 1 --2- 10.20.193.96:0/3488962582 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efecc0b5680 0x7efecc0d5b30 unknown :-1 s=CLOSED pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:14.107 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.104+0000 7efef81346c0 1 --2- 10.20.193.96:0/3488962582 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efef0122a50 0x7efef0122ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:14.108 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.104+0000 7efef81346c0 1 --2- 10.20.193.96:0/3488962582 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efef0115410 0x7efef011d690 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:14.108 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.104+0000 7efef81346c0 1 --2- 10.20.193.96:0/3488962582 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efef010f200 0x7efef011d150 unknown :-1 s=CLOSED pgs=218 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:14.108 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.104+0000 7efef81346c0 1 -- 10.20.193.96:0/3488962582 >> 10.20.193.96:0/3488962582 conn(0x7efef00ecb00 msgr2=0x7efef010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:14.108 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.104+0000 7efef81346c0 1 -- 10.20.193.96:0/3488962582 shutdown_connections 2026-02-13T03:34:14.108 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.104+0000 7efef81346c0 1 -- 10.20.193.96:0/3488962582 wait complete. 2026-02-13T03:34:14.150 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph fs new cephfs cephfs_metadata cephfs_data 2026-02-13T03:34:14.269 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:14.381 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.377+0000 7f0d61eef6c0 1 -- 10.20.193.96:0/3625961694 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0d5c10cfb0 msgr2=0x7f0d5c10d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:14.381 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.377+0000 7f0d61eef6c0 1 --2- 10.20.193.96:0/3625961694 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0d5c10cfb0 0x7f0d5c10d380 secure :-1 s=READY pgs=219 gs=1 cs=0 l=1 c_cookie=14903334039050555230 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d480099a0 tx=0x7f0d4802ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:14.381 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d61eef6c0 1 -- 10.20.193.96:0/3625961694 shutdown_connections 2026-02-13T03:34:14.381 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d61eef6c0 1 --2- 10.20.193.96:0/3625961694 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0d5c1131c0 0x7f0d5c173b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:14.381 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d61eef6c0 1 --2- 10.20.193.96:0/3625961694 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0d5c10d9a0 0x7f0d5c1129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:14.381 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d61eef6c0 1 --2- 10.20.193.96:0/3625961694 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0d5c10cfb0 0x7f0d5c10d380 unknown :-1 s=CLOSED pgs=219 gs=1 cs=0 l=1 c_cookie=14903334039050555230 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:14.381 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d61eef6c0 1 -- 10.20.193.96:0/3625961694 >> 10.20.193.96:0/3625961694 conn(0x7f0d5c0ea8b0 msgr2=0x7f0d5c10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:14.381 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d61eef6c0 1 -- 10.20.193.96:0/3625961694 shutdown_connections 2026-02-13T03:34:14.382 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d61eef6c0 1 -- 10.20.193.96:0/3625961694 wait complete. 2026-02-13T03:34:14.382 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:14 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/4263998874' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-13T03:34:14.382 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:14 trial096 ceph-mon[24671]: osdmap e65: 12 total, 12 up, 12 in 2026-02-13T03:34:14.382 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:14 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3488962582' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T03:34:14.385 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d61eef6c0 1 Processor -- start 2026-02-13T03:34:14.385 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d61eef6c0 1 -- start start 2026-02-13T03:34:14.385 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d61eef6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0d5c10cfb0 0x7f0d5c060700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:14.385 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d61eef6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0d5c1131c0 0x7f0d5c060c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:14.386 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d61eef6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0d5c061180 0x7f0d5c1632f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:14.386 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d61eef6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c163830 con 0x7f0d5c1131c0 2026-02-13T03:34:14.386 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d61eef6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c1639a0 con 0x7f0d5c10cfb0 2026-02-13T03:34:14.386 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d61eef6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c163b60 con 0x7f0d5c061180 2026-02-13T03:34:14.386 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d5affd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0d5c1131c0 0x7f0d5c060c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:14.386 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d5affd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0d5c1131c0 0x7f0d5c060c40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49702/0 (socket says 10.20.193.96:49702) 2026-02-13T03:34:14.386 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d5affd6c0 1 -- 10.20.193.96:0/2183724371 learned_addr learned my addr 10.20.193.96:0/2183724371 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:14.386 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d5affd6c0 1 -- 10.20.193.96:0/2183724371 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0d5c061180 msgr2=0x7f0d5c1632f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:14.386 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d5bfff6c0 1 --2- 10.20.193.96:0/2183724371 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0d5c061180 0x7f0d5c1632f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:14.386 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d5affd6c0 1 --2- 10.20.193.96:0/2183724371 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0d5c061180 0x7f0d5c1632f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:14.386 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d5b7fe6c0 1 --2- 10.20.193.96:0/2183724371 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0d5c10cfb0 0x7f0d5c060700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:14.386 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d5affd6c0 1 -- 10.20.193.96:0/2183724371 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0d5c10cfb0 msgr2=0x7f0d5c060700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:14.387 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d5affd6c0 1 --2- 10.20.193.96:0/2183724371 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0d5c10cfb0 0x7f0d5c060700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:14.387 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d5affd6c0 1 -- 10.20.193.96:0/2183724371 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d48009590 con 0x7f0d5c1131c0 2026-02-13T03:34:14.387 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.379+0000 7f0d5b7fe6c0 1 --2- 10.20.193.96:0/2183724371 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0d5c10cfb0 0x7f0d5c060700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:34:14.387 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.378+0000 7f0d5bfff6c0 1 --2- 10.20.193.96:0/2183724371 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0d5c061180 0x7f0d5c1632f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:34:14.387 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.379+0000 7f0d5affd6c0 1 --2- 10.20.193.96:0/2183724371 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0d5c1131c0 0x7f0d5c060c40 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d4c005dc0 tx=0x7f0d4c00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:14.387 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.379+0000 7f0d58ff96c0 1 -- 10.20.193.96:0/2183724371 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0d4c004250 con 0x7f0d5c1131c0 2026-02-13T03:34:14.387 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.379+0000 7f0d58ff96c0 1 -- 10.20.193.96:0/2183724371 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f0d4c009070 con 0x7f0d5c1131c0 2026-02-13T03:34:14.387 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.379+0000 7f0d61eef6c0 1 -- 10.20.193.96:0/2183724371 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d5c163e40 con 0x7f0d5c1131c0 2026-02-13T03:34:14.387 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.379+0000 7f0d58ff96c0 1 -- 10.20.193.96:0/2183724371 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0d4c00cdb0 con 0x7f0d5c1131c0 2026-02-13T03:34:14.387 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.379+0000 7f0d61eef6c0 1 -- 10.20.193.96:0/2183724371 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d5c164320 con 0x7f0d5c1131c0 2026-02-13T03:34:14.387 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.379+0000 7f0d61eef6c0 1 -- 10.20.193.96:0/2183724371 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d5c10e280 con 0x7f0d5c1131c0 2026-02-13T03:34:14.387 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.381+0000 7f0d58ff96c0 1 -- 10.20.193.96:0/2183724371 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f0d4c0028c0 con 0x7f0d5c1131c0 2026-02-13T03:34:14.388 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.381+0000 7f0d58ff96c0 1 --2- 10.20.193.96:0/2183724371 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f0d300b5600 0x7f0d300d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:14.388 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.381+0000 7f0d58ff96c0 1 -- 10.20.193.96:0/2183724371 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7662+0+0 (secure 0 0 0) 0x7f0d4c0e3880 con 0x7f0d5c1131c0 2026-02-13T03:34:14.388 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.381+0000 7f0d5b7fe6c0 1 --2- 10.20.193.96:0/2183724371 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f0d300b5600 0x7f0d300d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:14.388 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.382+0000 7f0d5b7fe6c0 1 --2- 10.20.193.96:0/2183724371 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f0d300b5600 0x7f0d300d5ab0 secure :-1 s=READY pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d480098c0 tx=0x7f0d480091a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:14.388 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.382+0000 7f0d58ff96c0 1 -- 10.20.193.96:0/2183724371 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0d4c0a64b0 con 0x7f0d5c1131c0 2026-02-13T03:34:14.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:14 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/4263998874' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-13T03:34:14.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:14 trial132 ceph-mon[26888]: osdmap e65: 12 total, 12 up, 12 in 2026-02-13T03:34:14.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:14 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3488962582' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T03:34:14.498 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:14.495+0000 7f0d61eef6c0 1 -- 10.20.193.96:0/2183724371 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0d5c10d380 con 0x7f0d5c1131c0 2026-02-13T03:34:14.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:14 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/4263998874' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-13T03:34:14.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:14 trial133 ceph-mon[26943]: osdmap e65: 12 total, 12 up, 12 in 2026-02-13T03:34:14.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:14 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3488962582' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T03:34:15.116 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.112+0000 7f0d58ff96c0 1 -- 10.20.193.96:0/2183724371 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v13) ==== 172+0+0 (secure 0 0 0) 0x7f0d4c0a9660 con 0x7f0d5c1131c0 2026-02-13T03:34:15.116 INFO:teuthology.orchestra.run.trial096.stderr:new fs with metadata pool 2 and data pool 3 2026-02-13T03:34:15.120 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.117+0000 7f0d61eef6c0 1 -- 10.20.193.96:0/2183724371 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f0d300b5600 msgr2=0x7f0d300d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:15.120 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.117+0000 7f0d61eef6c0 1 --2- 10.20.193.96:0/2183724371 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f0d300b5600 0x7f0d300d5ab0 secure :-1 s=READY pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d480098c0 tx=0x7f0d480091a0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.120 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.117+0000 7f0d61eef6c0 1 -- 10.20.193.96:0/2183724371 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0d5c1131c0 msgr2=0x7f0d5c060c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:15.121 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.117+0000 7f0d61eef6c0 1 --2- 10.20.193.96:0/2183724371 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0d5c1131c0 0x7f0d5c060c40 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d4c005dc0 tx=0x7f0d4c00bbb0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.121 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.117+0000 7f0d61eef6c0 1 -- 10.20.193.96:0/2183724371 shutdown_connections 2026-02-13T03:34:15.121 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.117+0000 7f0d61eef6c0 1 --2- 10.20.193.96:0/2183724371 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f0d300b5600 0x7f0d300d5ab0 unknown :-1 s=CLOSED pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.121 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.117+0000 7f0d61eef6c0 1 --2- 10.20.193.96:0/2183724371 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0d5c061180 0x7f0d5c1632f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.121 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.117+0000 7f0d61eef6c0 1 --2- 10.20.193.96:0/2183724371 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0d5c1131c0 0x7f0d5c060c40 unknown :-1 s=CLOSED pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.122 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.117+0000 7f0d61eef6c0 1 --2- 10.20.193.96:0/2183724371 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0d5c10cfb0 0x7f0d5c060700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.122 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.117+0000 7f0d61eef6c0 1 -- 10.20.193.96:0/2183724371 >> 10.20.193.96:0/2183724371 conn(0x7f0d5c0ea8b0 msgr2=0x7f0d5c10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:15.122 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.117+0000 7f0d61eef6c0 1 -- 10.20.193.96:0/2183724371 shutdown_connections 2026-02-13T03:34:15.122 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.118+0000 7f0d61eef6c0 1 -- 10.20.193.96:0/2183724371 wait complete. 2026-02-13T03:34:15.164 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T03:34:15.281 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:15.394 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.390+0000 7fc0822256c0 1 -- 10.20.193.96:0/1137421430 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc07c10fc20 msgr2=0x7fc07c114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:15.394 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.390+0000 7fc0822256c0 1 --2- 10.20.193.96:0/1137421430 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc07c10fc20 0x7fc07c114c60 secure :-1 s=READY pgs=221 gs=1 cs=0 l=1 c_cookie=17104175622424789521 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc06c0099a0 tx=0x7fc06c02ed50 comp rx=0 tx=0).stop 2026-02-13T03:34:15.395 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.390+0000 7fc0822256c0 1 -- 10.20.193.96:0/1137421430 shutdown_connections 2026-02-13T03:34:15.395 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.390+0000 7fc0822256c0 1 --2- 10.20.193.96:0/1137421430 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc07c115440 0x7fc07c175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.395 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.390+0000 7fc0822256c0 1 --2- 10.20.193.96:0/1137421430 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc07c10fc20 0x7fc07c114c60 unknown :-1 s=CLOSED pgs=221 gs=1 cs=0 l=1 c_cookie=17104175622424789521 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.395 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.390+0000 7fc0822256c0 1 --2- 10.20.193.96:0/1137421430 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fc07c10f230 0x7fc07c10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.395 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.390+0000 7fc0822256c0 1 -- 10.20.193.96:0/1137421430 >> 10.20.193.96:0/1137421430 conn(0x7fc07c0ecb30 msgr2=0x7fc07c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:15.395 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.390+0000 7fc0822256c0 1 -- 10.20.193.96:0/1137421430 shutdown_connections 2026-02-13T03:34:15.395 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.390+0000 7fc0822256c0 1 -- 10.20.193.96:0/1137421430 wait complete. 2026-02-13T03:34:15.395 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.391+0000 7fc0822256c0 1 Processor -- start 2026-02-13T03:34:15.396 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:15 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3488962582' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-13T03:34:15.396 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:15 trial096 ceph-mon[24671]: osdmap e66: 12 total, 12 up, 12 in 2026-02-13T03:34:15.396 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:15 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2183724371' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T03:34:15.396 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:15 trial096 ceph-mon[24671]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-13T03:34:15.396 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:15 trial096 ceph-mon[24671]: pgmap v181: 97 pgs: 96 unknown, 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:15.399 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.391+0000 7fc0822256c0 1 -- start start 2026-02-13T03:34:15.399 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.391+0000 7fc0822256c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc07c10f230 0x7fc07c0f4b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:15.399 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.391+0000 7fc0822256c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc07c115440 0x7fc07c175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:15.399 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.391+0000 7fc0822256c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fc07c0f51b0 0x7fc07c0fa480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:15.399 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.391+0000 7fc0822256c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc07c0f58a0 con 0x7fc07c115440 2026-02-13T03:34:15.399 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.391+0000 7fc0822256c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc07c0fa9c0 con 0x7fc07c10f230 2026-02-13T03:34:15.399 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.391+0000 7fc0822256c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc07c0fab80 con 0x7fc07c0f51b0 2026-02-13T03:34:15.399 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.391+0000 7fc07affd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc07c115440 0x7fc07c175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:15.399 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.391+0000 7fc07affd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc07c115440 0x7fc07c175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49724/0 (socket says 10.20.193.96:49724) 2026-02-13T03:34:15.399 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.391+0000 7fc07affd6c0 1 -- 10.20.193.96:0/2858472781 learned_addr learned my addr 10.20.193.96:0/2858472781 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:15.400 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.391+0000 7fc07b7fe6c0 1 --2- 10.20.193.96:0/2858472781 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc07c10f230 0x7fc07c0f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:15.400 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.391+0000 7fc07affd6c0 1 -- 10.20.193.96:0/2858472781 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fc07c0f51b0 msgr2=0x7fc07c0fa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:15.400 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.391+0000 7fc07affd6c0 1 --2- 10.20.193.96:0/2858472781 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fc07c0f51b0 0x7fc07c0fa480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.400 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.391+0000 7fc07affd6c0 1 -- 10.20.193.96:0/2858472781 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc07c10f230 msgr2=0x7fc07c0f4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:15.400 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.391+0000 7fc07affd6c0 1 --2- 10.20.193.96:0/2858472781 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc07c10f230 0x7fc07c0f4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.400 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.391+0000 7fc07affd6c0 1 -- 10.20.193.96:0/2858472781 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc06c009590 con 0x7fc07c115440 2026-02-13T03:34:15.400 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.391+0000 7fc07b7fe6c0 1 --2- 10.20.193.96:0/2858472781 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc07c10f230 0x7fc07c0f4b80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:34:15.400 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.391+0000 7fc07affd6c0 1 --2- 10.20.193.96:0/2858472781 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc07c115440 0x7fc07c175ce0 secure :-1 s=READY pgs=222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc06c02f260 tx=0x7fc06c02fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:15.400 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.391+0000 7fc078ff96c0 1 -- 10.20.193.96:0/2858472781 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc06c002ba0 con 0x7fc07c115440 2026-02-13T03:34:15.400 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.391+0000 7fc0822256c0 1 -- 10.20.193.96:0/2858472781 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc07c0fae00 con 0x7fc07c115440 2026-02-13T03:34:15.400 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.391+0000 7fc078ff96c0 1 -- 10.20.193.96:0/2858472781 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fc06c007740 con 0x7fc07c115440 2026-02-13T03:34:15.400 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.391+0000 7fc078ff96c0 1 -- 10.20.193.96:0/2858472781 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc06c037760 con 0x7fc07c115440 2026-02-13T03:34:15.400 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.392+0000 7fc0822256c0 1 -- 10.20.193.96:0/2858472781 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc07c0fb2d0 con 0x7fc07c115440 2026-02-13T03:34:15.401 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.392+0000 7fc0822256c0 1 -- 10.20.193.96:0/2858472781 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc07c110500 con 0x7fc07c115440 2026-02-13T03:34:15.401 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.393+0000 7fc078ff96c0 1 -- 10.20.193.96:0/2858472781 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7fc06c002d00 con 0x7fc07c115440 2026-02-13T03:34:15.401 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.394+0000 7fc078ff96c0 1 --2- 10.20.193.96:0/2858472781 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fc0500b5600 0x7fc0500d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:15.401 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.394+0000 7fc07b7fe6c0 1 --2- 10.20.193.96:0/2858472781 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fc0500b5600 0x7fc0500d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:15.401 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.394+0000 7fc078ff96c0 1 -- 10.20.193.96:0/2858472781 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7762+0+0 (secure 0 0 0) 0x7fc06c107c90 con 0x7fc07c115440 2026-02-13T03:34:15.401 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.394+0000 7fc078ff96c0 1 -- 10.20.193.96:0/2858472781 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc06c0cd9c0 con 0x7fc07c115440 2026-02-13T03:34:15.401 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.394+0000 7fc07b7fe6c0 1 --2- 10.20.193.96:0/2858472781 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fc0500b5600 0x7fc0500d5ab0 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc068005980 tx=0x7fc068005df0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:15.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:15 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3488962582' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-13T03:34:15.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:15 trial132 ceph-mon[26888]: osdmap e66: 12 total, 12 up, 12 in 2026-02-13T03:34:15.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:15 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2183724371' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T03:34:15.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:15 trial132 ceph-mon[26888]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-13T03:34:15.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:15 trial132 ceph-mon[26888]: pgmap v181: 97 pgs: 96 unknown, 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:15.488 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.485+0000 7fc0822256c0 1 -- 10.20.193.96:0/2858472781 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc07c10fc20 con 0x7fc07c115440 2026-02-13T03:34:15.489 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.486+0000 7fc078ff96c0 1 -- 10.20.193.96:0/2858472781 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+22072 (secure 0 0 0) 0x7fc06c0cdba0 con 0x7fc07c115440 2026-02-13T03:34:15.490 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:15.490 INFO:teuthology.orchestra.run.trial096.stdout:{"epoch":67,"fsid":"7c123de8-088c-11f1-84f7-d404e6e7d460","created":"2026-02-13T03:31:45.642136+0000","modified":"2026-02-13T03:34:14.497119+0000","last_up_change":"2026-02-13T03:33:56.962006+0000","last_in_change":"2026-02-13T03:33:48.669890+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T03:32:50.622231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T03:34:12.297405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T03:34:13.482715+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b4f15df-2bc8-4596-a5de-6b2c54cdf01c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6802","nonce":1861813169},{"type":"v1","addr":"10.20.193.96:6803","nonce":1861813169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6804","nonce":1861813169},{"type":"v1","addr":"10.20.193.96:6805","nonce":1861813169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6808","nonce":1861813169},{"type":"v1","addr":"10.20.193.96:6809","nonce":1861813169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6806","nonce":1861813169},{"type":"v1","addr":"10.20.193.96:6807","nonce":1861813169}]},"public_addr":"10.20.193.96:6803/1861813169","cluster_addr":"10.20.193.96:6805/1861813169","heartbeat_back_addr":"10.20.193.96:6809/1861813169","heartbeat_front_addr":"10.20.193.96:6807/1861813169","state":["exists","up"]},{"osd":1,"uuid":"4238865b-e38e-494d-b2cd-4ee08715f004","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6800","nonce":3550689941},{"type":"v1","addr":"10.20.193.132:6801","nonce":3550689941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6802","nonce":3550689941},{"type":"v1","addr":"10.20.193.132:6803","nonce":3550689941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6806","nonce":3550689941},{"type":"v1","addr":"10.20.193.132:6807","nonce":3550689941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6804","nonce":3550689941},{"type":"v1","addr":"10.20.193.132:6805","nonce":3550689941}]},"public_addr":"10.20.193.132:6801/3550689941","cluster_addr":"10.20.193.132:6803/3550689941","heartbeat_back_addr":"10.20.193.132:6807/3550689941","heartbeat_front_addr":"10.20.193.132:6805/3550689941","state":["exists","up"]},{"osd":2,"uuid":"85769516-916b-43ce-aec8-36a3011ae085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6800","nonce":4145071410},{"type":"v1","addr":"10.20.193.133:6801","nonce":4145071410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6802","nonce":4145071410},{"type":"v1","addr":"10.20.193.133:6803","nonce":4145071410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6806","nonce":4145071410},{"type":"v1","addr":"10.20.193.133:6807","nonce":4145071410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6804","nonce":4145071410},{"type":"v1","addr":"10.20.193.133:6805","nonce":4145071410}]},"public_addr":"10.20.193.133:6801/4145071410","cluster_addr":"10.20.193.133:6803/4145071410","heartbeat_back_addr":"10.20.193.133:6807/4145071410","heartbeat_front_addr":"10.20.193.133:6805/4145071410","state":["exists","up"]},{"osd":3,"uuid":"2fb1e80f-f91e-4f43-a277-ae0f650cbbf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6810","nonce":2289717362},{"type":"v1","addr":"10.20.193.96:6811","nonce":2289717362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6812","nonce":2289717362},{"type":"v1","addr":"10.20.193.96:6813","nonce":2289717362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6816","nonce":2289717362},{"type":"v1","addr":"10.20.193.96:6817","nonce":2289717362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6814","nonce":2289717362},{"type":"v1","addr":"10.20.193.96:6815","nonce":2289717362}]},"public_addr":"10.20.193.96:6811/2289717362","cluster_addr":"10.20.193.96:6813/2289717362","heartbeat_back_addr":"10.20.193.96:6817/2289717362","heartbeat_front_addr":"10.20.193.96:6815/2289717362","state":["exists","up"]},{"osd":4,"uuid":"fc59010d-7a40-47e0-8111-85c564c60c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6808","nonce":421645986},{"type":"v1","addr":"10.20.193.132:6809","nonce":421645986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6810","nonce":421645986},{"type":"v1","addr":"10.20.193.132:6811","nonce":421645986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6814","nonce":421645986},{"type":"v1","addr":"10.20.193.132:6815","nonce":421645986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6812","nonce":421645986},{"type":"v1","addr":"10.20.193.132:6813","nonce":421645986}]},"public_addr":"10.20.193.132:6809/421645986","cluster_addr":"10.20.193.132:6811/421645986","heartbeat_back_addr":"10.20.193.132:6815/421645986","heartbeat_front_addr":"10.20.193.132:6813/421645986","state":["exists","up"]},{"osd":5,"uuid":"301e3dbb-5341-4fda-9c71-7f2fa3f983b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6808","nonce":3625077127},{"type":"v1","addr":"10.20.193.133:6809","nonce":3625077127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6810","nonce":3625077127},{"type":"v1","addr":"10.20.193.133:6811","nonce":3625077127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6814","nonce":3625077127},{"type":"v1","addr":"10.20.193.133:6815","nonce":3625077127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6812","nonce":3625077127},{"type":"v1","addr":"10.20.193.133:6813","nonce":3625077127}]},"public_addr":"10.20.193.133:6809/3625077127","cluster_addr":"10.20.193.133:6811/3625077127","heartbeat_back_addr":"10.20.193.133:6815/3625077127","heartbeat_front_addr":"10.20.193.133:6813/3625077127","state":["exists","up"]},{"osd":6,"uuid":"5d25b12d-8499-4f12-91ca-ce4953256678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6818","nonce":4035362295},{"type":"v1","addr":"10.20.193.96:6819","nonce":4035362295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6820","nonce":4035362295},{"type":"v1","addr":"10.20.193.96:6821","nonce":4035362295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6824","nonce":4035362295},{"type":"v1","addr":"10.20.193.96:6825","nonce":4035362295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6822","nonce":4035362295},{"type":"v1","addr":"10.20.193.96:6823","nonce":4035362295}]},"public_addr":"10.20.193.96:6819/4035362295","cluster_addr":"10.20.193.96:6821/4035362295","heartbeat_back_addr":"10.20.193.96:6825/4035362295","heartbeat_front_addr":"10.20.193.96:6823/4035362295","state":["exists","up"]},{"osd":7,"uuid":"c7d1b3d6-d6c9-4ee2-a767-45dc6a68e941","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6816","nonce":2832704836},{"type":"v1","addr":"10.20.193.132:6817","nonce":2832704836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6818","nonce":2832704836},{"type":"v1","addr":"10.20.193.132:6819","nonce":2832704836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6822","nonce":2832704836},{"type":"v1","addr":"10.20.193.132:6823","nonce":2832704836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6820","nonce":2832704836},{"type":"v1","addr":"10.20.193.132:6821","nonce":2832704836}]},"public_addr":"10.20.193.132:6817/2832704836","cluster_addr":"10.20.193.132:6819/2832704836","heartbeat_back_addr":"10.20.193.132:6823/2832704836","heartbeat_front_addr":"10.20.193.132:6821/2832704836","state":["exists","up"]},{"osd":8,"uuid":"27d57241-5de9-4678-a519-7d218f165183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6816","nonce":3678366387},{"type":"v1","addr":"10.20.193.133:6817","nonce":3678366387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6818","nonce":3678366387},{"type":"v1","addr":"10.20.193.133:6819","nonce":3678366387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6822","nonce":3678366387},{"type":"v1","addr":"10.20.193.133:6823","nonce":3678366387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6820","nonce":3678366387},{"type":"v1","addr":"10.20.193.133:6821","nonce":3678366387}]},"public_addr":"10.20.193.133:6817/3678366387","cluster_addr":"10.20.193.133:6819/3678366387","heartbeat_back_addr":"10.20.193.133:6823/3678366387","heartbeat_front_addr":"10.20.193.133:6821/3678366387","state":["exists","up"]},{"osd":9,"uuid":"93c1ae3e-3b87-4e71-b876-dcd60bbefd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6826","nonce":1024808447},{"type":"v1","addr":"10.20.193.96:6827","nonce":1024808447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6828","nonce":1024808447},{"type":"v1","addr":"10.20.193.96:6829","nonce":1024808447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6832","nonce":1024808447},{"type":"v1","addr":"10.20.193.96:6833","nonce":1024808447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6830","nonce":1024808447},{"type":"v1","addr":"10.20.193.96:6831","nonce":1024808447}]},"public_addr":"10.20.193.96:6827/1024808447","cluster_addr":"10.20.193.96:6829/1024808447","heartbeat_back_addr":"10.20.193.96:6833/1024808447","heartbeat_front_addr":"10.20.193.96:6831/1024808447","state":["exists","up"]},{"osd":10,"uuid":"0e027d3a-fcab-46b0-8719-d335e01449da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6824","nonce":921326908},{"type":"v1","addr":"10.20.193.132:6825","nonce":921326908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6826","nonce":921326908},{"type":"v1","addr":"10.20.193.132:6827","nonce":921326908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6830","nonce":921326908},{"type":"v1","addr":"10.20.193.132:6831","nonce":921326908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6828","nonce":921326908},{"type":"v1","addr":"10.20.193.132:6829","nonce":921326908}]},"public_addr":"10.20.193.132:6825/921326908","cluster_addr":"10.20.193.132:6827/921326908","heartbeat_back_addr":"10.20.193.132:6831/921326908","heartbeat_front_addr":"10.20.193.132:6829/921326908","state":["exists","up"]},{"osd":11,"uuid":"28fa6f6e-6515-49ae-930f-22e18eecefde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6824","nonce":4255173938},{"type":"v1","addr":"10.20.193.133:6825","nonce":4255173938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6826","nonce":4255173938},{"type":"v1","addr":"10.20.193.133:6827","nonce":4255173938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6830","nonce":4255173938},{"type":"v1","addr":"10.20.193.133:6831","nonce":4255173938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6828","nonce":4255173938},{"type":"v1","addr":"10.20.193.133:6829","nonce":4255173938}]},"public_addr":"10.20.193.133:6825/4255173938","cluster_addr":"10.20.193.133:6827/4255173938","heartbeat_back_addr":"10.20.193.133:6831/4255173938","heartbeat_front_addr":"10.20.193.133:6829/4255173938","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:32:33.954605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:32:41.279739+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:32:48.625772+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:32:56.120770+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:03.397402+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:10.481915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:18.008023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:25.421134+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:32.867800+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:40.330823+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:47.773798+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:55.228505+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.96:0/2938583287":"2026-02-14T03:31:51.784882+0000","10.20.193.96:0/3118819056":"2026-02-14T03:31:51.784882+0000","10.20.193.96:6801/955566313":"2026-02-14T03:31:51.784882+0000","10.20.193.96:6800/955566313":"2026-02-14T03:31:51.784882+0000","10.20.193.96:0/135845931":"2026-02-14T03:31:51.784882+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T03:34:15.491 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.487+0000 7fc0822256c0 1 -- 10.20.193.96:0/2858472781 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fc0500b5600 msgr2=0x7fc0500d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:15.491 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.487+0000 7fc0822256c0 1 --2- 10.20.193.96:0/2858472781 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fc0500b5600 0x7fc0500d5ab0 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc068005980 tx=0x7fc068005df0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.491 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.487+0000 7fc0822256c0 1 -- 10.20.193.96:0/2858472781 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc07c115440 msgr2=0x7fc07c175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:15.491 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.487+0000 7fc0822256c0 1 --2- 10.20.193.96:0/2858472781 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc07c115440 0x7fc07c175ce0 secure :-1 s=READY pgs=222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc06c02f260 tx=0x7fc06c02fcd0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.492 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.487+0000 7fc0822256c0 1 -- 10.20.193.96:0/2858472781 shutdown_connections 2026-02-13T03:34:15.492 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.487+0000 7fc0822256c0 1 --2- 10.20.193.96:0/2858472781 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fc0500b5600 0x7fc0500d5ab0 unknown :-1 s=CLOSED pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.492 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.487+0000 7fc0822256c0 1 --2- 10.20.193.96:0/2858472781 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fc07c0f51b0 0x7fc07c0fa480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.492 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.487+0000 7fc0822256c0 1 --2- 10.20.193.96:0/2858472781 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc07c115440 0x7fc07c175ce0 unknown :-1 s=CLOSED pgs=222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.492 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.487+0000 7fc0822256c0 1 --2- 10.20.193.96:0/2858472781 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc07c10f230 0x7fc07c0f4b80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.492 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.487+0000 7fc0822256c0 1 -- 10.20.193.96:0/2858472781 >> 10.20.193.96:0/2858472781 conn(0x7fc07c0ecb30 msgr2=0x7fc07c10d790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:15.492 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.487+0000 7fc0822256c0 1 -- 10.20.193.96:0/2858472781 shutdown_connections 2026-02-13T03:34:15.492 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.487+0000 7fc0822256c0 1 -- 10.20.193.96:0/2858472781 wait complete. 2026-02-13T03:34:15.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:15 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3488962582' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-13T03:34:15.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:15 trial133 ceph-mon[26943]: osdmap e66: 12 total, 12 up, 12 in 2026-02-13T03:34:15.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:15 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2183724371' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T03:34:15.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:15 trial133 ceph-mon[26943]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-13T03:34:15.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:15 trial133 ceph-mon[26943]: pgmap v181: 97 pgs: 96 unknown, 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:34:15.548 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T03:34:15.663 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:15.787 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.782+0000 7ff48d0e36c0 1 -- 10.20.193.96:0/353961571 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff48810fbf0 msgr2=0x7ff488114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:15.788 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.782+0000 7ff48d0e36c0 1 --2- 10.20.193.96:0/353961571 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff48810fbf0 0x7ff488114c30 secure :-1 s=READY pgs=223 gs=1 cs=0 l=1 c_cookie=9093364365187747314 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4700099a0 tx=0x7ff47002ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:15.788 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.782+0000 7ff48d0e36c0 1 -- 10.20.193.96:0/353961571 shutdown_connections 2026-02-13T03:34:15.788 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.782+0000 7ff48d0e36c0 1 --2- 10.20.193.96:0/353961571 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff488115410 0x7ff488175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.788 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.782+0000 7ff48d0e36c0 1 --2- 10.20.193.96:0/353961571 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff48810fbf0 0x7ff488114c30 unknown :-1 s=CLOSED pgs=223 gs=1 cs=0 l=1 c_cookie=9093364365187747314 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.788 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.782+0000 7ff48d0e36c0 1 --2- 10.20.193.96:0/353961571 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff48810f200 0x7ff48810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.788 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.782+0000 7ff48d0e36c0 1 -- 10.20.193.96:0/353961571 >> 10.20.193.96:0/353961571 conn(0x7ff4880ecb00 msgr2=0x7ff48810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:15.788 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.782+0000 7ff48d0e36c0 1 -- 10.20.193.96:0/353961571 shutdown_connections 2026-02-13T03:34:15.788 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.782+0000 7ff48d0e36c0 1 -- 10.20.193.96:0/353961571 wait complete. 2026-02-13T03:34:15.788 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.783+0000 7ff48d0e36c0 1 Processor -- start 2026-02-13T03:34:15.788 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.783+0000 7ff48d0e36c0 1 -- start start 2026-02-13T03:34:15.788 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.783+0000 7ff48d0e36c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff48810f200 0x7ff4880f4be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:15.789 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.783+0000 7ff48d0e36c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff488115410 0x7ff488175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:15.789 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.783+0000 7ff48d0e36c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff4880f5210 0x7ff4880fa490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:15.789 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.783+0000 7ff48d0e36c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff4880f5900 con 0x7ff4880f5210 2026-02-13T03:34:15.789 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.783+0000 7ff48d0e36c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff4880fa9d0 con 0x7ff488115410 2026-02-13T03:34:15.789 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.783+0000 7ff48d0e36c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff4880fab90 con 0x7ff48810f200 2026-02-13T03:34:15.789 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.783+0000 7ff4875776c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff4880f5210 0x7ff4880fa490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:15.789 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.783+0000 7ff4875776c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff4880f5210 0x7ff4880fa490 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49740/0 (socket says 10.20.193.96:49740) 2026-02-13T03:34:15.789 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.783+0000 7ff4875776c0 1 -- 10.20.193.96:0/2313368053 learned_addr learned my addr 10.20.193.96:0/2313368053 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:15.789 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.783+0000 7ff486d766c0 1 --2- 10.20.193.96:0/2313368053 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff48810f200 0x7ff4880f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:15.789 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.783+0000 7ff4865756c0 1 --2- 10.20.193.96:0/2313368053 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff488115410 0x7ff488175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:15.789 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.783+0000 7ff4875776c0 1 -- 10.20.193.96:0/2313368053 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff48810f200 msgr2=0x7ff4880f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:15.790 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.783+0000 7ff4875776c0 1 --2- 10.20.193.96:0/2313368053 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff48810f200 0x7ff4880f4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.790 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.783+0000 7ff4875776c0 1 -- 10.20.193.96:0/2313368053 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff488115410 msgr2=0x7ff488175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:15.790 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.783+0000 7ff4875776c0 1 --2- 10.20.193.96:0/2313368053 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff488115410 0x7ff488175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.790 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.783+0000 7ff4875776c0 1 -- 10.20.193.96:0/2313368053 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff470009590 con 0x7ff4880f5210 2026-02-13T03:34:15.790 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.783+0000 7ff4875776c0 1 --2- 10.20.193.96:0/2313368053 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff4880f5210 0x7ff4880fa490 secure :-1 s=READY pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff47800c6c0 tx=0x7ff47800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:15.790 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.783+0000 7ff467fff6c0 1 -- 10.20.193.96:0/2313368053 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff478003c40 con 0x7ff4880f5210 2026-02-13T03:34:15.790 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.783+0000 7ff467fff6c0 1 -- 10.20.193.96:0/2313368053 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7ff47800a030 con 0x7ff4880f5210 2026-02-13T03:34:15.790 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.783+0000 7ff48d0e36c0 1 -- 10.20.193.96:0/2313368053 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4880fae70 con 0x7ff4880f5210 2026-02-13T03:34:15.790 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.783+0000 7ff467fff6c0 1 -- 10.20.193.96:0/2313368053 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff47800dcb0 con 0x7ff4880f5210 2026-02-13T03:34:15.790 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.783+0000 7ff48d0e36c0 1 -- 10.20.193.96:0/2313368053 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4880fb600 con 0x7ff4880f5210 2026-02-13T03:34:15.790 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.784+0000 7ff48d0e36c0 1 -- 10.20.193.96:0/2313368053 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4881104d0 con 0x7ff4880f5210 2026-02-13T03:34:15.791 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.785+0000 7ff467fff6c0 1 -- 10.20.193.96:0/2313368053 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7ff478005030 con 0x7ff4880f5210 2026-02-13T03:34:15.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.786+0000 7ff467fff6c0 1 --2- 10.20.193.96:0/2313368053 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff45c0b5680 0x7ff45c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:15.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.786+0000 7ff486d766c0 1 --2- 10.20.193.96:0/2313368053 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff45c0b5680 0x7ff45c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:15.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.786+0000 7ff467fff6c0 1 -- 10.20.193.96:0/2313368053 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7762+0+0 (secure 0 0 0) 0x7ff4780e4780 con 0x7ff4880f5210 2026-02-13T03:34:15.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.786+0000 7ff467fff6c0 1 -- 10.20.193.96:0/2313368053 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff4780a7300 con 0x7ff4880f5210 2026-02-13T03:34:15.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.786+0000 7ff486d766c0 1 --2- 10.20.193.96:0/2313368053 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff45c0b5680 0x7ff45c0d5b30 secure :-1 s=READY pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff47c005980 tx=0x7ff47c005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:15.879 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.876+0000 7ff48d0e36c0 1 -- 10.20.193.96:0/2313368053 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff4880f5ce0 con 0x7ff4880f5210 2026-02-13T03:34:15.880 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.877+0000 7ff467fff6c0 1 -- 10.20.193.96:0/2313368053 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+22072 (secure 0 0 0) 0x7ff4780aa4b0 con 0x7ff4880f5210 2026-02-13T03:34:15.880 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:15.881 INFO:teuthology.orchestra.run.trial096.stdout:{"epoch":67,"fsid":"7c123de8-088c-11f1-84f7-d404e6e7d460","created":"2026-02-13T03:31:45.642136+0000","modified":"2026-02-13T03:34:14.497119+0000","last_up_change":"2026-02-13T03:33:56.962006+0000","last_in_change":"2026-02-13T03:33:48.669890+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T03:32:50.622231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T03:34:12.297405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T03:34:13.482715+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b4f15df-2bc8-4596-a5de-6b2c54cdf01c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6802","nonce":1861813169},{"type":"v1","addr":"10.20.193.96:6803","nonce":1861813169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6804","nonce":1861813169},{"type":"v1","addr":"10.20.193.96:6805","nonce":1861813169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6808","nonce":1861813169},{"type":"v1","addr":"10.20.193.96:6809","nonce":1861813169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6806","nonce":1861813169},{"type":"v1","addr":"10.20.193.96:6807","nonce":1861813169}]},"public_addr":"10.20.193.96:6803/1861813169","cluster_addr":"10.20.193.96:6805/1861813169","heartbeat_back_addr":"10.20.193.96:6809/1861813169","heartbeat_front_addr":"10.20.193.96:6807/1861813169","state":["exists","up"]},{"osd":1,"uuid":"4238865b-e38e-494d-b2cd-4ee08715f004","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6800","nonce":3550689941},{"type":"v1","addr":"10.20.193.132:6801","nonce":3550689941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6802","nonce":3550689941},{"type":"v1","addr":"10.20.193.132:6803","nonce":3550689941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6806","nonce":3550689941},{"type":"v1","addr":"10.20.193.132:6807","nonce":3550689941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6804","nonce":3550689941},{"type":"v1","addr":"10.20.193.132:6805","nonce":3550689941}]},"public_addr":"10.20.193.132:6801/3550689941","cluster_addr":"10.20.193.132:6803/3550689941","heartbeat_back_addr":"10.20.193.132:6807/3550689941","heartbeat_front_addr":"10.20.193.132:6805/3550689941","state":["exists","up"]},{"osd":2,"uuid":"85769516-916b-43ce-aec8-36a3011ae085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6800","nonce":4145071410},{"type":"v1","addr":"10.20.193.133:6801","nonce":4145071410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6802","nonce":4145071410},{"type":"v1","addr":"10.20.193.133:6803","nonce":4145071410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6806","nonce":4145071410},{"type":"v1","addr":"10.20.193.133:6807","nonce":4145071410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6804","nonce":4145071410},{"type":"v1","addr":"10.20.193.133:6805","nonce":4145071410}]},"public_addr":"10.20.193.133:6801/4145071410","cluster_addr":"10.20.193.133:6803/4145071410","heartbeat_back_addr":"10.20.193.133:6807/4145071410","heartbeat_front_addr":"10.20.193.133:6805/4145071410","state":["exists","up"]},{"osd":3,"uuid":"2fb1e80f-f91e-4f43-a277-ae0f650cbbf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6810","nonce":2289717362},{"type":"v1","addr":"10.20.193.96:6811","nonce":2289717362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6812","nonce":2289717362},{"type":"v1","addr":"10.20.193.96:6813","nonce":2289717362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6816","nonce":2289717362},{"type":"v1","addr":"10.20.193.96:6817","nonce":2289717362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6814","nonce":2289717362},{"type":"v1","addr":"10.20.193.96:6815","nonce":2289717362}]},"public_addr":"10.20.193.96:6811/2289717362","cluster_addr":"10.20.193.96:6813/2289717362","heartbeat_back_addr":"10.20.193.96:6817/2289717362","heartbeat_front_addr":"10.20.193.96:6815/2289717362","state":["exists","up"]},{"osd":4,"uuid":"fc59010d-7a40-47e0-8111-85c564c60c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6808","nonce":421645986},{"type":"v1","addr":"10.20.193.132:6809","nonce":421645986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6810","nonce":421645986},{"type":"v1","addr":"10.20.193.132:6811","nonce":421645986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6814","nonce":421645986},{"type":"v1","addr":"10.20.193.132:6815","nonce":421645986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6812","nonce":421645986},{"type":"v1","addr":"10.20.193.132:6813","nonce":421645986}]},"public_addr":"10.20.193.132:6809/421645986","cluster_addr":"10.20.193.132:6811/421645986","heartbeat_back_addr":"10.20.193.132:6815/421645986","heartbeat_front_addr":"10.20.193.132:6813/421645986","state":["exists","up"]},{"osd":5,"uuid":"301e3dbb-5341-4fda-9c71-7f2fa3f983b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6808","nonce":3625077127},{"type":"v1","addr":"10.20.193.133:6809","nonce":3625077127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6810","nonce":3625077127},{"type":"v1","addr":"10.20.193.133:6811","nonce":3625077127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6814","nonce":3625077127},{"type":"v1","addr":"10.20.193.133:6815","nonce":3625077127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6812","nonce":3625077127},{"type":"v1","addr":"10.20.193.133:6813","nonce":3625077127}]},"public_addr":"10.20.193.133:6809/3625077127","cluster_addr":"10.20.193.133:6811/3625077127","heartbeat_back_addr":"10.20.193.133:6815/3625077127","heartbeat_front_addr":"10.20.193.133:6813/3625077127","state":["exists","up"]},{"osd":6,"uuid":"5d25b12d-8499-4f12-91ca-ce4953256678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6818","nonce":4035362295},{"type":"v1","addr":"10.20.193.96:6819","nonce":4035362295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6820","nonce":4035362295},{"type":"v1","addr":"10.20.193.96:6821","nonce":4035362295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6824","nonce":4035362295},{"type":"v1","addr":"10.20.193.96:6825","nonce":4035362295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6822","nonce":4035362295},{"type":"v1","addr":"10.20.193.96:6823","nonce":4035362295}]},"public_addr":"10.20.193.96:6819/4035362295","cluster_addr":"10.20.193.96:6821/4035362295","heartbeat_back_addr":"10.20.193.96:6825/4035362295","heartbeat_front_addr":"10.20.193.96:6823/4035362295","state":["exists","up"]},{"osd":7,"uuid":"c7d1b3d6-d6c9-4ee2-a767-45dc6a68e941","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6816","nonce":2832704836},{"type":"v1","addr":"10.20.193.132:6817","nonce":2832704836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6818","nonce":2832704836},{"type":"v1","addr":"10.20.193.132:6819","nonce":2832704836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6822","nonce":2832704836},{"type":"v1","addr":"10.20.193.132:6823","nonce":2832704836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6820","nonce":2832704836},{"type":"v1","addr":"10.20.193.132:6821","nonce":2832704836}]},"public_addr":"10.20.193.132:6817/2832704836","cluster_addr":"10.20.193.132:6819/2832704836","heartbeat_back_addr":"10.20.193.132:6823/2832704836","heartbeat_front_addr":"10.20.193.132:6821/2832704836","state":["exists","up"]},{"osd":8,"uuid":"27d57241-5de9-4678-a519-7d218f165183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6816","nonce":3678366387},{"type":"v1","addr":"10.20.193.133:6817","nonce":3678366387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6818","nonce":3678366387},{"type":"v1","addr":"10.20.193.133:6819","nonce":3678366387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6822","nonce":3678366387},{"type":"v1","addr":"10.20.193.133:6823","nonce":3678366387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6820","nonce":3678366387},{"type":"v1","addr":"10.20.193.133:6821","nonce":3678366387}]},"public_addr":"10.20.193.133:6817/3678366387","cluster_addr":"10.20.193.133:6819/3678366387","heartbeat_back_addr":"10.20.193.133:6823/3678366387","heartbeat_front_addr":"10.20.193.133:6821/3678366387","state":["exists","up"]},{"osd":9,"uuid":"93c1ae3e-3b87-4e71-b876-dcd60bbefd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6826","nonce":1024808447},{"type":"v1","addr":"10.20.193.96:6827","nonce":1024808447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6828","nonce":1024808447},{"type":"v1","addr":"10.20.193.96:6829","nonce":1024808447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6832","nonce":1024808447},{"type":"v1","addr":"10.20.193.96:6833","nonce":1024808447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6830","nonce":1024808447},{"type":"v1","addr":"10.20.193.96:6831","nonce":1024808447}]},"public_addr":"10.20.193.96:6827/1024808447","cluster_addr":"10.20.193.96:6829/1024808447","heartbeat_back_addr":"10.20.193.96:6833/1024808447","heartbeat_front_addr":"10.20.193.96:6831/1024808447","state":["exists","up"]},{"osd":10,"uuid":"0e027d3a-fcab-46b0-8719-d335e01449da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6824","nonce":921326908},{"type":"v1","addr":"10.20.193.132:6825","nonce":921326908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6826","nonce":921326908},{"type":"v1","addr":"10.20.193.132:6827","nonce":921326908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6830","nonce":921326908},{"type":"v1","addr":"10.20.193.132:6831","nonce":921326908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6828","nonce":921326908},{"type":"v1","addr":"10.20.193.132:6829","nonce":921326908}]},"public_addr":"10.20.193.132:6825/921326908","cluster_addr":"10.20.193.132:6827/921326908","heartbeat_back_addr":"10.20.193.132:6831/921326908","heartbeat_front_addr":"10.20.193.132:6829/921326908","state":["exists","up"]},{"osd":11,"uuid":"28fa6f6e-6515-49ae-930f-22e18eecefde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6824","nonce":4255173938},{"type":"v1","addr":"10.20.193.133:6825","nonce":4255173938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6826","nonce":4255173938},{"type":"v1","addr":"10.20.193.133:6827","nonce":4255173938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6830","nonce":4255173938},{"type":"v1","addr":"10.20.193.133:6831","nonce":4255173938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6828","nonce":4255173938},{"type":"v1","addr":"10.20.193.133:6829","nonce":4255173938}]},"public_addr":"10.20.193.133:6825/4255173938","cluster_addr":"10.20.193.133:6827/4255173938","heartbeat_back_addr":"10.20.193.133:6831/4255173938","heartbeat_front_addr":"10.20.193.133:6829/4255173938","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:32:33.954605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:32:41.279739+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:32:48.625772+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:32:56.120770+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:03.397402+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:10.481915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:18.008023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:25.421134+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:32.867800+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:40.330823+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:47.773798+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:55.228505+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.96:0/2938583287":"2026-02-14T03:31:51.784882+0000","10.20.193.96:0/3118819056":"2026-02-14T03:31:51.784882+0000","10.20.193.96:6801/955566313":"2026-02-14T03:31:51.784882+0000","10.20.193.96:6800/955566313":"2026-02-14T03:31:51.784882+0000","10.20.193.96:0/135845931":"2026-02-14T03:31:51.784882+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T03:34:15.882 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.878+0000 7ff48d0e36c0 1 -- 10.20.193.96:0/2313368053 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff45c0b5680 msgr2=0x7ff45c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:15.882 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.878+0000 7ff48d0e36c0 1 --2- 10.20.193.96:0/2313368053 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff45c0b5680 0x7ff45c0d5b30 secure :-1 s=READY pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff47c005980 tx=0x7ff47c005910 comp rx=0 tx=0).stop 2026-02-13T03:34:15.882 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.878+0000 7ff48d0e36c0 1 -- 10.20.193.96:0/2313368053 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff4880f5210 msgr2=0x7ff4880fa490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:15.882 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.878+0000 7ff48d0e36c0 1 --2- 10.20.193.96:0/2313368053 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff4880f5210 0x7ff4880fa490 secure :-1 s=READY pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff47800c6c0 tx=0x7ff47800cb90 comp rx=0 tx=0).stop 2026-02-13T03:34:15.882 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.878+0000 7ff48d0e36c0 1 -- 10.20.193.96:0/2313368053 shutdown_connections 2026-02-13T03:34:15.882 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.878+0000 7ff48d0e36c0 1 --2- 10.20.193.96:0/2313368053 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff45c0b5680 0x7ff45c0d5b30 unknown :-1 s=CLOSED pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.882 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.878+0000 7ff48d0e36c0 1 --2- 10.20.193.96:0/2313368053 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff4880f5210 0x7ff4880fa490 unknown :-1 s=CLOSED pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.882 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.878+0000 7ff48d0e36c0 1 --2- 10.20.193.96:0/2313368053 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff488115410 0x7ff488175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.882 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.878+0000 7ff48d0e36c0 1 --2- 10.20.193.96:0/2313368053 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff48810f200 0x7ff4880f4be0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:15.882 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.878+0000 7ff48d0e36c0 1 -- 10.20.193.96:0/2313368053 >> 10.20.193.96:0/2313368053 conn(0x7ff4880ecb00 msgr2=0x7ff48810d860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:15.883 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.878+0000 7ff48d0e36c0 1 -- 10.20.193.96:0/2313368053 shutdown_connections 2026-02-13T03:34:15.883 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:15.878+0000 7ff48d0e36c0 1 -- 10.20.193.96:0/2313368053 wait complete. 2026-02-13T03:34:15.921 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph fs set cephfs standby_count_wanted 0 2026-02-13T03:34:16.040 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:16.165 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.160+0000 7f9c9baa06c0 1 -- 10.20.193.96:0/3419874522 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9c9410cf80 msgr2=0x7f9c9410d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:16.165 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.160+0000 7f9c9baa06c0 1 --2- 10.20.193.96:0/3419874522 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9c9410cf80 0x7f9c9410d350 secure :-1 s=READY pgs=225 gs=1 cs=0 l=1 c_cookie=15640411814827028846 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c840099a0 tx=0x7f9c8402ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:16.166 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.160+0000 7f9c9baa06c0 1 -- 10.20.193.96:0/3419874522 shutdown_connections 2026-02-13T03:34:16.166 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.160+0000 7f9c9baa06c0 1 --2- 10.20.193.96:0/3419874522 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9c94113190 0x7f9c94173b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:16.166 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.160+0000 7f9c9baa06c0 1 --2- 10.20.193.96:0/3419874522 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9c9410d970 0x7f9c941129b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:16.166 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.160+0000 7f9c9baa06c0 1 --2- 10.20.193.96:0/3419874522 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9c9410cf80 0x7f9c9410d350 unknown :-1 s=CLOSED pgs=225 gs=1 cs=0 l=1 c_cookie=15640411814827028846 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:16.166 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.160+0000 7f9c9baa06c0 1 -- 10.20.193.96:0/3419874522 >> 10.20.193.96:0/3419874522 conn(0x7f9c940ea880 msgr2=0x7f9c9410ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:16.166 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.160+0000 7f9c9baa06c0 1 -- 10.20.193.96:0/3419874522 shutdown_connections 2026-02-13T03:34:16.166 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.160+0000 7f9c9baa06c0 1 -- 10.20.193.96:0/3419874522 wait complete. 2026-02-13T03:34:16.166 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.160+0000 7f9c9baa06c0 1 Processor -- start 2026-02-13T03:34:16.166 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.160+0000 7f9c9baa06c0 1 -- start start 2026-02-13T03:34:16.167 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.160+0000 7f9c9baa06c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9c9410cf80 0x7f9c940f4c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:16.167 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.160+0000 7f9c9baa06c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9c94113190 0x7f9c94173a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:16.167 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.160+0000 7f9c9baa06c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9c940f5240 0x7f9c940fa510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:16.167 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.160+0000 7f9c9baa06c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9c940f5930 con 0x7f9c940f5240 2026-02-13T03:34:16.167 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.160+0000 7f9c9baa06c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9c940faa50 con 0x7f9c9410cf80 2026-02-13T03:34:16.167 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.160+0000 7f9c9baa06c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9c940fac10 con 0x7f9c94113190 2026-02-13T03:34:16.167 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.161+0000 7f9c9a0126c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9c940f5240 0x7f9c940fa510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:16.167 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.161+0000 7f9c9a0126c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9c940f5240 0x7f9c940fa510 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49756/0 (socket says 10.20.193.96:49756) 2026-02-13T03:34:16.167 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.161+0000 7f9c9a0126c0 1 -- 10.20.193.96:0/532694790 learned_addr learned my addr 10.20.193.96:0/532694790 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:16.167 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.161+0000 7f9c998116c0 1 --2- 10.20.193.96:0/532694790 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9c9410cf80 0x7f9c940f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:16.167 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.161+0000 7f9c990106c0 1 --2- 10.20.193.96:0/532694790 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9c94113190 0x7f9c94173a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:16.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.161+0000 7f9c9a0126c0 1 -- 10.20.193.96:0/532694790 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9c94113190 msgr2=0x7f9c94173a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:16.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.161+0000 7f9c9a0126c0 1 --2- 10.20.193.96:0/532694790 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9c94113190 0x7f9c94173a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:16.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.161+0000 7f9c9a0126c0 1 -- 10.20.193.96:0/532694790 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9c9410cf80 msgr2=0x7f9c940f4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:16.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.161+0000 7f9c9a0126c0 1 --2- 10.20.193.96:0/532694790 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9c9410cf80 0x7f9c940f4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:16.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.161+0000 7f9c9a0126c0 1 -- 10.20.193.96:0/532694790 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c84009590 con 0x7f9c940f5240 2026-02-13T03:34:16.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.161+0000 7f9c9a0126c0 1 --2- 10.20.193.96:0/532694790 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9c940f5240 0x7f9c940fa510 secure :-1 s=READY pgs=226 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c90006ea0 tx=0x7f9c9000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:16.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.161+0000 7f9c82ffd6c0 1 -- 10.20.193.96:0/532694790 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c90003a30 con 0x7f9c940f5240 2026-02-13T03:34:16.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.161+0000 7f9c82ffd6c0 1 -- 10.20.193.96:0/532694790 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f9c90005510 con 0x7f9c940f5240 2026-02-13T03:34:16.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.161+0000 7f9c82ffd6c0 1 -- 10.20.193.96:0/532694790 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c9000dd70 con 0x7f9c940f5240 2026-02-13T03:34:16.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.161+0000 7f9c9baa06c0 1 -- 10.20.193.96:0/532694790 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c940faef0 con 0x7f9c940f5240 2026-02-13T03:34:16.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.161+0000 7f9c9baa06c0 1 -- 10.20.193.96:0/532694790 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c940fb380 con 0x7f9c940f5240 2026-02-13T03:34:16.169 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.161+0000 7f9c9baa06c0 1 -- 10.20.193.96:0/532694790 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c9410e250 con 0x7f9c940f5240 2026-02-13T03:34:16.170 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.163+0000 7f9c82ffd6c0 1 -- 10.20.193.96:0/532694790 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f9c90003b90 con 0x7f9c940f5240 2026-02-13T03:34:16.170 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.163+0000 7f9c82ffd6c0 1 --2- 10.20.193.96:0/532694790 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9c700b5680 0x7f9c700d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:16.170 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.163+0000 7f9c82ffd6c0 1 -- 10.20.193.96:0/532694790 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f9c900e46b0 con 0x7f9c940f5240 2026-02-13T03:34:16.170 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.163+0000 7f9c998116c0 1 --2- 10.20.193.96:0/532694790 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9c700b5680 0x7f9c700d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:16.170 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.163+0000 7f9c998116c0 1 --2- 10.20.193.96:0/532694790 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9c700b5680 0x7f9c700d5b30 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c840023e0 tx=0x7f9c84009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:16.170 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.164+0000 7f9c82ffd6c0 1 -- 10.20.193.96:0/532694790 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9c900a7270 con 0x7f9c940f5240 2026-02-13T03:34:16.282 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:16.279+0000 7f9c9baa06c0 1 -- 10.20.193.96:0/532694790 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9c940fb380 con 0x7f9c940f5240 2026-02-13T03:34:16.283 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:16 trial096 ceph-mon[24671]: osdmap e67: 12 total, 12 up, 12 in 2026-02-13T03:34:16.283 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:16 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2183724371' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-13T03:34:16.283 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:16 trial096 ceph-mon[24671]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-13T03:34:16.283 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:16 trial096 ceph-mon[24671]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-13T03:34:16.283 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:16 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2858472781' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:34:16.283 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:16 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2313368053' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:34:16.283 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:16 trial096 ceph-mon[24671]: osdmap e68: 12 total, 12 up, 12 in 2026-02-13T03:34:16.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:16 trial132 ceph-mon[26888]: osdmap e67: 12 total, 12 up, 12 in 2026-02-13T03:34:16.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:16 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2183724371' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-13T03:34:16.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:16 trial132 ceph-mon[26888]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-13T03:34:16.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:16 trial132 ceph-mon[26888]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-13T03:34:16.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:16 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2858472781' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:34:16.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:16 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2313368053' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:34:16.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:16 trial132 ceph-mon[26888]: osdmap e68: 12 total, 12 up, 12 in 2026-02-13T03:34:16.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:16 trial133 ceph-mon[26943]: osdmap e67: 12 total, 12 up, 12 in 2026-02-13T03:34:16.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:16 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2183724371' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-13T03:34:16.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:16 trial133 ceph-mon[26943]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-13T03:34:16.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:16 trial133 ceph-mon[26943]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-13T03:34:16.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:16 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2858472781' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:34:16.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:16 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2313368053' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:34:16.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:16 trial133 ceph-mon[26943]: osdmap e68: 12 total, 12 up, 12 in 2026-02-13T03:34:17.124 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.121+0000 7f9c82ffd6c0 1 -- 10.20.193.96:0/532694790 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f9c900aa420 con 0x7f9c940f5240 2026-02-13T03:34:17.127 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.124+0000 7f9c9baa06c0 1 -- 10.20.193.96:0/532694790 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9c700b5680 msgr2=0x7f9c700d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:17.127 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.124+0000 7f9c9baa06c0 1 --2- 10.20.193.96:0/532694790 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9c700b5680 0x7f9c700d5b30 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c840023e0 tx=0x7f9c84009260 comp rx=0 tx=0).stop 2026-02-13T03:34:17.127 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.124+0000 7f9c9baa06c0 1 -- 10.20.193.96:0/532694790 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9c940f5240 msgr2=0x7f9c940fa510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:17.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.124+0000 7f9c9baa06c0 1 --2- 10.20.193.96:0/532694790 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9c940f5240 0x7f9c940fa510 secure :-1 s=READY pgs=226 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c90006ea0 tx=0x7f9c9000cca0 comp rx=0 tx=0).stop 2026-02-13T03:34:17.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.124+0000 7f9c9baa06c0 1 -- 10.20.193.96:0/532694790 shutdown_connections 2026-02-13T03:34:17.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.124+0000 7f9c9baa06c0 1 --2- 10.20.193.96:0/532694790 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9c700b5680 0x7f9c700d5b30 unknown :-1 s=CLOSED pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:17.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.124+0000 7f9c9baa06c0 1 --2- 10.20.193.96:0/532694790 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9c940f5240 0x7f9c940fa510 unknown :-1 s=CLOSED pgs=226 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:17.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.124+0000 7f9c9baa06c0 1 --2- 10.20.193.96:0/532694790 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9c94113190 0x7f9c94173a30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:17.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.124+0000 7f9c9baa06c0 1 --2- 10.20.193.96:0/532694790 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9c9410cf80 0x7f9c940f4c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:17.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.124+0000 7f9c9baa06c0 1 -- 10.20.193.96:0/532694790 >> 10.20.193.96:0/532694790 conn(0x7f9c940ea880 msgr2=0x7f9c9410f830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:17.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.124+0000 7f9c9baa06c0 1 -- 10.20.193.96:0/532694790 shutdown_connections 2026-02-13T03:34:17.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.124+0000 7f9c9baa06c0 1 -- 10.20.193.96:0/532694790 wait complete. 2026-02-13T03:34:17.167 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['disabled'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2026-02-13T03:34:17.167 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph fs set cephfs max_mds 3 --yes-i-really-mean-it 2026-02-13T03:34:17.285 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:17.388 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:17 trial133 ceph-mon[26943]: mds.? [v2:10.20.193.132:6838/1168876815,v1:10.20.193.132:6839/1168876815] up:active 2026-02-13T03:34:17.388 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:17 trial133 ceph-mon[26943]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T03:34:17.388 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:17 trial133 ceph-mon[26943]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T03:34:17.388 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:17 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/532694790' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T03:34:17.389 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:17 trial133 ceph-mon[26943]: pgmap v184: 97 pgs: 14 creating+peering, 50 unknown, 33 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s wr, 1 op/s 2026-02-13T03:34:17.399 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:17 trial096 ceph-mon[24671]: mds.? [v2:10.20.193.132:6838/1168876815,v1:10.20.193.132:6839/1168876815] up:active 2026-02-13T03:34:17.400 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:17 trial096 ceph-mon[24671]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T03:34:17.400 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:17 trial096 ceph-mon[24671]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T03:34:17.400 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:17 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/532694790' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T03:34:17.400 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:17 trial096 ceph-mon[24671]: pgmap v184: 97 pgs: 14 creating+peering, 50 unknown, 33 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s wr, 1 op/s 2026-02-13T03:34:17.405 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.399+0000 7f5febc146c0 1 -- 10.20.193.96:0/999397214 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5fe410f200 msgr2=0x7f5fe410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:17.405 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.399+0000 7f5febc146c0 1 --2- 10.20.193.96:0/999397214 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5fe410f200 0x7f5fe410f5d0 secure :-1 s=READY pgs=227 gs=1 cs=0 l=1 c_cookie=10819743110515851141 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5fd800aa70 tx=0x7f5fd802fde0 comp rx=0 tx=0).stop 2026-02-13T03:34:17.405 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5febc146c0 1 -- 10.20.193.96:0/999397214 shutdown_connections 2026-02-13T03:34:17.405 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5febc146c0 1 --2- 10.20.193.96:0/999397214 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5fe4115410 0x7f5fe4175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:17.405 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5febc146c0 1 --2- 10.20.193.96:0/999397214 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5fe410fbf0 0x7f5fe4114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:17.405 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5febc146c0 1 --2- 10.20.193.96:0/999397214 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5fe410f200 0x7f5fe410f5d0 unknown :-1 s=CLOSED pgs=227 gs=1 cs=0 l=1 c_cookie=10819743110515851141 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:17.405 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5febc146c0 1 -- 10.20.193.96:0/999397214 >> 10.20.193.96:0/999397214 conn(0x7f5fe40ecb00 msgr2=0x7f5fe410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:17.405 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5febc146c0 1 -- 10.20.193.96:0/999397214 shutdown_connections 2026-02-13T03:34:17.405 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5febc146c0 1 -- 10.20.193.96:0/999397214 wait complete. 2026-02-13T03:34:17.406 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5febc146c0 1 Processor -- start 2026-02-13T03:34:17.406 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5febc146c0 1 -- start start 2026-02-13T03:34:17.406 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5febc146c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5fe410f200 0x7f5fe411d150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:17.406 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5febc146c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5fe4115410 0x7f5fe411d690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:17.406 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5febc146c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5fe4122a50 0x7f5fe4122ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:17.406 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5febc146c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe4123460 con 0x7f5fe4122a50 2026-02-13T03:34:17.406 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5febc146c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe41235d0 con 0x7f5fe410f200 2026-02-13T03:34:17.406 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5febc146c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe4123790 con 0x7f5fe4115410 2026-02-13T03:34:17.406 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5fea1866c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5fe4122a50 0x7f5fe4122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:17.406 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5fea1866c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5fe4122a50 0x7f5fe4122ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49780/0 (socket says 10.20.193.96:49780) 2026-02-13T03:34:17.406 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5fea1866c0 1 -- 10.20.193.96:0/2950809886 learned_addr learned my addr 10.20.193.96:0/2950809886 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:17.406 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5fe99856c0 1 --2- 10.20.193.96:0/2950809886 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5fe410f200 0x7f5fe411d150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:17.407 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5fe91846c0 1 --2- 10.20.193.96:0/2950809886 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5fe4115410 0x7f5fe411d690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:17.407 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5fea1866c0 1 -- 10.20.193.96:0/2950809886 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5fe4115410 msgr2=0x7f5fe411d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:17.407 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5fea1866c0 1 --2- 10.20.193.96:0/2950809886 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5fe4115410 0x7f5fe411d690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:17.407 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5fea1866c0 1 -- 10.20.193.96:0/2950809886 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5fe410f200 msgr2=0x7f5fe411d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:17.407 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5fea1866c0 1 --2- 10.20.193.96:0/2950809886 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5fe410f200 0x7f5fe411d150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:17.407 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5fea1866c0 1 -- 10.20.193.96:0/2950809886 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd800a660 con 0x7f5fe4122a50 2026-02-13T03:34:17.407 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5fe91846c0 1 --2- 10.20.193.96:0/2950809886 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5fe4115410 0x7f5fe411d690 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:34:17.407 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5fe99856c0 1 --2- 10.20.193.96:0/2950809886 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5fe410f200 0x7f5fe411d150 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:34:17.407 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5fea1866c0 1 --2- 10.20.193.96:0/2950809886 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5fe4122a50 0x7f5fe4122ef0 secure :-1 s=READY pgs=228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5fe0005dc0 tx=0x7f5fe000bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:17.407 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5fd6ffd6c0 1 -- 10.20.193.96:0/2950809886 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5fe0004250 con 0x7f5fe4122a50 2026-02-13T03:34:17.407 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5fd6ffd6c0 1 -- 10.20.193.96:0/2950809886 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f5fe0009070 con 0x7f5fe4122a50 2026-02-13T03:34:17.407 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5fd6ffd6c0 1 -- 10.20.193.96:0/2950809886 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5fe000cd90 con 0x7f5fe4122a50 2026-02-13T03:34:17.408 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.400+0000 7f5febc146c0 1 -- 10.20.193.96:0/2950809886 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fe4163c40 con 0x7f5fe4122a50 2026-02-13T03:34:17.408 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.401+0000 7f5febc146c0 1 -- 10.20.193.96:0/2950809886 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fe41640d0 con 0x7f5fe4122a50 2026-02-13T03:34:17.408 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.401+0000 7f5febc146c0 1 -- 10.20.193.96:0/2950809886 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fe41104d0 con 0x7f5fe4122a50 2026-02-13T03:34:17.409 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.402+0000 7f5fd6ffd6c0 1 -- 10.20.193.96:0/2950809886 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f5fe00043b0 con 0x7f5fe4122a50 2026-02-13T03:34:17.409 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.403+0000 7f5fd6ffd6c0 1 --2- 10.20.193.96:0/2950809886 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f5fc00b5680 0x7f5fc00d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:17.409 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.403+0000 7f5fe99856c0 1 --2- 10.20.193.96:0/2950809886 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f5fc00b5680 0x7f5fc00d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:17.409 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.403+0000 7f5fd6ffd6c0 1 -- 10.20.193.96:0/2950809886 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f5fe00e38e0 con 0x7f5fe4122a50 2026-02-13T03:34:17.409 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.403+0000 7f5fe99856c0 1 --2- 10.20.193.96:0/2950809886 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f5fc00b5680 0x7f5fc00d5b30 secure :-1 s=READY pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5fd80024b0 tx=0x7f5fd800a1a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:17.409 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.403+0000 7f5fd6ffd6c0 1 -- 10.20.193.96:0/2950809886 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5fe00a6460 con 0x7f5fe4122a50 2026-02-13T03:34:17.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:17 trial132 ceph-mon[26888]: mds.? [v2:10.20.193.132:6838/1168876815,v1:10.20.193.132:6839/1168876815] up:active 2026-02-13T03:34:17.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:17 trial132 ceph-mon[26888]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T03:34:17.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:17 trial132 ceph-mon[26888]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T03:34:17.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:17 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/532694790' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T03:34:17.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:17 trial132 ceph-mon[26888]: pgmap v184: 97 pgs: 14 creating+peering, 50 unknown, 33 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s wr, 1 op/s 2026-02-13T03:34:17.519 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:17.516+0000 7f5febc146c0 1 -- 10.20.193.96:0/2950809886 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} v 0) -- 0x7f5fe410f5d0 con 0x7f5fe4122a50 2026-02-13T03:34:18.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.125+0000 7f5fd6ffd6c0 1 -- 10.20.193.96:0/2950809886 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]=0 v17) ==== 135+0+0 (secure 0 0 0) 0x7f5fe00a9610 con 0x7f5fe4122a50 2026-02-13T03:34:18.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.126+0000 7f5febc146c0 1 -- 10.20.193.96:0/2950809886 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f5fc00b5680 msgr2=0x7f5fc00d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:18.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.126+0000 7f5febc146c0 1 --2- 10.20.193.96:0/2950809886 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f5fc00b5680 0x7f5fc00d5b30 secure :-1 s=READY pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5fd80024b0 tx=0x7f5fd800a1a0 comp rx=0 tx=0).stop 2026-02-13T03:34:18.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.126+0000 7f5febc146c0 1 -- 10.20.193.96:0/2950809886 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5fe4122a50 msgr2=0x7f5fe4122ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:18.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.126+0000 7f5febc146c0 1 --2- 10.20.193.96:0/2950809886 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5fe4122a50 0x7f5fe4122ef0 secure :-1 s=READY pgs=228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5fe0005dc0 tx=0x7f5fe000bb60 comp rx=0 tx=0).stop 2026-02-13T03:34:18.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.127+0000 7f5febc146c0 1 -- 10.20.193.96:0/2950809886 shutdown_connections 2026-02-13T03:34:18.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.127+0000 7f5febc146c0 1 --2- 10.20.193.96:0/2950809886 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f5fc00b5680 0x7f5fc00d5b30 unknown :-1 s=CLOSED pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:18.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.127+0000 7f5febc146c0 1 --2- 10.20.193.96:0/2950809886 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5fe4122a50 0x7f5fe4122ef0 unknown :-1 s=CLOSED pgs=228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:18.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.127+0000 7f5febc146c0 1 --2- 10.20.193.96:0/2950809886 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5fe4115410 0x7f5fe411d690 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:18.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.127+0000 7f5febc146c0 1 --2- 10.20.193.96:0/2950809886 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5fe410f200 0x7f5fe411d150 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:18.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.127+0000 7f5febc146c0 1 -- 10.20.193.96:0/2950809886 >> 10.20.193.96:0/2950809886 conn(0x7f5fe40ecb00 msgr2=0x7f5fe410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:18.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.127+0000 7f5febc146c0 1 -- 10.20.193.96:0/2950809886 shutdown_connections 2026-02-13T03:34:18.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.127+0000 7f5febc146c0 1 -- 10.20.193.96:0/2950809886 wait complete. 2026-02-13T03:34:18.173 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph fs set cephfs allow_standby_replay true 2026-02-13T03:34:18.289 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:18.404 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:18 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/532694790' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-13T03:34:18.404 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:18 trial096 ceph-mon[24671]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T03:34:18.404 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:18 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2950809886' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} : dispatch 2026-02-13T03:34:18.409 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.404+0000 7f500f69f6c0 1 -- 10.20.193.96:0/1159952068 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f500810d970 msgr2=0x7f50081129b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:18.409 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.404+0000 7f500f69f6c0 1 --2- 10.20.193.96:0/1159952068 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f500810d970 0x7f50081129b0 secure :-1 s=READY pgs=229 gs=1 cs=0 l=1 c_cookie=16393612117760426850 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ffc0099a0 tx=0x7f4ffc02ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:18.409 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.404+0000 7f500f69f6c0 1 -- 10.20.193.96:0/1159952068 shutdown_connections 2026-02-13T03:34:18.409 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.404+0000 7f500f69f6c0 1 --2- 10.20.193.96:0/1159952068 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5008113190 0x7f5008173b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:18.409 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.404+0000 7f500f69f6c0 1 --2- 10.20.193.96:0/1159952068 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f500810d970 0x7f50081129b0 unknown :-1 s=CLOSED pgs=229 gs=1 cs=0 l=1 c_cookie=16393612117760426850 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:18.409 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.404+0000 7f500f69f6c0 1 --2- 10.20.193.96:0/1159952068 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f500810cf80 0x7f500810d350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:18.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.404+0000 7f500f69f6c0 1 -- 10.20.193.96:0/1159952068 >> 10.20.193.96:0/1159952068 conn(0x7f50080ea880 msgr2=0x7f500810ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:18.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.404+0000 7f500f69f6c0 1 -- 10.20.193.96:0/1159952068 shutdown_connections 2026-02-13T03:34:18.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.404+0000 7f500f69f6c0 1 -- 10.20.193.96:0/1159952068 wait complete. 2026-02-13T03:34:18.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.404+0000 7f500f69f6c0 1 Processor -- start 2026-02-13T03:34:18.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.404+0000 7f500f69f6c0 1 -- start start 2026-02-13T03:34:18.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.404+0000 7f500f69f6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f500810cf80 0x7f50080f4b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:18.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.404+0000 7f500f69f6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5008113190 0x7f5008173a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:18.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.404+0000 7f500f69f6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f50080f5130 0x7f50080fa400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:18.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.404+0000 7f500f69f6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f50080f5820 con 0x7f50080f5130 2026-02-13T03:34:18.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.404+0000 7f500f69f6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f50080fa940 con 0x7f500810cf80 2026-02-13T03:34:18.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.404+0000 7f500f69f6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f50080fab00 con 0x7f5008113190 2026-02-13T03:34:18.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.404+0000 7f500dc116c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f50080f5130 0x7f50080fa400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:18.411 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.404+0000 7f500dc116c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f50080f5130 0x7f50080fa400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49804/0 (socket says 10.20.193.96:49804) 2026-02-13T03:34:18.411 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.404+0000 7f500dc116c0 1 -- 10.20.193.96:0/534864955 learned_addr learned my addr 10.20.193.96:0/534864955 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:18.411 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.404+0000 7f500d4106c0 1 --2- 10.20.193.96:0/534864955 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f500810cf80 0x7f50080f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:18.411 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.405+0000 7f500dc116c0 1 -- 10.20.193.96:0/534864955 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5008113190 msgr2=0x7f5008173a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:18.411 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.405+0000 7f500dc116c0 1 --2- 10.20.193.96:0/534864955 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5008113190 0x7f5008173a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:18.411 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.405+0000 7f500dc116c0 1 -- 10.20.193.96:0/534864955 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f500810cf80 msgr2=0x7f50080f4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:18.411 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.405+0000 7f500dc116c0 1 --2- 10.20.193.96:0/534864955 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f500810cf80 0x7f50080f4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:18.411 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.405+0000 7f500dc116c0 1 -- 10.20.193.96:0/534864955 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ffc009590 con 0x7f50080f5130 2026-02-13T03:34:18.411 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.405+0000 7f500dc116c0 1 --2- 10.20.193.96:0/534864955 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f50080f5130 0x7f50080fa400 secure :-1 s=READY pgs=230 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5004006ea0 tx=0x7f500400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:18.411 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.405+0000 7f4ff67fc6c0 1 -- 10.20.193.96:0/534864955 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5004003c40 con 0x7f50080f5130 2026-02-13T03:34:18.411 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.405+0000 7f500f69f6c0 1 -- 10.20.193.96:0/534864955 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50080fade0 con 0x7f50080f5130 2026-02-13T03:34:18.411 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.405+0000 7f4ff67fc6c0 1 -- 10.20.193.96:0/534864955 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f5004003da0 con 0x7f50080f5130 2026-02-13T03:34:18.412 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.405+0000 7f4ff67fc6c0 1 -- 10.20.193.96:0/534864955 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50040081c0 con 0x7f50080f5130 2026-02-13T03:34:18.412 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.405+0000 7f500f69f6c0 1 -- 10.20.193.96:0/534864955 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50080fb570 con 0x7f50080f5130 2026-02-13T03:34:18.412 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.405+0000 7f500f69f6c0 1 -- 10.20.193.96:0/534864955 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50080fb2c0 con 0x7f50080f5130 2026-02-13T03:34:18.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.407+0000 7f4ff67fc6c0 1 -- 10.20.193.96:0/534864955 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f5004005860 con 0x7f50080f5130 2026-02-13T03:34:18.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.407+0000 7f4ff67fc6c0 1 --2- 10.20.193.96:0/534864955 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4fe40b5600 0x7f4fe40d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:18.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.407+0000 7f4ff67fc6c0 1 -- 10.20.193.96:0/534864955 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f50040e49d0 con 0x7f50080f5130 2026-02-13T03:34:18.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.407+0000 7f500d4106c0 1 --2- 10.20.193.96:0/534864955 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4fe40b5600 0x7f4fe40d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:18.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.408+0000 7f500d4106c0 1 --2- 10.20.193.96:0/534864955 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4fe40b5600 0x7f4fe40d5ab0 secure :-1 s=READY pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ff8005980 tx=0x7f4ff8005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:18.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.408+0000 7f4ff67fc6c0 1 -- 10.20.193.96:0/534864955 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f50040a7590 con 0x7f50080f5130 2026-02-13T03:34:18.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:18 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/532694790' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-13T03:34:18.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:18 trial132 ceph-mon[26888]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T03:34:18.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:18 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2950809886' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} : dispatch 2026-02-13T03:34:18.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:18 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/532694790' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-13T03:34:18.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:18 trial133 ceph-mon[26943]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T03:34:18.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:18 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2950809886' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} : dispatch 2026-02-13T03:34:18.526 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:18.523+0000 7f500f69f6c0 1 -- 10.20.193.96:0/534864955 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f50080f5c50 con 0x7f50080f5130 2026-02-13T03:34:19.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.128+0000 7f4ff67fc6c0 1 -- 10.20.193.96:0/534864955 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f500400d620 con 0x7f50080f5130 2026-02-13T03:34:19.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.130+0000 7f500f69f6c0 1 -- 10.20.193.96:0/534864955 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4fe40b5600 msgr2=0x7f4fe40d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:19.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.130+0000 7f500f69f6c0 1 --2- 10.20.193.96:0/534864955 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4fe40b5600 0x7f4fe40d5ab0 secure :-1 s=READY pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ff8005980 tx=0x7f4ff8005910 comp rx=0 tx=0).stop 2026-02-13T03:34:19.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.130+0000 7f500f69f6c0 1 -- 10.20.193.96:0/534864955 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f50080f5130 msgr2=0x7f50080fa400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:19.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.130+0000 7f500f69f6c0 1 --2- 10.20.193.96:0/534864955 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f50080f5130 0x7f50080fa400 secure :-1 s=READY pgs=230 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5004006ea0 tx=0x7f500400ce50 comp rx=0 tx=0).stop 2026-02-13T03:34:19.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.131+0000 7f500f69f6c0 1 -- 10.20.193.96:0/534864955 shutdown_connections 2026-02-13T03:34:19.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.131+0000 7f500f69f6c0 1 --2- 10.20.193.96:0/534864955 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4fe40b5600 0x7f4fe40d5ab0 unknown :-1 s=CLOSED pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:19.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.131+0000 7f500f69f6c0 1 --2- 10.20.193.96:0/534864955 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f50080f5130 0x7f50080fa400 unknown :-1 s=CLOSED pgs=230 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:19.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.131+0000 7f500f69f6c0 1 --2- 10.20.193.96:0/534864955 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5008113190 0x7f5008173a30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:19.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.131+0000 7f500f69f6c0 1 --2- 10.20.193.96:0/534864955 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f500810cf80 0x7f50080f4b00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:19.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.131+0000 7f500f69f6c0 1 -- 10.20.193.96:0/534864955 >> 10.20.193.96:0/534864955 conn(0x7f50080ea880 msgr2=0x7f5008111810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:19.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.131+0000 7f500f69f6c0 1 -- 10.20.193.96:0/534864955 shutdown_connections 2026-02-13T03:34:19.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.131+0000 7f500f69f6c0 1 -- 10.20.193.96:0/534864955 wait complete. 2026-02-13T03:34:19.176 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph fs set cephfs session_timeout 300 2026-02-13T03:34:19.293 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:19.407 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:19 trial096 ceph-mon[24671]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-13T03:34:19.407 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:19 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2950809886' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]': finished 2026-02-13T03:34:19.407 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:19 trial096 ceph-mon[24671]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-13T03:34:19.407 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:19 trial096 ceph-mon[24671]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T03:34:19.407 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:19 trial096 ceph-mon[24671]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2026-02-13T03:34:19.408 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:19 trial096 ceph-mon[24671]: daemon mds.h is now active in filesystem cephfs as rank 1 2026-02-13T03:34:19.408 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:19 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/534864955' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T03:34:19.408 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:19 trial096 ceph-mon[24671]: pgmap v185: 97 pgs: 14 creating+peering, 83 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail; 1.8 KiB/s wr, 2 op/s 2026-02-13T03:34:19.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.408+0000 7fade9b606c0 1 -- 10.20.193.96:0/2800526364 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fade410cfb0 msgr2=0x7fade410d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:19.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.408+0000 7fade9b606c0 1 --2- 10.20.193.96:0/2800526364 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fade410cfb0 0x7fade410d380 secure :-1 s=READY pgs=231 gs=1 cs=0 l=1 c_cookie=3793099169309712005 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fadd00099a0 tx=0x7fadd002ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:19.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.408+0000 7fade9b606c0 1 -- 10.20.193.96:0/2800526364 shutdown_connections 2026-02-13T03:34:19.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.408+0000 7fade9b606c0 1 --2- 10.20.193.96:0/2800526364 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fade41131c0 0x7fade4173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:19.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.408+0000 7fade9b606c0 1 --2- 10.20.193.96:0/2800526364 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fade410d9a0 0x7fade41129e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:19.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.408+0000 7fade9b606c0 1 --2- 10.20.193.96:0/2800526364 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fade410cfb0 0x7fade410d380 unknown :-1 s=CLOSED pgs=231 gs=1 cs=0 l=1 c_cookie=3793099169309712005 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:19.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.408+0000 7fade9b606c0 1 -- 10.20.193.96:0/2800526364 >> 10.20.193.96:0/2800526364 conn(0x7fade40ea8b0 msgr2=0x7fade410acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:19.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.408+0000 7fade9b606c0 1 -- 10.20.193.96:0/2800526364 shutdown_connections 2026-02-13T03:34:19.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.408+0000 7fade9b606c0 1 -- 10.20.193.96:0/2800526364 wait complete. 2026-02-13T03:34:19.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.409+0000 7fade9b606c0 1 Processor -- start 2026-02-13T03:34:19.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.409+0000 7fade9b606c0 1 -- start start 2026-02-13T03:34:19.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.409+0000 7fade9b606c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fade410cfb0 0x7fade40f4bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:19.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.409+0000 7fade9b606c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fade41131c0 0x7fade4173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:19.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.409+0000 7fade9b606c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fade40f51f0 0x7fade40fa4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:19.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.409+0000 7fade9b606c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fade40f58e0 con 0x7fade40f51f0 2026-02-13T03:34:19.415 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.409+0000 7fade9b606c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fade40faa00 con 0x7fade410cfb0 2026-02-13T03:34:19.415 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.409+0000 7fade9b606c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fade40fabc0 con 0x7fade41131c0 2026-02-13T03:34:19.415 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.409+0000 7fade3fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fade40f51f0 0x7fade40fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:19.415 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.409+0000 7fade3fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fade40f51f0 0x7fade40fa4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49826/0 (socket says 10.20.193.96:49826) 2026-02-13T03:34:19.415 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.409+0000 7fade3fff6c0 1 -- 10.20.193.96:0/2736423227 learned_addr learned my addr 10.20.193.96:0/2736423227 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:19.415 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.409+0000 7fade2ffd6c0 1 --2- 10.20.193.96:0/2736423227 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fade41131c0 0x7fade4173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:19.415 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.409+0000 7fade3fff6c0 1 -- 10.20.193.96:0/2736423227 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fade41131c0 msgr2=0x7fade4173a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:19.415 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.409+0000 7fade3fff6c0 1 --2- 10.20.193.96:0/2736423227 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fade41131c0 0x7fade4173a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:19.415 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.409+0000 7fade3fff6c0 1 -- 10.20.193.96:0/2736423227 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fade410cfb0 msgr2=0x7fade40f4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:19.415 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.409+0000 7fade3fff6c0 1 --2- 10.20.193.96:0/2736423227 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fade410cfb0 0x7fade40f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:19.415 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.409+0000 7fade3fff6c0 1 -- 10.20.193.96:0/2736423227 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd0009590 con 0x7fade40f51f0 2026-02-13T03:34:19.415 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.409+0000 7fade3fff6c0 1 --2- 10.20.193.96:0/2736423227 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fade40f51f0 0x7fade40fa4c0 secure :-1 s=READY pgs=232 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fadd8006ea0 tx=0x7fadd800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:19.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.409+0000 7fade0ff96c0 1 -- 10.20.193.96:0/2736423227 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fadd8003a30 con 0x7fade40f51f0 2026-02-13T03:34:19.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.409+0000 7fade0ff96c0 1 -- 10.20.193.96:0/2736423227 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fadd8005510 con 0x7fade40f51f0 2026-02-13T03:34:19.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.409+0000 7fade9b606c0 1 -- 10.20.193.96:0/2736423227 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade40faea0 con 0x7fade40f51f0 2026-02-13T03:34:19.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.409+0000 7fade0ff96c0 1 -- 10.20.193.96:0/2736423227 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fadd800dd70 con 0x7fade40f51f0 2026-02-13T03:34:19.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.409+0000 7fade9b606c0 1 -- 10.20.193.96:0/2736423227 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade40fb630 con 0x7fade40f51f0 2026-02-13T03:34:19.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.410+0000 7fade9b606c0 1 -- 10.20.193.96:0/2736423227 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade410e280 con 0x7fade40f51f0 2026-02-13T03:34:19.417 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.411+0000 7fade0ff96c0 1 -- 10.20.193.96:0/2736423227 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7fadd8003b90 con 0x7fade40f51f0 2026-02-13T03:34:19.417 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.412+0000 7fade0ff96c0 1 --2- 10.20.193.96:0/2736423227 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fadb80b5680 0x7fadb80d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:19.417 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.412+0000 7fade0ff96c0 1 -- 10.20.193.96:0/2736423227 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7fadd80e4960 con 0x7fade40f51f0 2026-02-13T03:34:19.417 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.412+0000 7fade37fe6c0 1 --2- 10.20.193.96:0/2736423227 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fadb80b5680 0x7fadb80d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:19.417 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.412+0000 7fade37fe6c0 1 --2- 10.20.193.96:0/2736423227 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fadb80b5680 0x7fadb80d5b30 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fadd0005b40 tx=0x7fadd0005c20 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:19.417 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.412+0000 7fade0ff96c0 1 -- 10.20.193.96:0/2736423227 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fadd80a74e0 con 0x7fade40f51f0 2026-02-13T03:34:19.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:19 trial132 ceph-mon[26888]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-13T03:34:19.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:19 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2950809886' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]': finished 2026-02-13T03:34:19.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:19 trial132 ceph-mon[26888]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-13T03:34:19.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:19 trial132 ceph-mon[26888]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T03:34:19.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:19 trial132 ceph-mon[26888]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2026-02-13T03:34:19.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:19 trial132 ceph-mon[26888]: daemon mds.h is now active in filesystem cephfs as rank 1 2026-02-13T03:34:19.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:19 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/534864955' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T03:34:19.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:19 trial132 ceph-mon[26888]: pgmap v185: 97 pgs: 14 creating+peering, 83 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail; 1.8 KiB/s wr, 2 op/s 2026-02-13T03:34:19.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:19 trial133 ceph-mon[26943]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-13T03:34:19.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:19 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2950809886' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]': finished 2026-02-13T03:34:19.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:19 trial133 ceph-mon[26943]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-13T03:34:19.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:19 trial133 ceph-mon[26943]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T03:34:19.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:19 trial133 ceph-mon[26943]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2026-02-13T03:34:19.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:19 trial133 ceph-mon[26943]: daemon mds.h is now active in filesystem cephfs as rank 1 2026-02-13T03:34:19.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:19 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/534864955' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T03:34:19.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:19 trial133 ceph-mon[26943]: pgmap v185: 97 pgs: 14 creating+peering, 83 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail; 1.8 KiB/s wr, 2 op/s 2026-02-13T03:34:19.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:19.529+0000 7fade9b606c0 1 -- 10.20.193.96:0/2736423227 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fade40f5d10 con 0x7fade40f51f0 2026-02-13T03:34:20.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.132+0000 7fade0ff96c0 1 -- 10.20.193.96:0/2736423227 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7fadd80aa690 con 0x7fade40f51f0 2026-02-13T03:34:20.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.135+0000 7fade9b606c0 1 -- 10.20.193.96:0/2736423227 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fadb80b5680 msgr2=0x7fadb80d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:20.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.135+0000 7fade9b606c0 1 --2- 10.20.193.96:0/2736423227 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fadb80b5680 0x7fadb80d5b30 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fadd0005b40 tx=0x7fadd0005c20 comp rx=0 tx=0).stop 2026-02-13T03:34:20.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.135+0000 7fade9b606c0 1 -- 10.20.193.96:0/2736423227 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fade40f51f0 msgr2=0x7fade40fa4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:20.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.135+0000 7fade9b606c0 1 --2- 10.20.193.96:0/2736423227 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fade40f51f0 0x7fade40fa4c0 secure :-1 s=READY pgs=232 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fadd8006ea0 tx=0x7fadd800cca0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.135+0000 7fade9b606c0 1 -- 10.20.193.96:0/2736423227 shutdown_connections 2026-02-13T03:34:20.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.135+0000 7fade9b606c0 1 --2- 10.20.193.96:0/2736423227 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fadb80b5680 0x7fadb80d5b30 unknown :-1 s=CLOSED pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.135+0000 7fade9b606c0 1 --2- 10.20.193.96:0/2736423227 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fade40f51f0 0x7fade40fa4c0 unknown :-1 s=CLOSED pgs=232 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.135+0000 7fade9b606c0 1 --2- 10.20.193.96:0/2736423227 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fade41131c0 0x7fade4173a60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.135+0000 7fade9b606c0 1 --2- 10.20.193.96:0/2736423227 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fade410cfb0 0x7fade40f4bc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.135+0000 7fade9b606c0 1 -- 10.20.193.96:0/2736423227 >> 10.20.193.96:0/2736423227 conn(0x7fade40ea8b0 msgr2=0x7fade4111840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:20.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.135+0000 7fade9b606c0 1 -- 10.20.193.96:0/2736423227 shutdown_connections 2026-02-13T03:34:20.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.135+0000 7fade9b606c0 1 -- 10.20.193.96:0/2736423227 wait complete. 2026-02-13T03:34:20.177 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2026-02-13T03:34:20.178 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph fs subvolumegroup create cephfs qa 2026-02-13T03:34:20.294 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:20.409 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:20 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/534864955' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-13T03:34:20.409 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:20 trial096 ceph-mon[24671]: mds.? [v2:10.20.193.132:6836/768182548,v1:10.20.193.132:6837/768182548] up:active 2026-02-13T03:34:20.409 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:20 trial096 ceph-mon[24671]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-13T03:34:20.409 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:20 trial096 ceph-mon[24671]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-13T03:34:20.409 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:20 trial096 ceph-mon[24671]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2026-02-13T03:34:20.409 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:20 trial096 ceph-mon[24671]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2026-02-13T03:34:20.409 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:20 trial096 ceph-mon[24671]: daemon mds.i is now active in filesystem cephfs as rank 2 2026-02-13T03:34:20.409 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:20 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2736423227' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T03:34:20.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.411+0000 7f0f6903c6c0 1 -- 10.20.193.96:0/997176973 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0f64115440 msgr2=0x7f0f64175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:20.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.411+0000 7f0f6903c6c0 1 --2- 10.20.193.96:0/997176973 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0f64115440 0x7f0f64175de0 secure :-1 s=READY pgs=233 gs=1 cs=0 l=1 c_cookie=12588304734794722431 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f5400aa70 tx=0x7f0f5402fde0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.411+0000 7f0f6903c6c0 1 -- 10.20.193.96:0/997176973 shutdown_connections 2026-02-13T03:34:20.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.411+0000 7f0f6903c6c0 1 --2- 10.20.193.96:0/997176973 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0f64115440 0x7f0f64175de0 unknown :-1 s=CLOSED pgs=233 gs=1 cs=0 l=1 c_cookie=12588304734794722431 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.411+0000 7f0f6903c6c0 1 --2- 10.20.193.96:0/997176973 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0f6410fc20 0x7f0f64114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.411+0000 7f0f6903c6c0 1 --2- 10.20.193.96:0/997176973 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0f6410f230 0x7f0f6410f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.411+0000 7f0f6903c6c0 1 -- 10.20.193.96:0/997176973 >> 10.20.193.96:0/997176973 conn(0x7f0f640ecb30 msgr2=0x7f0f6410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:20.415 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.411+0000 7f0f6903c6c0 1 -- 10.20.193.96:0/997176973 shutdown_connections 2026-02-13T03:34:20.415 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.411+0000 7f0f6903c6c0 1 -- 10.20.193.96:0/997176973 wait complete. 2026-02-13T03:34:20.415 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.412+0000 7f0f6903c6c0 1 Processor -- start 2026-02-13T03:34:20.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.412+0000 7f0f6903c6c0 1 -- start start 2026-02-13T03:34:20.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.412+0000 7f0f6903c6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0f6410f230 0x7f0f6411d230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:20.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.412+0000 7f0f6903c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0f64115440 0x7f0f6411d770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:20.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.412+0000 7f0f6903c6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0f64122b30 0x7f0f64122fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:20.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.412+0000 7f0f6903c6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0f64123540 con 0x7f0f64115440 2026-02-13T03:34:20.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.412+0000 7f0f6903c6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0f641236b0 con 0x7f0f6410f230 2026-02-13T03:34:20.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.412+0000 7f0f6903c6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0f64123870 con 0x7f0f64122b30 2026-02-13T03:34:20.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.412+0000 7f0f625756c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0f64115440 0x7f0f6411d770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:20.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.412+0000 7f0f625756c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0f64115440 0x7f0f6411d770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49854/0 (socket says 10.20.193.96:49854) 2026-02-13T03:34:20.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.412+0000 7f0f625756c0 1 -- 10.20.193.96:0/1693434491 learned_addr learned my addr 10.20.193.96:0/1693434491 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:20.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.412+0000 7f0f625756c0 1 -- 10.20.193.96:0/1693434491 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0f64122b30 msgr2=0x7f0f64122fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:20.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.412+0000 7f0f625756c0 1 --2- 10.20.193.96:0/1693434491 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0f64122b30 0x7f0f64122fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.412+0000 7f0f625756c0 1 -- 10.20.193.96:0/1693434491 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0f6410f230 msgr2=0x7f0f6411d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:20.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.412+0000 7f0f625756c0 1 --2- 10.20.193.96:0/1693434491 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0f6410f230 0x7f0f6411d230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.412+0000 7f0f625756c0 1 -- 10.20.193.96:0/1693434491 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5400a660 con 0x7f0f64115440 2026-02-13T03:34:20.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.412+0000 7f0f625756c0 1 --2- 10.20.193.96:0/1693434491 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0f64115440 0x7f0f6411d770 secure :-1 s=READY pgs=234 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f4c005dc0 tx=0x7f0f4c00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:20.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.412+0000 7f0f43fff6c0 1 -- 10.20.193.96:0/1693434491 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0f4c004250 con 0x7f0f64115440 2026-02-13T03:34:20.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.412+0000 7f0f43fff6c0 1 -- 10.20.193.96:0/1693434491 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f0f4c009070 con 0x7f0f64115440 2026-02-13T03:34:20.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.413+0000 7f0f6903c6c0 1 -- 10.20.193.96:0/1693434491 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f64163d20 con 0x7f0f64115440 2026-02-13T03:34:20.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.413+0000 7f0f43fff6c0 1 -- 10.20.193.96:0/1693434491 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0f4c00cdb0 con 0x7f0f64115440 2026-02-13T03:34:20.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.413+0000 7f0f6903c6c0 1 -- 10.20.193.96:0/1693434491 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f64164200 con 0x7f0f64115440 2026-02-13T03:34:20.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.413+0000 7f0f6903c6c0 1 -- 10.20.193.96:0/1693434491 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f64110500 con 0x7f0f64115440 2026-02-13T03:34:20.417 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.414+0000 7f0f43fff6c0 1 -- 10.20.193.96:0/1693434491 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f0f4c0028c0 con 0x7f0f64115440 2026-02-13T03:34:20.417 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.415+0000 7f0f43fff6c0 1 --2- 10.20.193.96:0/1693434491 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f0f380b5680 0x7f0f380d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:20.418 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.415+0000 7f0f62d766c0 1 --2- 10.20.193.96:0/1693434491 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f0f380b5680 0x7f0f380d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:20.418 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.415+0000 7f0f43fff6c0 1 -- 10.20.193.96:0/1693434491 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f0f4c0e38c0 con 0x7f0f64115440 2026-02-13T03:34:20.418 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.415+0000 7f0f62d766c0 1 --2- 10.20.193.96:0/1693434491 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f0f380b5680 0x7f0f380d5b30 secure :-1 s=READY pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f58005980 tx=0x7f0f58005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:20.418 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.415+0000 7f0f43fff6c0 1 -- 10.20.193.96:0/1693434491 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0f4c0a6440 con 0x7f0f64115440 2026-02-13T03:34:20.482 INFO:journalctl@ceph.mds.b.trial132.stdout:Feb 13 03:34:20 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-b[55456]: 2026-02-13T03:34:20.111+0000 7f26f51086c0 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2026-02-13T03:34:20.483 INFO:journalctl@ceph.mds.b.trial132.stdout:Feb 13 03:34:20 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-b[55456]: 2026-02-13T03:34:20.111+0000 7f26f51086c0 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2026-02-13T03:34:20.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:20 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/534864955' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-13T03:34:20.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:20 trial132 ceph-mon[26888]: mds.? [v2:10.20.193.132:6836/768182548,v1:10.20.193.132:6837/768182548] up:active 2026-02-13T03:34:20.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:20 trial132 ceph-mon[26888]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-13T03:34:20.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:20 trial132 ceph-mon[26888]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-13T03:34:20.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:20 trial132 ceph-mon[26888]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2026-02-13T03:34:20.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:20 trial132 ceph-mon[26888]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2026-02-13T03:34:20.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:20 trial132 ceph-mon[26888]: daemon mds.i is now active in filesystem cephfs as rank 2 2026-02-13T03:34:20.484 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:20 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2736423227' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T03:34:20.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:20 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/534864955' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-13T03:34:20.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:20 trial133 ceph-mon[26943]: mds.? [v2:10.20.193.132:6836/768182548,v1:10.20.193.132:6837/768182548] up:active 2026-02-13T03:34:20.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:20 trial133 ceph-mon[26943]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-13T03:34:20.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:20 trial133 ceph-mon[26943]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-13T03:34:20.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:20 trial133 ceph-mon[26943]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2026-02-13T03:34:20.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:20 trial133 ceph-mon[26943]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2026-02-13T03:34:20.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:20 trial133 ceph-mon[26943]: daemon mds.i is now active in filesystem cephfs as rank 2 2026-02-13T03:34:20.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:20 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2736423227' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T03:34:20.528 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.525+0000 7f0f6903c6c0 1 -- 10.20.193.96:0/1693434491 --> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0f6411e3f0 con 0x7f0f380b5680 2026-02-13T03:34:20.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.541+0000 7f0f43fff6c0 1 -- 10.20.193.96:0/1693434491 <== mgr.14116 v2:10.20.193.96:6800/1736050816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0f6411e3f0 con 0x7f0f380b5680 2026-02-13T03:34:20.546 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.543+0000 7f0f6903c6c0 1 -- 10.20.193.96:0/1693434491 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f0f380b5680 msgr2=0x7f0f380d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:20.546 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.543+0000 7f0f6903c6c0 1 --2- 10.20.193.96:0/1693434491 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f0f380b5680 0x7f0f380d5b30 secure :-1 s=READY pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f58005980 tx=0x7f0f58005910 comp rx=0 tx=0).stop 2026-02-13T03:34:20.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.543+0000 7f0f6903c6c0 1 -- 10.20.193.96:0/1693434491 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0f64115440 msgr2=0x7f0f6411d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:20.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.543+0000 7f0f6903c6c0 1 --2- 10.20.193.96:0/1693434491 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0f64115440 0x7f0f6411d770 secure :-1 s=READY pgs=234 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f4c005dc0 tx=0x7f0f4c00bbb0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.543+0000 7f0f6903c6c0 1 -- 10.20.193.96:0/1693434491 shutdown_connections 2026-02-13T03:34:20.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.543+0000 7f0f6903c6c0 1 --2- 10.20.193.96:0/1693434491 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f0f380b5680 0x7f0f380d5b30 unknown :-1 s=CLOSED pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.543+0000 7f0f6903c6c0 1 --2- 10.20.193.96:0/1693434491 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0f64122b30 0x7f0f64122fd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.543+0000 7f0f6903c6c0 1 --2- 10.20.193.96:0/1693434491 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0f64115440 0x7f0f6411d770 unknown :-1 s=CLOSED pgs=234 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.543+0000 7f0f6903c6c0 1 --2- 10.20.193.96:0/1693434491 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0f6410f230 0x7f0f6411d230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.543+0000 7f0f6903c6c0 1 -- 10.20.193.96:0/1693434491 >> 10.20.193.96:0/1693434491 conn(0x7f0f640ecb30 msgr2=0x7f0f6410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:20.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.543+0000 7f0f6903c6c0 1 -- 10.20.193.96:0/1693434491 shutdown_connections 2026-02-13T03:34:20.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.543+0000 7f0f6903c6c0 1 -- 10.20.193.96:0/1693434491 wait complete. 2026-02-13T03:34:20.587 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2026-02-13T03:34:20.674 INFO:journalctl@ceph.mgr.x.trial096.stdout:Feb 13 03:34:20 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mgr-x[24925]: 2026-02-13T03:34:20.532+0000 7f9ebd5a76c0 -1 client.14856 error registering admin socket command: (17) File exists 2026-02-13T03:34:20.704 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:20.826 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.821+0000 7f9ed6e786c0 1 -- 10.20.193.96:0/1663292671 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9ed0115440 msgr2=0x7f9ed0175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:20.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.821+0000 7f9ed6e786c0 1 --2- 10.20.193.96:0/1663292671 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9ed0115440 0x7f9ed0175de0 secure :-1 s=READY pgs=237 gs=1 cs=0 l=1 c_cookie=6280422688325342426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ecc00aa70 tx=0x7f9ecc02fde0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.821+0000 7f9ed6e786c0 1 -- 10.20.193.96:0/1663292671 shutdown_connections 2026-02-13T03:34:20.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.821+0000 7f9ed6e786c0 1 --2- 10.20.193.96:0/1663292671 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9ed0115440 0x7f9ed0175de0 unknown :-1 s=CLOSED pgs=237 gs=1 cs=0 l=1 c_cookie=6280422688325342426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.821+0000 7f9ed6e786c0 1 --2- 10.20.193.96:0/1663292671 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9ed010fc20 0x7f9ed0114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.821+0000 7f9ed6e786c0 1 --2- 10.20.193.96:0/1663292671 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9ed010f230 0x7f9ed010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.821+0000 7f9ed6e786c0 1 -- 10.20.193.96:0/1663292671 >> 10.20.193.96:0/1663292671 conn(0x7f9ed00ecb30 msgr2=0x7f9ed010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:20.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.821+0000 7f9ed6e786c0 1 -- 10.20.193.96:0/1663292671 shutdown_connections 2026-02-13T03:34:20.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.821+0000 7f9ed6e786c0 1 -- 10.20.193.96:0/1663292671 wait complete. 2026-02-13T03:34:20.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ed6e786c0 1 Processor -- start 2026-02-13T03:34:20.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ed6e786c0 1 -- start start 2026-02-13T03:34:20.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ed6e786c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9ed010f230 0x7f9ed011d140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:20.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ed6e786c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9ed0115440 0x7f9ed011d680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:20.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ed6e786c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9ed0122a40 0x7f9ed0122ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:20.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ed6e786c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed0123450 con 0x7f9ed010f230 2026-02-13T03:34:20.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ed6e786c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed01235c0 con 0x7f9ed0115440 2026-02-13T03:34:20.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ed6e786c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed0123780 con 0x7f9ed0122a40 2026-02-13T03:34:20.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ed4bed6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9ed010f230 0x7f9ed011d140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:20.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ed4bed6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9ed010f230 0x7f9ed011d140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49894/0 (socket says 10.20.193.96:49894) 2026-02-13T03:34:20.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ed4bed6c0 1 -- 10.20.193.96:0/3860243146 learned_addr learned my addr 10.20.193.96:0/3860243146 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:20.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ec7fff6c0 1 --2- 10.20.193.96:0/3860243146 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9ed0115440 0x7f9ed011d680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:20.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ed53ee6c0 1 --2- 10.20.193.96:0/3860243146 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9ed0122a40 0x7f9ed0122ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:20.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ed4bed6c0 1 -- 10.20.193.96:0/3860243146 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9ed0122a40 msgr2=0x7f9ed0122ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:20.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ed4bed6c0 1 --2- 10.20.193.96:0/3860243146 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9ed0122a40 0x7f9ed0122ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ed4bed6c0 1 -- 10.20.193.96:0/3860243146 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9ed0115440 msgr2=0x7f9ed011d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:20.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ed4bed6c0 1 --2- 10.20.193.96:0/3860243146 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9ed0115440 0x7f9ed011d680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ed4bed6c0 1 -- 10.20.193.96:0/3860243146 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ecc00a660 con 0x7f9ed010f230 2026-02-13T03:34:20.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ed53ee6c0 1 --2- 10.20.193.96:0/3860243146 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9ed0122a40 0x7f9ed0122ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:34:20.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ec7fff6c0 1 --2- 10.20.193.96:0/3860243146 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9ed0115440 0x7f9ed011d680 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:34:20.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ed4bed6c0 1 --2- 10.20.193.96:0/3860243146 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9ed010f230 0x7f9ed011d140 secure :-1 s=READY pgs=238 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ec00092e0 tx=0x7f9ec000bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:20.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ec5ffb6c0 1 -- 10.20.193.96:0/3860243146 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ec0004250 con 0x7f9ed010f230 2026-02-13T03:34:20.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ed6e786c0 1 -- 10.20.193.96:0/3860243146 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ed0163c30 con 0x7f9ed010f230 2026-02-13T03:34:20.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ec5ffb6c0 1 -- 10.20.193.96:0/3860243146 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f9ec00043b0 con 0x7f9ed010f230 2026-02-13T03:34:20.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ec5ffb6c0 1 -- 10.20.193.96:0/3860243146 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ec000cd90 con 0x7f9ed010f230 2026-02-13T03:34:20.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.822+0000 7f9ed6e786c0 1 -- 10.20.193.96:0/3860243146 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ed01640c0 con 0x7f9ed010f230 2026-02-13T03:34:20.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.823+0000 7f9ed6e786c0 1 -- 10.20.193.96:0/3860243146 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ed0110500 con 0x7f9ed010f230 2026-02-13T03:34:20.831 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.824+0000 7f9ec5ffb6c0 1 -- 10.20.193.96:0/3860243146 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f9ec00026b0 con 0x7f9ed010f230 2026-02-13T03:34:20.831 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.825+0000 7f9ec5ffb6c0 1 --2- 10.20.193.96:0/3860243146 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9eac0b5600 0x7f9eac0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:20.831 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.825+0000 7f9ec7fff6c0 1 --2- 10.20.193.96:0/3860243146 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9eac0b5600 0x7f9eac0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:20.831 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.825+0000 7f9ec5ffb6c0 1 -- 10.20.193.96:0/3860243146 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f9ec00e39d0 con 0x7f9ed010f230 2026-02-13T03:34:20.831 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.825+0000 7f9ec7fff6c0 1 --2- 10.20.193.96:0/3860243146 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9eac0b5600 0x7f9eac0d5ab0 secure :-1 s=READY pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9eb8005fd0 tx=0x7f9eb8005d50 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:20.831 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.825+0000 7f9ec5ffb6c0 1 -- 10.20.193.96:0/3860243146 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9ec00e3e50 con 0x7f9ed010f230 2026-02-13T03:34:20.937 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.934+0000 7f9ed6e786c0 1 -- 10.20.193.96:0/3860243146 --> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f9ed010fc20 con 0x7f9eac0b5600 2026-02-13T03:34:20.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.947+0000 7f9ec5ffb6c0 1 -- 10.20.193.96:0/3860243146 <== mgr.14116 v2:10.20.193.96:6800/1736050816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9ed010fc20 con 0x7f9eac0b5600 2026-02-13T03:34:20.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.948+0000 7f9ed6e786c0 1 -- 10.20.193.96:0/3860243146 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9eac0b5600 msgr2=0x7f9eac0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:20.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.948+0000 7f9ed6e786c0 1 --2- 10.20.193.96:0/3860243146 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9eac0b5600 0x7f9eac0d5ab0 secure :-1 s=READY pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9eb8005fd0 tx=0x7f9eb8005d50 comp rx=0 tx=0).stop 2026-02-13T03:34:20.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.948+0000 7f9ed6e786c0 1 -- 10.20.193.96:0/3860243146 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9ed010f230 msgr2=0x7f9ed011d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:20.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.948+0000 7f9ed6e786c0 1 --2- 10.20.193.96:0/3860243146 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9ed010f230 0x7f9ed011d140 secure :-1 s=READY pgs=238 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ec00092e0 tx=0x7f9ec000bc50 comp rx=0 tx=0).stop 2026-02-13T03:34:20.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.948+0000 7f9ed6e786c0 1 -- 10.20.193.96:0/3860243146 shutdown_connections 2026-02-13T03:34:20.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.948+0000 7f9ed6e786c0 1 --2- 10.20.193.96:0/3860243146 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9eac0b5600 0x7f9eac0d5ab0 unknown :-1 s=CLOSED pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.948+0000 7f9ed6e786c0 1 --2- 10.20.193.96:0/3860243146 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9ed0122a40 0x7f9ed0122ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.948+0000 7f9ed6e786c0 1 --2- 10.20.193.96:0/3860243146 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9ed0115440 0x7f9ed011d680 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.948+0000 7f9ed6e786c0 1 --2- 10.20.193.96:0/3860243146 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9ed010f230 0x7f9ed011d140 unknown :-1 s=CLOSED pgs=238 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:20.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.948+0000 7f9ed6e786c0 1 -- 10.20.193.96:0/3860243146 >> 10.20.193.96:0/3860243146 conn(0x7f9ed00ecb30 msgr2=0x7f9ed010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:20.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.948+0000 7f9ed6e786c0 1 -- 10.20.193.96:0/3860243146 shutdown_connections 2026-02-13T03:34:20.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:20.948+0000 7f9ed6e786c0 1 -- 10.20.193.96:0/3860243146 wait complete. 2026-02-13T03:34:20.993 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2026-02-13T03:34:21.112 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:21.230 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e29f86c0 1 -- 10.20.193.96:0/1006493952 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff0dc10f230 msgr2=0x7ff0dc10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:21.230 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e29f86c0 1 --2- 10.20.193.96:0/1006493952 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff0dc10f230 0x7ff0dc10f600 secure :-1 s=READY pgs=239 gs=1 cs=0 l=1 c_cookie=867405629023710206 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0c80099a0 tx=0x7ff0c802ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:21.230 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e29f86c0 1 -- 10.20.193.96:0/1006493952 shutdown_connections 2026-02-13T03:34:21.231 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e29f86c0 1 --2- 10.20.193.96:0/1006493952 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff0dc115440 0x7ff0dc175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:21.231 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e29f86c0 1 --2- 10.20.193.96:0/1006493952 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff0dc10fc20 0x7ff0dc114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:21.231 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e29f86c0 1 --2- 10.20.193.96:0/1006493952 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff0dc10f230 0x7ff0dc10f600 unknown :-1 s=CLOSED pgs=239 gs=1 cs=0 l=1 c_cookie=867405629023710206 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:21.231 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e29f86c0 1 -- 10.20.193.96:0/1006493952 >> 10.20.193.96:0/1006493952 conn(0x7ff0dc0ecb30 msgr2=0x7ff0dc10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:21.231 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e29f86c0 1 -- 10.20.193.96:0/1006493952 shutdown_connections 2026-02-13T03:34:21.231 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e29f86c0 1 -- 10.20.193.96:0/1006493952 wait complete. 2026-02-13T03:34:21.231 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:21 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2736423227' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-13T03:34:21.232 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:21 trial096 ceph-mon[24671]: mds.? [v2:10.20.193.133:6838/3735956625,v1:10.20.193.133:6839/3735956625] up:active 2026-02-13T03:34:21.232 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:21 trial096 ceph-mon[24671]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2026-02-13T03:34:21.232 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:21 trial096 ceph-mon[24671]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2026-02-13T03:34:21.232 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:21 trial096 ceph-mon[24671]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:34:21.232 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:21 trial096 ceph-mon[24671]: pgmap v186: 97 pgs: 97 active+clean; 580 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 5.3 KiB/s wr, 16 op/s 2026-02-13T03:34:21.232 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:21 trial096 ceph-mon[24671]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:34:21.235 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e29f86c0 1 Processor -- start 2026-02-13T03:34:21.235 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e29f86c0 1 -- start start 2026-02-13T03:34:21.235 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e29f86c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff0dc10f230 0x7ff0dc11d280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:21.235 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e29f86c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff0dc115440 0x7ff0dc11d7c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:21.235 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e29f86c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff0dc122b80 0x7ff0dc123020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:21.235 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e29f86c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc123560 con 0x7ff0dc122b80 2026-02-13T03:34:21.235 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e29f86c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc1236d0 con 0x7ff0dc10f230 2026-02-13T03:34:21.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e29f86c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc123890 con 0x7ff0dc115440 2026-02-13T03:34:21.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e0f6e6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff0dc122b80 0x7ff0dc123020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:21.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e0f6e6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff0dc122b80 0x7ff0dc123020 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49920/0 (socket says 10.20.193.96:49920) 2026-02-13T03:34:21.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e0f6e6c0 1 -- 10.20.193.96:0/3046542372 learned_addr learned my addr 10.20.193.96:0/3046542372 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:21.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0dbfff6c0 1 --2- 10.20.193.96:0/3046542372 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff0dc10f230 0x7ff0dc11d280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:21.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0db7fe6c0 1 --2- 10.20.193.96:0/3046542372 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff0dc115440 0x7ff0dc11d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:21.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e0f6e6c0 1 -- 10.20.193.96:0/3046542372 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff0dc115440 msgr2=0x7ff0dc11d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:21.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e0f6e6c0 1 --2- 10.20.193.96:0/3046542372 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff0dc115440 0x7ff0dc11d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:21.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e0f6e6c0 1 -- 10.20.193.96:0/3046542372 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff0dc10f230 msgr2=0x7ff0dc11d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:21.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e0f6e6c0 1 --2- 10.20.193.96:0/3046542372 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff0dc10f230 0x7ff0dc11d280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:21.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0e0f6e6c0 1 -- 10.20.193.96:0/3046542372 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c8009590 con 0x7ff0dc122b80 2026-02-13T03:34:21.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.227+0000 7ff0dbfff6c0 1 --2- 10.20.193.96:0/3046542372 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff0dc10f230 0x7ff0dc11d280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:34:21.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.228+0000 7ff0e0f6e6c0 1 --2- 10.20.193.96:0/3046542372 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff0dc122b80 0x7ff0dc123020 secure :-1 s=READY pgs=240 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0d0006ea0 tx=0x7ff0d000ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:21.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.228+0000 7ff0d97fa6c0 1 -- 10.20.193.96:0/3046542372 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff0d0003c40 con 0x7ff0dc122b80 2026-02-13T03:34:21.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.228+0000 7ff0d97fa6c0 1 -- 10.20.193.96:0/3046542372 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7ff0d0003da0 con 0x7ff0dc122b80 2026-02-13T03:34:21.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.228+0000 7ff0e29f86c0 1 -- 10.20.193.96:0/3046542372 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0dc163d10 con 0x7ff0dc122b80 2026-02-13T03:34:21.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.228+0000 7ff0d97fa6c0 1 -- 10.20.193.96:0/3046542372 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff0d00081c0 con 0x7ff0dc122b80 2026-02-13T03:34:21.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.228+0000 7ff0e29f86c0 1 -- 10.20.193.96:0/3046542372 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0dc1641f0 con 0x7ff0dc122b80 2026-02-13T03:34:21.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.228+0000 7ff0e29f86c0 1 -- 10.20.193.96:0/3046542372 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0dc110500 con 0x7ff0dc122b80 2026-02-13T03:34:21.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.229+0000 7ff0d97fa6c0 1 -- 10.20.193.96:0/3046542372 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7ff0d0005860 con 0x7ff0dc122b80 2026-02-13T03:34:21.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.230+0000 7ff0d97fa6c0 1 --2- 10.20.193.96:0/3046542372 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff0b00b5600 0x7ff0b00d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:21.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.230+0000 7ff0dbfff6c0 1 --2- 10.20.193.96:0/3046542372 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff0b00b5600 0x7ff0b00d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:21.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.230+0000 7ff0d97fa6c0 1 -- 10.20.193.96:0/3046542372 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7ff0d00e49d0 con 0x7ff0dc122b80 2026-02-13T03:34:21.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.230+0000 7ff0d97fa6c0 1 -- 10.20.193.96:0/3046542372 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff0d00aa560 con 0x7ff0dc122b80 2026-02-13T03:34:21.238 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.230+0000 7ff0dbfff6c0 1 --2- 10.20.193.96:0/3046542372 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff0b00b5600 0x7ff0b00d5ab0 secure :-1 s=READY pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0c80023e0 tx=0x7ff0c8005c40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:21.342 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.339+0000 7ff0e29f86c0 1 -- 10.20.193.96:0/3046542372 --> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7ff0dc11e3d0 con 0x7ff0b00b5600 2026-02-13T03:34:21.345 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.342+0000 7ff0d97fa6c0 1 -- 10.20.193.96:0/3046542372 <== mgr.14116 v2:10.20.193.96:6800/1736050816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7ff0dc11e3d0 con 0x7ff0b00b5600 2026-02-13T03:34:21.345 INFO:teuthology.orchestra.run.trial096.stdout:/volumes/qa/sv_0/7a038cee-ec0f-44cc-8616-56567c1d55c3 2026-02-13T03:34:21.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.343+0000 7ff0e29f86c0 1 -- 10.20.193.96:0/3046542372 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff0b00b5600 msgr2=0x7ff0b00d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:21.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.343+0000 7ff0e29f86c0 1 --2- 10.20.193.96:0/3046542372 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff0b00b5600 0x7ff0b00d5ab0 secure :-1 s=READY pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0c80023e0 tx=0x7ff0c8005c40 comp rx=0 tx=0).stop 2026-02-13T03:34:21.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.343+0000 7ff0e29f86c0 1 -- 10.20.193.96:0/3046542372 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff0dc122b80 msgr2=0x7ff0dc123020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:21.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.343+0000 7ff0e29f86c0 1 --2- 10.20.193.96:0/3046542372 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff0dc122b80 0x7ff0dc123020 secure :-1 s=READY pgs=240 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0d0006ea0 tx=0x7ff0d000ce50 comp rx=0 tx=0).stop 2026-02-13T03:34:21.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.343+0000 7ff0e29f86c0 1 -- 10.20.193.96:0/3046542372 shutdown_connections 2026-02-13T03:34:21.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.343+0000 7ff0e29f86c0 1 --2- 10.20.193.96:0/3046542372 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff0b00b5600 0x7ff0b00d5ab0 unknown :-1 s=CLOSED pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:21.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.343+0000 7ff0e29f86c0 1 --2- 10.20.193.96:0/3046542372 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff0dc122b80 0x7ff0dc123020 unknown :-1 s=CLOSED pgs=240 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:21.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.343+0000 7ff0e29f86c0 1 --2- 10.20.193.96:0/3046542372 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff0dc115440 0x7ff0dc11d7c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:21.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.343+0000 7ff0e29f86c0 1 --2- 10.20.193.96:0/3046542372 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff0dc10f230 0x7ff0dc11d280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:21.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.343+0000 7ff0e29f86c0 1 -- 10.20.193.96:0/3046542372 >> 10.20.193.96:0/3046542372 conn(0x7ff0dc0ecb30 msgr2=0x7ff0dc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:21.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.343+0000 7ff0e29f86c0 1 -- 10.20.193.96:0/3046542372 shutdown_connections 2026-02-13T03:34:21.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.343+0000 7ff0e29f86c0 1 -- 10.20.193.96:0/3046542372 wait complete. 2026-02-13T03:34:21.386 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2026-02-13T03:34:21.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:21 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2736423227' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-13T03:34:21.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:21 trial132 ceph-mon[26888]: mds.? [v2:10.20.193.133:6838/3735956625,v1:10.20.193.133:6839/3735956625] up:active 2026-02-13T03:34:21.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:21 trial132 ceph-mon[26888]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2026-02-13T03:34:21.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:21 trial132 ceph-mon[26888]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2026-02-13T03:34:21.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:21 trial132 ceph-mon[26888]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:34:21.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:21 trial132 ceph-mon[26888]: pgmap v186: 97 pgs: 97 active+clean; 580 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 5.3 KiB/s wr, 16 op/s 2026-02-13T03:34:21.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:21 trial132 ceph-mon[26888]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:34:21.501 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:21.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:21 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2736423227' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-13T03:34:21.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:21 trial133 ceph-mon[26943]: mds.? [v2:10.20.193.133:6838/3735956625,v1:10.20.193.133:6839/3735956625] up:active 2026-02-13T03:34:21.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:21 trial133 ceph-mon[26943]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2026-02-13T03:34:21.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:21 trial133 ceph-mon[26943]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2026-02-13T03:34:21.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:21 trial133 ceph-mon[26943]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:34:21.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:21 trial133 ceph-mon[26943]: pgmap v186: 97 pgs: 97 active+clean; 580 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 5.3 KiB/s wr, 16 op/s 2026-02-13T03:34:21.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:21 trial133 ceph-mon[26943]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:34:21.623 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.617+0000 7f140aff16c0 1 -- 10.20.193.96:0/4179349343 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1404115410 msgr2=0x7f1404175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:21.623 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.617+0000 7f140aff16c0 1 --2- 10.20.193.96:0/4179349343 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1404115410 0x7f1404175db0 secure :-1 s=READY pgs=241 gs=1 cs=0 l=1 c_cookie=6670837149709420898 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f140000aa70 tx=0x7f140002fde0 comp rx=0 tx=0).stop 2026-02-13T03:34:21.623 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.617+0000 7f140aff16c0 1 -- 10.20.193.96:0/4179349343 shutdown_connections 2026-02-13T03:34:21.623 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.617+0000 7f140aff16c0 1 --2- 10.20.193.96:0/4179349343 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1404115410 0x7f1404175db0 unknown :-1 s=CLOSED pgs=241 gs=1 cs=0 l=1 c_cookie=6670837149709420898 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:21.623 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.617+0000 7f140aff16c0 1 --2- 10.20.193.96:0/4179349343 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f140410fbf0 0x7f1404114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:21.623 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.617+0000 7f140aff16c0 1 --2- 10.20.193.96:0/4179349343 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f140410f200 0x7f140410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:21.623 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.617+0000 7f140aff16c0 1 -- 10.20.193.96:0/4179349343 >> 10.20.193.96:0/4179349343 conn(0x7f14040ecb00 msgr2=0x7f140410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:21.623 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.617+0000 7f140aff16c0 1 -- 10.20.193.96:0/4179349343 shutdown_connections 2026-02-13T03:34:21.623 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.617+0000 7f140aff16c0 1 -- 10.20.193.96:0/4179349343 wait complete. 2026-02-13T03:34:21.624 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f140aff16c0 1 Processor -- start 2026-02-13T03:34:21.624 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f140aff16c0 1 -- start start 2026-02-13T03:34:21.624 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f140aff16c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f140410f200 0x7f140411d120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:21.624 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f140aff16c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1404115410 0x7f140411d660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:21.624 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f140aff16c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1404122a20 0x7f1404122ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:21.624 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f140aff16c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1404123430 con 0x7f1404122a20 2026-02-13T03:34:21.624 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f140aff16c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f14041235a0 con 0x7f1404115410 2026-02-13T03:34:21.624 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f140aff16c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1404123760 con 0x7f140410f200 2026-02-13T03:34:21.624 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f14095636c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1404122a20 0x7f1404122ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:21.624 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f14095636c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1404122a20 0x7f1404122ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49940/0 (socket says 10.20.193.96:49940) 2026-02-13T03:34:21.624 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f14095636c0 1 -- 10.20.193.96:0/1703878567 learned_addr learned my addr 10.20.193.96:0/1703878567 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:21.624 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f1408d626c0 1 --2- 10.20.193.96:0/1703878567 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f140410f200 0x7f140411d120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:21.625 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f14095636c0 1 -- 10.20.193.96:0/1703878567 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f140410f200 msgr2=0x7f140411d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:21.625 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f14095636c0 1 --2- 10.20.193.96:0/1703878567 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f140410f200 0x7f140411d120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:21.625 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f13fbfff6c0 1 --2- 10.20.193.96:0/1703878567 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1404115410 0x7f140411d660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:21.625 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f14095636c0 1 -- 10.20.193.96:0/1703878567 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1404115410 msgr2=0x7f140411d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:21.625 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f14095636c0 1 --2- 10.20.193.96:0/1703878567 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1404115410 0x7f140411d660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:21.625 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f14095636c0 1 -- 10.20.193.96:0/1703878567 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140000a660 con 0x7f1404122a20 2026-02-13T03:34:21.625 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f1408d626c0 1 --2- 10.20.193.96:0/1703878567 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f140410f200 0x7f140411d120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:34:21.625 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f13fbfff6c0 1 --2- 10.20.193.96:0/1703878567 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1404115410 0x7f140411d660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:34:21.625 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f14095636c0 1 --2- 10.20.193.96:0/1703878567 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1404122a20 0x7f1404122ec0 secure :-1 s=READY pgs=242 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f140000ab70 tx=0x7f14000054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:21.625 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f13f9ffb6c0 1 -- 10.20.193.96:0/1703878567 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1400030d10 con 0x7f1404122a20 2026-02-13T03:34:21.625 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f140aff16c0 1 -- 10.20.193.96:0/1703878567 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1404163bb0 con 0x7f1404122a20 2026-02-13T03:34:21.625 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f13f9ffb6c0 1 -- 10.20.193.96:0/1703878567 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f1400030e70 con 0x7f1404122a20 2026-02-13T03:34:21.626 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f13f9ffb6c0 1 -- 10.20.193.96:0/1703878567 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1400032920 con 0x7f1404122a20 2026-02-13T03:34:21.626 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.618+0000 7f140aff16c0 1 -- 10.20.193.96:0/1703878567 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1404163fe0 con 0x7f1404122a20 2026-02-13T03:34:21.626 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.619+0000 7f140aff16c0 1 -- 10.20.193.96:0/1703878567 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14041104d0 con 0x7f1404122a20 2026-02-13T03:34:21.627 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.620+0000 7f13f9ffb6c0 1 -- 10.20.193.96:0/1703878567 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f1400032030 con 0x7f1404122a20 2026-02-13T03:34:21.627 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.621+0000 7f13f9ffb6c0 1 --2- 10.20.193.96:0/1703878567 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f13e00b5600 0x7f13e00d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:21.627 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.621+0000 7f1408d626c0 1 --2- 10.20.193.96:0/1703878567 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f13e00b5600 0x7f13e00d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:21.627 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.621+0000 7f13f9ffb6c0 1 -- 10.20.193.96:0/1703878567 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f1400108d40 con 0x7f1404122a20 2026-02-13T03:34:21.627 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.621+0000 7f13f9ffb6c0 1 -- 10.20.193.96:0/1703878567 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f14000ce890 con 0x7f1404122a20 2026-02-13T03:34:21.627 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.621+0000 7f1408d626c0 1 --2- 10.20.193.96:0/1703878567 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f13e00b5600 0x7f13e00d5ab0 secure :-1 s=READY pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13f4004750 tx=0x7f13f4005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:21.732 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.729+0000 7f140aff16c0 1 -- 10.20.193.96:0/1703878567 --> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f140411e270 con 0x7f13e00b5600 2026-02-13T03:34:21.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.744+0000 7f13f9ffb6c0 1 -- 10.20.193.96:0/1703878567 <== mgr.14116 v2:10.20.193.96:6800/1736050816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f140411e270 con 0x7f13e00b5600 2026-02-13T03:34:21.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.745+0000 7f140aff16c0 1 -- 10.20.193.96:0/1703878567 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f13e00b5600 msgr2=0x7f13e00d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:21.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.745+0000 7f140aff16c0 1 --2- 10.20.193.96:0/1703878567 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f13e00b5600 0x7f13e00d5ab0 secure :-1 s=READY pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13f4004750 tx=0x7f13f4005f10 comp rx=0 tx=0).stop 2026-02-13T03:34:21.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.745+0000 7f140aff16c0 1 -- 10.20.193.96:0/1703878567 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1404122a20 msgr2=0x7f1404122ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:21.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.745+0000 7f140aff16c0 1 --2- 10.20.193.96:0/1703878567 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1404122a20 0x7f1404122ec0 secure :-1 s=READY pgs=242 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f140000ab70 tx=0x7f14000054b0 comp rx=0 tx=0).stop 2026-02-13T03:34:21.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.745+0000 7f140aff16c0 1 -- 10.20.193.96:0/1703878567 shutdown_connections 2026-02-13T03:34:21.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.745+0000 7f140aff16c0 1 --2- 10.20.193.96:0/1703878567 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f13e00b5600 0x7f13e00d5ab0 unknown :-1 s=CLOSED pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:21.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.745+0000 7f140aff16c0 1 --2- 10.20.193.96:0/1703878567 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1404122a20 0x7f1404122ec0 unknown :-1 s=CLOSED pgs=242 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:21.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.745+0000 7f140aff16c0 1 --2- 10.20.193.96:0/1703878567 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1404115410 0x7f140411d660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:21.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.745+0000 7f140aff16c0 1 --2- 10.20.193.96:0/1703878567 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f140410f200 0x7f140411d120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:21.750 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.745+0000 7f140aff16c0 1 -- 10.20.193.96:0/1703878567 >> 10.20.193.96:0/1703878567 conn(0x7f14040ecb00 msgr2=0x7f140410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:21.750 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.745+0000 7f140aff16c0 1 -- 10.20.193.96:0/1703878567 shutdown_connections 2026-02-13T03:34:21.750 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:21.745+0000 7f140aff16c0 1 -- 10.20.193.96:0/1703878567 wait complete. 2026-02-13T03:34:21.787 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2026-02-13T03:34:21.904 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:22.026 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.021+0000 7fd3642e86c0 1 -- 10.20.193.96:0/3581317225 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd35c10f200 msgr2=0x7fd35c10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:22.026 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.021+0000 7fd3642e86c0 1 --2- 10.20.193.96:0/3581317225 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd35c10f200 0x7fd35c10f5d0 secure :-1 s=READY pgs=243 gs=1 cs=0 l=1 c_cookie=4160127262711673394 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd34c0099a0 tx=0x7fd34c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:22.026 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.021+0000 7fd3642e86c0 1 -- 10.20.193.96:0/3581317225 shutdown_connections 2026-02-13T03:34:22.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.021+0000 7fd3642e86c0 1 --2- 10.20.193.96:0/3581317225 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd35c115410 0x7fd35c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.021+0000 7fd3642e86c0 1 --2- 10.20.193.96:0/3581317225 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd35c10fbf0 0x7fd35c114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.021+0000 7fd3642e86c0 1 --2- 10.20.193.96:0/3581317225 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd35c10f200 0x7fd35c10f5d0 unknown :-1 s=CLOSED pgs=243 gs=1 cs=0 l=1 c_cookie=4160127262711673394 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.021+0000 7fd3642e86c0 1 -- 10.20.193.96:0/3581317225 >> 10.20.193.96:0/3581317225 conn(0x7fd35c0ecb00 msgr2=0x7fd35c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:22.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.021+0000 7fd3642e86c0 1 -- 10.20.193.96:0/3581317225 shutdown_connections 2026-02-13T03:34:22.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.021+0000 7fd3642e86c0 1 -- 10.20.193.96:0/3581317225 wait complete. 2026-02-13T03:34:22.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.021+0000 7fd3642e86c0 1 Processor -- start 2026-02-13T03:34:22.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.021+0000 7fd3642e86c0 1 -- start start 2026-02-13T03:34:22.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.021+0000 7fd3642e86c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd35c10f200 0x7fd35c11d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:22.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.021+0000 7fd3642e86c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd35c115410 0x7fd35c11d740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:22.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.021+0000 7fd3642e86c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd35c122b00 0x7fd35c122fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:22.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.021+0000 7fd3642e86c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c1234e0 con 0x7fd35c122b00 2026-02-13T03:34:22.028 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.021+0000 7fd3642e86c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c123650 con 0x7fd35c115410 2026-02-13T03:34:22.028 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.021+0000 7fd3642e86c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c123810 con 0x7fd35c10f200 2026-02-13T03:34:22.028 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.022+0000 7fd36285e6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd35c122b00 0x7fd35c122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:22.028 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.022+0000 7fd36285e6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd35c122b00 0x7fd35c122fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49968/0 (socket says 10.20.193.96:49968) 2026-02-13T03:34:22.028 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.022+0000 7fd36285e6c0 1 -- 10.20.193.96:0/2935800770 learned_addr learned my addr 10.20.193.96:0/2935800770 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:22.028 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.022+0000 7fd36205d6c0 1 --2- 10.20.193.96:0/2935800770 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd35c10f200 0x7fd35c11d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:22.028 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.022+0000 7fd36185c6c0 1 --2- 10.20.193.96:0/2935800770 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd35c115410 0x7fd35c11d740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:22.028 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.022+0000 7fd36285e6c0 1 -- 10.20.193.96:0/2935800770 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd35c10f200 msgr2=0x7fd35c11d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:22.028 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.022+0000 7fd36285e6c0 1 --2- 10.20.193.96:0/2935800770 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd35c10f200 0x7fd35c11d200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.028 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.022+0000 7fd36285e6c0 1 -- 10.20.193.96:0/2935800770 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd35c115410 msgr2=0x7fd35c11d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:22.028 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.022+0000 7fd36285e6c0 1 --2- 10.20.193.96:0/2935800770 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd35c115410 0x7fd35c11d740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.028 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.022+0000 7fd36285e6c0 1 -- 10.20.193.96:0/2935800770 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34c009590 con 0x7fd35c122b00 2026-02-13T03:34:22.029 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.022+0000 7fd36285e6c0 1 --2- 10.20.193.96:0/2935800770 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd35c122b00 0x7fd35c122fa0 secure :-1 s=READY pgs=244 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd358006ea0 tx=0x7fd35800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:22.029 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.022+0000 7fd3437fe6c0 1 -- 10.20.193.96:0/2935800770 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd358003a30 con 0x7fd35c122b00 2026-02-13T03:34:22.029 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.022+0000 7fd3642e86c0 1 -- 10.20.193.96:0/2935800770 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd35c163c90 con 0x7fd35c122b00 2026-02-13T03:34:22.029 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.022+0000 7fd3437fe6c0 1 -- 10.20.193.96:0/2935800770 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fd358005510 con 0x7fd35c122b00 2026-02-13T03:34:22.029 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.022+0000 7fd3437fe6c0 1 -- 10.20.193.96:0/2935800770 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd35800dd70 con 0x7fd35c122b00 2026-02-13T03:34:22.029 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.022+0000 7fd3642e86c0 1 -- 10.20.193.96:0/2935800770 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd35c1641c0 con 0x7fd35c122b00 2026-02-13T03:34:22.029 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.022+0000 7fd3642e86c0 1 -- 10.20.193.96:0/2935800770 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd35c1104d0 con 0x7fd35c122b00 2026-02-13T03:34:22.030 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.024+0000 7fd3437fe6c0 1 -- 10.20.193.96:0/2935800770 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7fd358003b90 con 0x7fd35c122b00 2026-02-13T03:34:22.030 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.024+0000 7fd3437fe6c0 1 --2- 10.20.193.96:0/2935800770 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd3380b5600 0x7fd3380d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:22.030 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.024+0000 7fd3437fe6c0 1 -- 10.20.193.96:0/2935800770 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7fd3580e4830 con 0x7fd35c122b00 2026-02-13T03:34:22.030 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.024+0000 7fd36205d6c0 1 --2- 10.20.193.96:0/2935800770 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd3380b5600 0x7fd3380d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:22.030 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.024+0000 7fd36205d6c0 1 --2- 10.20.193.96:0/2935800770 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd3380b5600 0x7fd3380d5ab0 secure :-1 s=READY pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd34c005b40 tx=0x7fd34c0023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:22.030 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.025+0000 7fd3437fe6c0 1 -- 10.20.193.96:0/2935800770 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd3580a73f0 con 0x7fd35c122b00 2026-02-13T03:34:22.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.132+0000 7fd3642e86c0 1 -- 10.20.193.96:0/2935800770 --> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fd35c11e350 con 0x7fd3380b5600 2026-02-13T03:34:22.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.136+0000 7fd3437fe6c0 1 -- 10.20.193.96:0/2935800770 <== mgr.14116 v2:10.20.193.96:6800/1736050816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fd35c11e350 con 0x7fd3380b5600 2026-02-13T03:34:22.139 INFO:teuthology.orchestra.run.trial096.stdout:/volumes/qa/sv_1/6373d4e5-12a6-4b50-a711-e8ae779478f7 2026-02-13T03:34:22.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.137+0000 7fd3642e86c0 1 -- 10.20.193.96:0/2935800770 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd3380b5600 msgr2=0x7fd3380d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:22.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.137+0000 7fd3642e86c0 1 --2- 10.20.193.96:0/2935800770 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd3380b5600 0x7fd3380d5ab0 secure :-1 s=READY pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd34c005b40 tx=0x7fd34c0023a0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.137+0000 7fd3642e86c0 1 -- 10.20.193.96:0/2935800770 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd35c122b00 msgr2=0x7fd35c122fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:22.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.137+0000 7fd3642e86c0 1 --2- 10.20.193.96:0/2935800770 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd35c122b00 0x7fd35c122fa0 secure :-1 s=READY pgs=244 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd358006ea0 tx=0x7fd35800cca0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.137+0000 7fd3642e86c0 1 -- 10.20.193.96:0/2935800770 shutdown_connections 2026-02-13T03:34:22.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.137+0000 7fd3642e86c0 1 --2- 10.20.193.96:0/2935800770 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd3380b5600 0x7fd3380d5ab0 unknown :-1 s=CLOSED pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.137+0000 7fd3642e86c0 1 --2- 10.20.193.96:0/2935800770 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd35c122b00 0x7fd35c122fa0 unknown :-1 s=CLOSED pgs=244 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.137+0000 7fd3642e86c0 1 --2- 10.20.193.96:0/2935800770 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd35c115410 0x7fd35c11d740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.137+0000 7fd3642e86c0 1 --2- 10.20.193.96:0/2935800770 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd35c10f200 0x7fd35c11d200 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.137+0000 7fd3642e86c0 1 -- 10.20.193.96:0/2935800770 >> 10.20.193.96:0/2935800770 conn(0x7fd35c0ecb00 msgr2=0x7fd35c10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:22.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.137+0000 7fd3642e86c0 1 -- 10.20.193.96:0/2935800770 shutdown_connections 2026-02-13T03:34:22.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.137+0000 7fd3642e86c0 1 -- 10.20.193.96:0/2935800770 wait complete. 2026-02-13T03:34:22.181 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T03:34:22.297 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:22.413 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:22 trial096 ceph-mon[24671]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:34:22.413 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:22 trial096 ceph-mon[24671]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:34:22.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.411+0000 7f4496e946c0 1 -- 10.20.193.96:0/2093852996 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f449010fc20 msgr2=0x7f4490114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:22.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.411+0000 7f4496e946c0 1 --2- 10.20.193.96:0/2093852996 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f449010fc20 0x7f4490114c60 secure :-1 s=READY pgs=245 gs=1 cs=0 l=1 c_cookie=8475253282638731446 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44780099a0 tx=0x7f447802ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:22.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.411+0000 7f4496e946c0 1 -- 10.20.193.96:0/2093852996 shutdown_connections 2026-02-13T03:34:22.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.411+0000 7f4496e946c0 1 --2- 10.20.193.96:0/2093852996 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4490115440 0x7f4490175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.417 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.411+0000 7f4496e946c0 1 --2- 10.20.193.96:0/2093852996 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f449010fc20 0x7f4490114c60 unknown :-1 s=CLOSED pgs=245 gs=1 cs=0 l=1 c_cookie=8475253282638731446 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.417 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.411+0000 7f4496e946c0 1 --2- 10.20.193.96:0/2093852996 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f449010f230 0x7f449010f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.417 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.411+0000 7f4496e946c0 1 -- 10.20.193.96:0/2093852996 >> 10.20.193.96:0/2093852996 conn(0x7f44900ecb30 msgr2=0x7f449010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:22.417 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.411+0000 7f4496e946c0 1 -- 10.20.193.96:0/2093852996 shutdown_connections 2026-02-13T03:34:22.417 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.411+0000 7f4496e946c0 1 -- 10.20.193.96:0/2093852996 wait complete. 2026-02-13T03:34:22.417 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.411+0000 7f4496e946c0 1 Processor -- start 2026-02-13T03:34:22.417 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.411+0000 7f4496e946c0 1 -- start start 2026-02-13T03:34:22.417 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.411+0000 7f4496e946c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f449010f230 0x7f449011d350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:22.417 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.411+0000 7f4496e946c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4490115440 0x7f449011d890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:22.417 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.411+0000 7f4496e946c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4490122c50 0x7f44901230f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:22.417 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.411+0000 7f4496e946c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4490123660 con 0x7f4490122c50 2026-02-13T03:34:22.418 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.411+0000 7f4496e946c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f44901237d0 con 0x7f4490115440 2026-02-13T03:34:22.418 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.411+0000 7f4496e946c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4490123990 con 0x7f449010f230 2026-02-13T03:34:22.418 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.412+0000 7f449540a6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4490122c50 0x7f44901230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:22.418 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.412+0000 7f449540a6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4490122c50 0x7f44901230f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49984/0 (socket says 10.20.193.96:49984) 2026-02-13T03:34:22.418 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.412+0000 7f449540a6c0 1 -- 10.20.193.96:0/869300649 learned_addr learned my addr 10.20.193.96:0/869300649 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:22.418 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.412+0000 7f4487fff6c0 1 --2- 10.20.193.96:0/869300649 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4490115440 0x7f449011d890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:22.418 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.412+0000 7f4494c096c0 1 --2- 10.20.193.96:0/869300649 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f449010f230 0x7f449011d350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:22.418 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.412+0000 7f449540a6c0 1 -- 10.20.193.96:0/869300649 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f449010f230 msgr2=0x7f449011d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:22.418 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.412+0000 7f449540a6c0 1 --2- 10.20.193.96:0/869300649 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f449010f230 0x7f449011d350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.418 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.412+0000 7f449540a6c0 1 -- 10.20.193.96:0/869300649 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4490115440 msgr2=0x7f449011d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:22.418 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.412+0000 7f449540a6c0 1 --2- 10.20.193.96:0/869300649 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4490115440 0x7f449011d890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.418 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.412+0000 7f449540a6c0 1 -- 10.20.193.96:0/869300649 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4478009590 con 0x7f4490122c50 2026-02-13T03:34:22.419 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.412+0000 7f449540a6c0 1 --2- 10.20.193.96:0/869300649 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4490122c50 0x7f44901230f0 secure :-1 s=READY pgs=246 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f448c006ea0 tx=0x7f448c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:22.419 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.412+0000 7f4485ffb6c0 1 -- 10.20.193.96:0/869300649 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f448c003a30 con 0x7f4490122c50 2026-02-13T03:34:22.419 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.412+0000 7f4485ffb6c0 1 -- 10.20.193.96:0/869300649 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f448c005510 con 0x7f4490122c50 2026-02-13T03:34:22.419 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.412+0000 7f4496e946c0 1 -- 10.20.193.96:0/869300649 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4490163e40 con 0x7f4490122c50 2026-02-13T03:34:22.419 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.412+0000 7f4485ffb6c0 1 -- 10.20.193.96:0/869300649 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f448c00dd70 con 0x7f4490122c50 2026-02-13T03:34:22.419 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.412+0000 7f4496e946c0 1 -- 10.20.193.96:0/869300649 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4490164320 con 0x7f4490122c50 2026-02-13T03:34:22.419 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.412+0000 7f4496e946c0 1 -- 10.20.193.96:0/869300649 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4490110500 con 0x7f4490122c50 2026-02-13T03:34:22.420 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.414+0000 7f4485ffb6c0 1 -- 10.20.193.96:0/869300649 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f448c003b90 con 0x7f4490122c50 2026-02-13T03:34:22.420 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.414+0000 7f4485ffb6c0 1 --2- 10.20.193.96:0/869300649 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f446c0b5710 0x7f446c0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:22.420 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.414+0000 7f4494c096c0 1 --2- 10.20.193.96:0/869300649 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f446c0b5710 0x7f446c0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:22.420 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.414+0000 7f4485ffb6c0 1 -- 10.20.193.96:0/869300649 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f448c0e4b00 con 0x7f4490122c50 2026-02-13T03:34:22.421 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.414+0000 7f4494c096c0 1 --2- 10.20.193.96:0/869300649 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f446c0b5710 0x7f446c0d5bc0 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4480005980 tx=0x7f4480005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:22.421 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.415+0000 7f4485ffb6c0 1 -- 10.20.193.96:0/869300649 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f448c0a7520 con 0x7f4490122c50 2026-02-13T03:34:22.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:22 trial132 ceph-mon[26888]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:34:22.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:22 trial132 ceph-mon[26888]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:34:22.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:22 trial133 ceph-mon[26943]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:34:22.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:22 trial133 ceph-mon[26943]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:34:22.531 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.528+0000 7f4496e946c0 1 -- 10.20.193.96:0/869300649 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f449011e4a0 con 0x7f4490122c50 2026-02-13T03:34:22.531 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.528+0000 7f4485ffb6c0 1 -- 10.20.193.96:0/869300649 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11950 (secure 0 0 0) 0x7f448c0aa6d0 con 0x7f4490122c50 2026-02-13T03:34:22.532 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:22.532 INFO:teuthology.orchestra.run.trial096.stdout:{"epoch":22,"btime":"2026-02-13T03:34:20:135481+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.96:6835/392543675","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6834","nonce":392543675},{"type":"v1","addr":"10.20.193.96:6835","nonce":392543675}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.96:6837/1965017277","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6836","nonce":1965017277},{"type":"v1","addr":"10.20.193.96:6837","nonce":1965017277}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14763,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.96:6839/3941321429","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6838","nonce":3941321429},{"type":"v1","addr":"10.20.193.96:6839","nonce":3941321429}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.96:6841/2510084239","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6840","nonce":2510084239},{"type":"v1","addr":"10.20.193.96:6841","nonce":2510084239}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.133:6833/1760340814","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6832","nonce":1760340814},{"type":"v1","addr":"10.20.193.133:6833","nonce":1760340814}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.132:6833/4227189143","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6832","nonce":4227189143},{"type":"v1","addr":"10.20.193.132:6833","nonce":4227189143}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-13T03:34:14.497083+0000","modified":"2026-02-13T03:34:20.135477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24473,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24445":{"gid":24445,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.133:6835/2552443453","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6834","nonce":2552443453},{"type":"v1","addr":"10.20.193.133:6835","nonce":2552443453}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.133:6837/1508462977","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6836","nonce":1508462977},{"type":"v1","addr":"10.20.193.133:6837","nonce":1508462977}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.132:6835/4071682208","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6834","nonce":4071682208},{"type":"v1","addr":"10.20.193.132:6835","nonce":4071682208}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":5,"addr":"10.20.193.133:6839/3735956625","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6838","nonce":3735956625},{"type":"v1","addr":"10.20.193.133:6839","nonce":3735956625}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"10.20.193.132:6837/768182548","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6836","nonce":768182548},{"type":"v1","addr":"10.20.193.132:6837","nonce":768182548}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"10.20.193.132:6839/1168876815","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6838","nonce":1168876815},{"type":"v1","addr":"10.20.193.132:6839","nonce":1168876815}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24473,24466]},"id":1}]} 2026-02-13T03:34:22.533 INFO:teuthology.orchestra.run.trial096.stderr:dumped fsmap epoch 22 2026-02-13T03:34:22.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.529+0000 7f4496e946c0 1 -- 10.20.193.96:0/869300649 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f446c0b5710 msgr2=0x7f446c0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:22.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.529+0000 7f4496e946c0 1 --2- 10.20.193.96:0/869300649 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f446c0b5710 0x7f446c0d5bc0 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4480005980 tx=0x7f4480005910 comp rx=0 tx=0).stop 2026-02-13T03:34:22.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.529+0000 7f4496e946c0 1 -- 10.20.193.96:0/869300649 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4490122c50 msgr2=0x7f44901230f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:22.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.529+0000 7f4496e946c0 1 --2- 10.20.193.96:0/869300649 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4490122c50 0x7f44901230f0 secure :-1 s=READY pgs=246 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f448c006ea0 tx=0x7f448c00cca0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.529+0000 7f4496e946c0 1 -- 10.20.193.96:0/869300649 shutdown_connections 2026-02-13T03:34:22.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.529+0000 7f4496e946c0 1 --2- 10.20.193.96:0/869300649 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f446c0b5710 0x7f446c0d5bc0 unknown :-1 s=CLOSED pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.529+0000 7f4496e946c0 1 --2- 10.20.193.96:0/869300649 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4490122c50 0x7f44901230f0 unknown :-1 s=CLOSED pgs=246 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.534 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.529+0000 7f4496e946c0 1 --2- 10.20.193.96:0/869300649 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4490115440 0x7f449011d890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.534 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.529+0000 7f4496e946c0 1 --2- 10.20.193.96:0/869300649 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f449010f230 0x7f449011d350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.534 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.529+0000 7f4496e946c0 1 -- 10.20.193.96:0/869300649 >> 10.20.193.96:0/869300649 conn(0x7f44900ecb30 msgr2=0x7f449010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:22.534 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.529+0000 7f4496e946c0 1 -- 10.20.193.96:0/869300649 shutdown_connections 2026-02-13T03:34:22.534 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.529+0000 7f4496e946c0 1 -- 10.20.193.96:0/869300649 wait complete. 2026-02-13T03:34:22.573 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T03:34:22.689 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:22.808 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.802+0000 7fbaba1c06c0 1 -- 10.20.193.96:0/1403585809 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbab4115440 msgr2=0x7fbab4175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:22.808 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.802+0000 7fbaba1c06c0 1 --2- 10.20.193.96:0/1403585809 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbab4115440 0x7fbab4175de0 secure :-1 s=READY pgs=247 gs=1 cs=0 l=1 c_cookie=13087778917908348214 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbaa800aa70 tx=0x7fbaa802fde0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.808 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.802+0000 7fbaba1c06c0 1 -- 10.20.193.96:0/1403585809 shutdown_connections 2026-02-13T03:34:22.808 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.802+0000 7fbaba1c06c0 1 --2- 10.20.193.96:0/1403585809 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbab4115440 0x7fbab4175de0 unknown :-1 s=CLOSED pgs=247 gs=1 cs=0 l=1 c_cookie=13087778917908348214 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.808 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.802+0000 7fbaba1c06c0 1 --2- 10.20.193.96:0/1403585809 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fbab410fc20 0x7fbab4114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.808 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.802+0000 7fbaba1c06c0 1 --2- 10.20.193.96:0/1403585809 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fbab410f230 0x7fbab410f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.809 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.802+0000 7fbaba1c06c0 1 -- 10.20.193.96:0/1403585809 >> 10.20.193.96:0/1403585809 conn(0x7fbab40ecb30 msgr2=0x7fbab410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:22.809 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.802+0000 7fbaba1c06c0 1 -- 10.20.193.96:0/1403585809 shutdown_connections 2026-02-13T03:34:22.809 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.802+0000 7fbaba1c06c0 1 -- 10.20.193.96:0/1403585809 wait complete. 2026-02-13T03:34:22.809 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.803+0000 7fbaba1c06c0 1 Processor -- start 2026-02-13T03:34:22.809 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.803+0000 7fbaba1c06c0 1 -- start start 2026-02-13T03:34:22.809 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.803+0000 7fbaba1c06c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbab410f230 0x7fbab411d190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:22.809 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.803+0000 7fbaba1c06c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fbab4115440 0x7fbab411d6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:22.809 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.803+0000 7fbaba1c06c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fbab4122a90 0x7fbab4122f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:22.809 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.803+0000 7fbaba1c06c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fbab41234a0 con 0x7fbab410f230 2026-02-13T03:34:22.809 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.803+0000 7fbaba1c06c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbab4123610 con 0x7fbab4115440 2026-02-13T03:34:22.809 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.803+0000 7fbaba1c06c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbab41237d0 con 0x7fbab4122a90 2026-02-13T03:34:22.809 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.803+0000 7fbab37fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbab410f230 0x7fbab411d190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:22.810 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.803+0000 7fbab37fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbab410f230 0x7fbab411d190 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:50002/0 (socket says 10.20.193.96:50002) 2026-02-13T03:34:22.810 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.803+0000 7fbab37fe6c0 1 -- 10.20.193.96:0/4166861408 learned_addr learned my addr 10.20.193.96:0/4166861408 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:22.810 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.803+0000 7fbab2ffd6c0 1 --2- 10.20.193.96:0/4166861408 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fbab4115440 0x7fbab411d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:22.810 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.803+0000 7fbab3fff6c0 1 --2- 10.20.193.96:0/4166861408 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fbab4122a90 0x7fbab4122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:22.810 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.803+0000 7fbab37fe6c0 1 -- 10.20.193.96:0/4166861408 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fbab4122a90 msgr2=0x7fbab4122f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:22.810 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.803+0000 7fbab37fe6c0 1 --2- 10.20.193.96:0/4166861408 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fbab4122a90 0x7fbab4122f30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.810 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.803+0000 7fbab37fe6c0 1 -- 10.20.193.96:0/4166861408 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fbab4115440 msgr2=0x7fbab411d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:22.810 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.803+0000 7fbab37fe6c0 1 --2- 10.20.193.96:0/4166861408 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fbab4115440 0x7fbab411d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.810 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.803+0000 7fbab37fe6c0 1 -- 10.20.193.96:0/4166861408 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa800a660 con 0x7fbab410f230 2026-02-13T03:34:22.810 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.803+0000 7fbab37fe6c0 1 --2- 10.20.193.96:0/4166861408 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbab410f230 0x7fbab411d190 secure :-1 s=READY pgs=248 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbaa000b710 tx=0x7fbaa000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:22.810 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.803+0000 7fbab0ff96c0 1 -- 10.20.193.96:0/4166861408 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbaa0004250 con 0x7fbab410f230 2026-02-13T03:34:22.810 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.803+0000 7fbaba1c06c0 1 -- 10.20.193.96:0/4166861408 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbab4163c80 con 0x7fbab410f230 2026-02-13T03:34:22.811 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.803+0000 7fbab0ff96c0 1 -- 10.20.193.96:0/4166861408 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fbaa0002da0 con 0x7fbab410f230 2026-02-13T03:34:22.811 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.803+0000 7fbab0ff96c0 1 -- 10.20.193.96:0/4166861408 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbaa000ce30 con 0x7fbab410f230 2026-02-13T03:34:22.811 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.803+0000 7fbaba1c06c0 1 -- 10.20.193.96:0/4166861408 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbab4164110 con 0x7fbab410f230 2026-02-13T03:34:22.811 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.804+0000 7fbaba1c06c0 1 -- 10.20.193.96:0/4166861408 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbab4110500 con 0x7fbab410f230 2026-02-13T03:34:22.811 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.805+0000 7fbab0ff96c0 1 -- 10.20.193.96:0/4166861408 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fbaa00028c0 con 0x7fbab410f230 2026-02-13T03:34:22.812 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.805+0000 7fbab0ff96c0 1 --2- 10.20.193.96:0/4166861408 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fba880b5690 0x7fba880d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:22.812 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.805+0000 7fbab0ff96c0 1 -- 10.20.193.96:0/4166861408 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7fbaa00e3d00 con 0x7fbab410f230 2026-02-13T03:34:22.812 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.805+0000 7fbab2ffd6c0 1 --2- 10.20.193.96:0/4166861408 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fba880b5690 0x7fba880d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:22.812 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.806+0000 7fbab0ff96c0 1 -- 10.20.193.96:0/4166861408 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbaa00a6760 con 0x7fbab410f230 2026-02-13T03:34:22.812 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.806+0000 7fbab2ffd6c0 1 --2- 10.20.193.96:0/4166861408 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fba880b5690 0x7fba880d5b40 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbab4123b20 tx=0x7fbaa4005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:22.899 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.896+0000 7fbaba1c06c0 1 -- 10.20.193.96:0/4166861408 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbab410fc20 con 0x7fbab410f230 2026-02-13T03:34:22.900 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.897+0000 7fbab0ff96c0 1 -- 10.20.193.96:0/4166861408 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+22059 (secure 0 0 0) 0x7fbaa00a9910 con 0x7fbab410f230 2026-02-13T03:34:22.901 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:22.901 INFO:teuthology.orchestra.run.trial096.stdout:{"epoch":68,"fsid":"7c123de8-088c-11f1-84f7-d404e6e7d460","created":"2026-02-13T03:31:45.642136+0000","modified":"2026-02-13T03:34:16.108938+0000","last_up_change":"2026-02-13T03:33:56.962006+0000","last_in_change":"2026-02-13T03:33:48.669890+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T03:32:50.622231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T03:34:12.297405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T03:34:13.482715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b4f15df-2bc8-4596-a5de-6b2c54cdf01c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6802","nonce":1861813169},{"type":"v1","addr":"10.20.193.96:6803","nonce":1861813169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6804","nonce":1861813169},{"type":"v1","addr":"10.20.193.96:6805","nonce":1861813169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6808","nonce":1861813169},{"type":"v1","addr":"10.20.193.96:6809","nonce":1861813169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6806","nonce":1861813169},{"type":"v1","addr":"10.20.193.96:6807","nonce":1861813169}]},"public_addr":"10.20.193.96:6803/1861813169","cluster_addr":"10.20.193.96:6805/1861813169","heartbeat_back_addr":"10.20.193.96:6809/1861813169","heartbeat_front_addr":"10.20.193.96:6807/1861813169","state":["exists","up"]},{"osd":1,"uuid":"4238865b-e38e-494d-b2cd-4ee08715f004","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6800","nonce":3550689941},{"type":"v1","addr":"10.20.193.132:6801","nonce":3550689941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6802","nonce":3550689941},{"type":"v1","addr":"10.20.193.132:6803","nonce":3550689941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6806","nonce":3550689941},{"type":"v1","addr":"10.20.193.132:6807","nonce":3550689941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6804","nonce":3550689941},{"type":"v1","addr":"10.20.193.132:6805","nonce":3550689941}]},"public_addr":"10.20.193.132:6801/3550689941","cluster_addr":"10.20.193.132:6803/3550689941","heartbeat_back_addr":"10.20.193.132:6807/3550689941","heartbeat_front_addr":"10.20.193.132:6805/3550689941","state":["exists","up"]},{"osd":2,"uuid":"85769516-916b-43ce-aec8-36a3011ae085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6800","nonce":4145071410},{"type":"v1","addr":"10.20.193.133:6801","nonce":4145071410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6802","nonce":4145071410},{"type":"v1","addr":"10.20.193.133:6803","nonce":4145071410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6806","nonce":4145071410},{"type":"v1","addr":"10.20.193.133:6807","nonce":4145071410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6804","nonce":4145071410},{"type":"v1","addr":"10.20.193.133:6805","nonce":4145071410}]},"public_addr":"10.20.193.133:6801/4145071410","cluster_addr":"10.20.193.133:6803/4145071410","heartbeat_back_addr":"10.20.193.133:6807/4145071410","heartbeat_front_addr":"10.20.193.133:6805/4145071410","state":["exists","up"]},{"osd":3,"uuid":"2fb1e80f-f91e-4f43-a277-ae0f650cbbf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6810","nonce":2289717362},{"type":"v1","addr":"10.20.193.96:6811","nonce":2289717362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6812","nonce":2289717362},{"type":"v1","addr":"10.20.193.96:6813","nonce":2289717362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6816","nonce":2289717362},{"type":"v1","addr":"10.20.193.96:6817","nonce":2289717362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6814","nonce":2289717362},{"type":"v1","addr":"10.20.193.96:6815","nonce":2289717362}]},"public_addr":"10.20.193.96:6811/2289717362","cluster_addr":"10.20.193.96:6813/2289717362","heartbeat_back_addr":"10.20.193.96:6817/2289717362","heartbeat_front_addr":"10.20.193.96:6815/2289717362","state":["exists","up"]},{"osd":4,"uuid":"fc59010d-7a40-47e0-8111-85c564c60c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6808","nonce":421645986},{"type":"v1","addr":"10.20.193.132:6809","nonce":421645986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6810","nonce":421645986},{"type":"v1","addr":"10.20.193.132:6811","nonce":421645986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6814","nonce":421645986},{"type":"v1","addr":"10.20.193.132:6815","nonce":421645986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6812","nonce":421645986},{"type":"v1","addr":"10.20.193.132:6813","nonce":421645986}]},"public_addr":"10.20.193.132:6809/421645986","cluster_addr":"10.20.193.132:6811/421645986","heartbeat_back_addr":"10.20.193.132:6815/421645986","heartbeat_front_addr":"10.20.193.132:6813/421645986","state":["exists","up"]},{"osd":5,"uuid":"301e3dbb-5341-4fda-9c71-7f2fa3f983b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6808","nonce":3625077127},{"type":"v1","addr":"10.20.193.133:6809","nonce":3625077127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6810","nonce":3625077127},{"type":"v1","addr":"10.20.193.133:6811","nonce":3625077127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6814","nonce":3625077127},{"type":"v1","addr":"10.20.193.133:6815","nonce":3625077127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6812","nonce":3625077127},{"type":"v1","addr":"10.20.193.133:6813","nonce":3625077127}]},"public_addr":"10.20.193.133:6809/3625077127","cluster_addr":"10.20.193.133:6811/3625077127","heartbeat_back_addr":"10.20.193.133:6815/3625077127","heartbeat_front_addr":"10.20.193.133:6813/3625077127","state":["exists","up"]},{"osd":6,"uuid":"5d25b12d-8499-4f12-91ca-ce4953256678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6818","nonce":4035362295},{"type":"v1","addr":"10.20.193.96:6819","nonce":4035362295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6820","nonce":4035362295},{"type":"v1","addr":"10.20.193.96:6821","nonce":4035362295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6824","nonce":4035362295},{"type":"v1","addr":"10.20.193.96:6825","nonce":4035362295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6822","nonce":4035362295},{"type":"v1","addr":"10.20.193.96:6823","nonce":4035362295}]},"public_addr":"10.20.193.96:6819/4035362295","cluster_addr":"10.20.193.96:6821/4035362295","heartbeat_back_addr":"10.20.193.96:6825/4035362295","heartbeat_front_addr":"10.20.193.96:6823/4035362295","state":["exists","up"]},{"osd":7,"uuid":"c7d1b3d6-d6c9-4ee2-a767-45dc6a68e941","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6816","nonce":2832704836},{"type":"v1","addr":"10.20.193.132:6817","nonce":2832704836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6818","nonce":2832704836},{"type":"v1","addr":"10.20.193.132:6819","nonce":2832704836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6822","nonce":2832704836},{"type":"v1","addr":"10.20.193.132:6823","nonce":2832704836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6820","nonce":2832704836},{"type":"v1","addr":"10.20.193.132:6821","nonce":2832704836}]},"public_addr":"10.20.193.132:6817/2832704836","cluster_addr":"10.20.193.132:6819/2832704836","heartbeat_back_addr":"10.20.193.132:6823/2832704836","heartbeat_front_addr":"10.20.193.132:6821/2832704836","state":["exists","up"]},{"osd":8,"uuid":"27d57241-5de9-4678-a519-7d218f165183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6816","nonce":3678366387},{"type":"v1","addr":"10.20.193.133:6817","nonce":3678366387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6818","nonce":3678366387},{"type":"v1","addr":"10.20.193.133:6819","nonce":3678366387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6822","nonce":3678366387},{"type":"v1","addr":"10.20.193.133:6823","nonce":3678366387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6820","nonce":3678366387},{"type":"v1","addr":"10.20.193.133:6821","nonce":3678366387}]},"public_addr":"10.20.193.133:6817/3678366387","cluster_addr":"10.20.193.133:6819/3678366387","heartbeat_back_addr":"10.20.193.133:6823/3678366387","heartbeat_front_addr":"10.20.193.133:6821/3678366387","state":["exists","up"]},{"osd":9,"uuid":"93c1ae3e-3b87-4e71-b876-dcd60bbefd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6826","nonce":1024808447},{"type":"v1","addr":"10.20.193.96:6827","nonce":1024808447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6828","nonce":1024808447},{"type":"v1","addr":"10.20.193.96:6829","nonce":1024808447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6832","nonce":1024808447},{"type":"v1","addr":"10.20.193.96:6833","nonce":1024808447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6830","nonce":1024808447},{"type":"v1","addr":"10.20.193.96:6831","nonce":1024808447}]},"public_addr":"10.20.193.96:6827/1024808447","cluster_addr":"10.20.193.96:6829/1024808447","heartbeat_back_addr":"10.20.193.96:6833/1024808447","heartbeat_front_addr":"10.20.193.96:6831/1024808447","state":["exists","up"]},{"osd":10,"uuid":"0e027d3a-fcab-46b0-8719-d335e01449da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6824","nonce":921326908},{"type":"v1","addr":"10.20.193.132:6825","nonce":921326908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6826","nonce":921326908},{"type":"v1","addr":"10.20.193.132:6827","nonce":921326908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6830","nonce":921326908},{"type":"v1","addr":"10.20.193.132:6831","nonce":921326908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6828","nonce":921326908},{"type":"v1","addr":"10.20.193.132:6829","nonce":921326908}]},"public_addr":"10.20.193.132:6825/921326908","cluster_addr":"10.20.193.132:6827/921326908","heartbeat_back_addr":"10.20.193.132:6831/921326908","heartbeat_front_addr":"10.20.193.132:6829/921326908","state":["exists","up"]},{"osd":11,"uuid":"28fa6f6e-6515-49ae-930f-22e18eecefde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6824","nonce":4255173938},{"type":"v1","addr":"10.20.193.133:6825","nonce":4255173938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6826","nonce":4255173938},{"type":"v1","addr":"10.20.193.133:6827","nonce":4255173938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6830","nonce":4255173938},{"type":"v1","addr":"10.20.193.133:6831","nonce":4255173938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6828","nonce":4255173938},{"type":"v1","addr":"10.20.193.133:6829","nonce":4255173938}]},"public_addr":"10.20.193.133:6825/4255173938","cluster_addr":"10.20.193.133:6827/4255173938","heartbeat_back_addr":"10.20.193.133:6831/4255173938","heartbeat_front_addr":"10.20.193.133:6829/4255173938","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:32:33.954605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:32:41.279739+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:32:48.625772+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:32:56.120770+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:03.397402+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:10.481915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:18.008023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:25.421134+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:32.867800+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:40.330823+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:47.773798+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:55.228505+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.96:0/2938583287":"2026-02-14T03:31:51.784882+0000","10.20.193.96:0/3118819056":"2026-02-14T03:31:51.784882+0000","10.20.193.96:6801/955566313":"2026-02-14T03:31:51.784882+0000","10.20.193.96:6800/955566313":"2026-02-14T03:31:51.784882+0000","10.20.193.96:0/135845931":"2026-02-14T03:31:51.784882+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T03:34:22.902 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.898+0000 7fbaba1c06c0 1 -- 10.20.193.96:0/4166861408 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fba880b5690 msgr2=0x7fba880d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:22.902 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.898+0000 7fbaba1c06c0 1 --2- 10.20.193.96:0/4166861408 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fba880b5690 0x7fba880d5b40 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbab4123b20 tx=0x7fbaa4005f10 comp rx=0 tx=0).stop 2026-02-13T03:34:22.902 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.898+0000 7fbaba1c06c0 1 -- 10.20.193.96:0/4166861408 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbab410f230 msgr2=0x7fbab411d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:22.902 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.898+0000 7fbaba1c06c0 1 --2- 10.20.193.96:0/4166861408 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbab410f230 0x7fbab411d190 secure :-1 s=READY pgs=248 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbaa000b710 tx=0x7fbaa000bbe0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.902 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.898+0000 7fbaba1c06c0 1 -- 10.20.193.96:0/4166861408 shutdown_connections 2026-02-13T03:34:22.902 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.898+0000 7fbaba1c06c0 1 --2- 10.20.193.96:0/4166861408 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fba880b5690 0x7fba880d5b40 unknown :-1 s=CLOSED pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.902 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.898+0000 7fbaba1c06c0 1 --2- 10.20.193.96:0/4166861408 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fbab4122a90 0x7fbab4122f30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.903 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.898+0000 7fbaba1c06c0 1 --2- 10.20.193.96:0/4166861408 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fbab4115440 0x7fbab411d6d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.903 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.898+0000 7fbaba1c06c0 1 --2- 10.20.193.96:0/4166861408 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbab410f230 0x7fbab411d190 unknown :-1 s=CLOSED pgs=248 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:22.903 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.898+0000 7fbaba1c06c0 1 -- 10.20.193.96:0/4166861408 >> 10.20.193.96:0/4166861408 conn(0x7fbab40ecb30 msgr2=0x7fbab410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:22.903 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.898+0000 7fbaba1c06c0 1 -- 10.20.193.96:0/4166861408 shutdown_connections 2026-02-13T03:34:22.903 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:22.898+0000 7fbaba1c06c0 1 -- 10.20.193.96:0/4166861408 wait complete. 2026-02-13T03:34:22.941 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-13T03:34:22.942 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T03:34:23.059 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:23.176 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.173+0000 7fad4109b6c0 1 -- 10.20.193.96:0/2411439167 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fad3c115410 msgr2=0x7fad3c175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:23.176 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.173+0000 7fad4109b6c0 1 --2- 10.20.193.96:0/2411439167 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fad3c115410 0x7fad3c175db0 secure :-1 s=READY pgs=249 gs=1 cs=0 l=1 c_cookie=7625532940474199548 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad2c00aa70 tx=0x7fad2c02fde0 comp rx=0 tx=0).stop 2026-02-13T03:34:23.177 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.173+0000 7fad4109b6c0 1 -- 10.20.193.96:0/2411439167 shutdown_connections 2026-02-13T03:34:23.177 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.173+0000 7fad4109b6c0 1 --2- 10.20.193.96:0/2411439167 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fad3c115410 0x7fad3c175db0 unknown :-1 s=CLOSED pgs=249 gs=1 cs=0 l=1 c_cookie=7625532940474199548 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:23.177 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.173+0000 7fad4109b6c0 1 --2- 10.20.193.96:0/2411439167 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fad3c10fbf0 0x7fad3c114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:23.177 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.173+0000 7fad4109b6c0 1 --2- 10.20.193.96:0/2411439167 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fad3c10f200 0x7fad3c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:23.177 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.173+0000 7fad4109b6c0 1 -- 10.20.193.96:0/2411439167 >> 10.20.193.96:0/2411439167 conn(0x7fad3c0ecb00 msgr2=0x7fad3c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:23.177 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.173+0000 7fad4109b6c0 1 -- 10.20.193.96:0/2411439167 shutdown_connections 2026-02-13T03:34:23.177 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.173+0000 7fad4109b6c0 1 -- 10.20.193.96:0/2411439167 wait complete. 2026-02-13T03:34:23.177 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.173+0000 7fad4109b6c0 1 Processor -- start 2026-02-13T03:34:23.177 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.173+0000 7fad4109b6c0 1 -- start start 2026-02-13T03:34:23.178 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:23 trial096 ceph-mon[24671]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:34:23.178 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:23 trial096 ceph-mon[24671]: mgrmap e12: x(active, since 2m), standbys: z, y 2026-02-13T03:34:23.178 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:23 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/869300649' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:34:23.178 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:23 trial096 ceph-mon[24671]: pgmap v187: 97 pgs: 97 active+clean; 582 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s rd, 5.0 KiB/s wr, 17 op/s 2026-02-13T03:34:23.178 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:23 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/4166861408' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:34:23.180 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.174+0000 7fad4109b6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fad3c10f200 0x7fad3c11d110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:23.181 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.174+0000 7fad4109b6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fad3c115410 0x7fad3c11d650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:23.181 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.174+0000 7fad4109b6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fad3c122a10 0x7fad3c122eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:23.181 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.174+0000 7fad4109b6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fad3c123420 con 0x7fad3c115410 2026-02-13T03:34:23.181 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.174+0000 7fad4109b6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fad3c123590 con 0x7fad3c122a10 2026-02-13T03:34:23.181 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.174+0000 7fad4109b6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fad3c123750 con 0x7fad3c10f200 2026-02-13T03:34:23.181 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.174+0000 7fad3a5756c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fad3c115410 0x7fad3c11d650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:23.181 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.174+0000 7fad3a5756c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fad3c115410 0x7fad3c11d650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:48794/0 (socket says 10.20.193.96:48794) 2026-02-13T03:34:23.181 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.174+0000 7fad3a5756c0 1 -- 10.20.193.96:0/860448826 learned_addr learned my addr 10.20.193.96:0/860448826 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:23.181 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.174+0000 7fad3b5776c0 1 --2- 10.20.193.96:0/860448826 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fad3c122a10 0x7fad3c122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:23.181 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.174+0000 7fad3ad766c0 1 --2- 10.20.193.96:0/860448826 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fad3c10f200 0x7fad3c11d110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:23.181 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.174+0000 7fad3a5756c0 1 -- 10.20.193.96:0/860448826 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fad3c10f200 msgr2=0x7fad3c11d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:23.182 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.174+0000 7fad3a5756c0 1 --2- 10.20.193.96:0/860448826 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fad3c10f200 0x7fad3c11d110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:23.182 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.174+0000 7fad3a5756c0 1 -- 10.20.193.96:0/860448826 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fad3c122a10 msgr2=0x7fad3c122eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:23.182 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.174+0000 7fad3a5756c0 1 --2- 10.20.193.96:0/860448826 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fad3c122a10 0x7fad3c122eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:23.182 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.174+0000 7fad3a5756c0 1 -- 10.20.193.96:0/860448826 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad2c00a660 con 0x7fad3c115410 2026-02-13T03:34:23.182 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.174+0000 7fad3b5776c0 1 --2- 10.20.193.96:0/860448826 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fad3c122a10 0x7fad3c122eb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:34:23.182 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.174+0000 7fad3a5756c0 1 --2- 10.20.193.96:0/860448826 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fad3c115410 0x7fad3c11d650 secure :-1 s=READY pgs=250 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad2400b6c0 tx=0x7fad2400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:23.182 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.174+0000 7fad1bfff6c0 1 -- 10.20.193.96:0/860448826 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fad24004250 con 0x7fad3c115410 2026-02-13T03:34:23.182 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.174+0000 7fad1bfff6c0 1 -- 10.20.193.96:0/860448826 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fad24009070 con 0x7fad3c115410 2026-02-13T03:34:23.182 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.174+0000 7fad4109b6c0 1 -- 10.20.193.96:0/860448826 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad3c163c00 con 0x7fad3c115410 2026-02-13T03:34:23.182 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.174+0000 7fad1bfff6c0 1 -- 10.20.193.96:0/860448826 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fad2400ccd0 con 0x7fad3c115410 2026-02-13T03:34:23.182 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.174+0000 7fad4109b6c0 1 -- 10.20.193.96:0/860448826 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad3c164090 con 0x7fad3c115410 2026-02-13T03:34:23.183 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.174+0000 7fad4109b6c0 1 -- 10.20.193.96:0/860448826 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad3c1104d0 con 0x7fad3c115410 2026-02-13T03:34:23.183 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.176+0000 7fad1bfff6c0 1 -- 10.20.193.96:0/860448826 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fad240028c0 con 0x7fad3c115410 2026-02-13T03:34:23.183 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.176+0000 7fad1bfff6c0 1 --2- 10.20.193.96:0/860448826 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fad100b5710 0x7fad100d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:23.183 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.176+0000 7fad3ad766c0 1 --2- 10.20.193.96:0/860448826 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fad100b5710 0x7fad100d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:23.183 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.177+0000 7fad1bfff6c0 1 -- 10.20.193.96:0/860448826 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7fad240e3b00 con 0x7fad3c115410 2026-02-13T03:34:23.183 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.177+0000 7fad3ad766c0 1 --2- 10.20.193.96:0/860448826 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fad100b5710 0x7fad100d5bc0 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad30005980 tx=0x7fad30005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:23.183 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.177+0000 7fad1bfff6c0 1 -- 10.20.193.96:0/860448826 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fad240a6560 con 0x7fad3c115410 2026-02-13T03:34:23.269 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.266+0000 7fad4109b6c0 1 -- 10.20.193.96:0/860448826 --> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fad3c11e2f0 con 0x7fad100b5710 2026-02-13T03:34:23.271 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.268+0000 7fad1bfff6c0 1 -- 10.20.193.96:0/860448826 <== mgr.14116 v2:10.20.193.96:6800/1736050816 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258925 (secure 0 0 0) 0x7fad3000b7d0 con 0x7fad100b5710 2026-02-13T03:34:23.275 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:23.276 INFO:teuthology.orchestra.run.trial096.stderr:dumped all 2026-02-13T03:34:23.278 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.270+0000 7fad4109b6c0 1 -- 10.20.193.96:0/860448826 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fad100b5710 msgr2=0x7fad100d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:23.279 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.270+0000 7fad4109b6c0 1 --2- 10.20.193.96:0/860448826 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fad100b5710 0x7fad100d5bc0 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad30005980 tx=0x7fad30005910 comp rx=0 tx=0).stop 2026-02-13T03:34:23.279 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.270+0000 7fad4109b6c0 1 -- 10.20.193.96:0/860448826 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fad3c115410 msgr2=0x7fad3c11d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:23.279 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.270+0000 7fad4109b6c0 1 --2- 10.20.193.96:0/860448826 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fad3c115410 0x7fad3c11d650 secure :-1 s=READY pgs=250 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad2400b6c0 tx=0x7fad2400bb90 comp rx=0 tx=0).stop 2026-02-13T03:34:23.279 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.270+0000 7fad4109b6c0 1 -- 10.20.193.96:0/860448826 shutdown_connections 2026-02-13T03:34:23.279 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.270+0000 7fad4109b6c0 1 --2- 10.20.193.96:0/860448826 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fad100b5710 0x7fad100d5bc0 unknown :-1 s=CLOSED pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:23.279 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.270+0000 7fad4109b6c0 1 --2- 10.20.193.96:0/860448826 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fad3c122a10 0x7fad3c122eb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:23.279 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.270+0000 7fad4109b6c0 1 --2- 10.20.193.96:0/860448826 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fad3c115410 0x7fad3c11d650 unknown :-1 s=CLOSED pgs=250 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:23.279 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.270+0000 7fad4109b6c0 1 --2- 10.20.193.96:0/860448826 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fad3c10f200 0x7fad3c11d110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:23.279 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.270+0000 7fad4109b6c0 1 -- 10.20.193.96:0/860448826 >> 10.20.193.96:0/860448826 conn(0x7fad3c0ecb00 msgr2=0x7fad3c10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:23.279 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.270+0000 7fad4109b6c0 1 -- 10.20.193.96:0/860448826 shutdown_connections 2026-02-13T03:34:23.280 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.270+0000 7fad4109b6c0 1 -- 10.20.193.96:0/860448826 wait complete. 2026-02-13T03:34:23.313 INFO:teuthology.orchestra.run.trial096.stdout:{"pg_ready":true,"pg_map":{"version":187,"stamp":"2026-02-13T03:34:22.578691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596115,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":123,"num_read_kb":105,"num_write":310,"num_write_kb":3756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":257,"ondisk_log_size":257,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":279,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":332488,"kb_used_data":8920,"kb_used_omap":376,"kb_used_meta":322951,"kb_avail":8807705912,"statfs":{"total":9019431321600,"available":9019090853888,"internally_reserved":0,"allocated":9134080,"data_stored":6031474,"data_compressed":114354,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":385873,"internal_metadata":330701999},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5747,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":121,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001529"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.949202+0000","last_change":"2026-02-13T03:34:15.119248+0000","last_active":"2026-02-13T03:34:16.949202+0000","last_peered":"2026-02-13T03:34:16.949202+0000","last_clean":"2026-02-13T03:34:16.949202+0000","last_became_active":"2026-02-13T03:34:15.118886+0000","last_became_peered":"2026-02-13T03:34:15.118886+0000","last_unstale":"2026-02-13T03:34:16.949202+0000","last_undegraded":"2026-02-13T03:34:16.949202+0000","last_fullsized":"2026-02-13T03:34:16.949202+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:56:49.614786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910225+0000","last_change":"2026-02-13T03:34:15.118140+0000","last_active":"2026-02-13T03:34:16.910225+0000","last_peered":"2026-02-13T03:34:16.910225+0000","last_clean":"2026-02-13T03:34:16.910225+0000","last_became_active":"2026-02-13T03:34:15.117796+0000","last_became_peered":"2026-02-13T03:34:15.117796+0000","last_unstale":"2026-02-13T03:34:16.910225+0000","last_undegraded":"2026-02-13T03:34:16.910225+0000","last_fullsized":"2026-02-13T03:34:16.910225+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:08:34.780460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910178+0000","last_change":"2026-02-13T03:34:15.116927+0000","last_active":"2026-02-13T03:34:16.910178+0000","last_peered":"2026-02-13T03:34:16.910178+0000","last_clean":"2026-02-13T03:34:16.910178+0000","last_became_active":"2026-02-13T03:34:15.116646+0000","last_became_peered":"2026-02-13T03:34:15.116646+0000","last_unstale":"2026-02-13T03:34:16.910178+0000","last_undegraded":"2026-02-13T03:34:16.910178+0000","last_fullsized":"2026-02-13T03:34:16.910178+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:24:45.374886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.122075+0000","last_change":"2026-02-13T03:34:15.127414+0000","last_active":"2026-02-13T03:34:16.122075+0000","last_peered":"2026-02-13T03:34:16.122075+0000","last_clean":"2026-02-13T03:34:16.122075+0000","last_became_active":"2026-02-13T03:34:15.127284+0000","last_became_peered":"2026-02-13T03:34:15.127284+0000","last_unstale":"2026-02-13T03:34:16.122075+0000","last_undegraded":"2026-02-13T03:34:16.122075+0000","last_fullsized":"2026-02-13T03:34:16.122075+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:10:58.233447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909667+0000","last_change":"2026-02-13T03:34:15.117815+0000","last_active":"2026-02-13T03:34:16.909667+0000","last_peered":"2026-02-13T03:34:16.909667+0000","last_clean":"2026-02-13T03:34:16.909667+0000","last_became_active":"2026-02-13T03:34:15.117642+0000","last_became_peered":"2026-02-13T03:34:15.117642+0000","last_unstale":"2026-02-13T03:34:16.909667+0000","last_undegraded":"2026-02-13T03:34:16.909667+0000","last_fullsized":"2026-02-13T03:34:16.909667+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:06:59.379987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.912593+0000","last_change":"2026-02-13T03:34:15.127838+0000","last_active":"2026-02-13T03:34:16.912593+0000","last_peered":"2026-02-13T03:34:16.912593+0000","last_clean":"2026-02-13T03:34:16.912593+0000","last_became_active":"2026-02-13T03:34:15.127492+0000","last_became_peered":"2026-02-13T03:34:15.127492+0000","last_unstale":"2026-02-13T03:34:16.912593+0000","last_undegraded":"2026-02-13T03:34:16.912593+0000","last_fullsized":"2026-02-13T03:34:16.912593+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:10:44.948452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.177724+0000","last_change":"2026-02-13T03:34:15.128751+0000","last_active":"2026-02-13T03:34:16.177724+0000","last_peered":"2026-02-13T03:34:16.177724+0000","last_clean":"2026-02-13T03:34:16.177724+0000","last_became_active":"2026-02-13T03:34:15.128588+0000","last_became_peered":"2026-02-13T03:34:15.128588+0000","last_unstale":"2026-02-13T03:34:16.177724+0000","last_undegraded":"2026-02-13T03:34:16.177724+0000","last_fullsized":"2026-02-13T03:34:16.177724+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:46:50.929612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.790967+0000","last_change":"2026-02-13T03:34:15.119765+0000","last_active":"2026-02-13T03:34:16.790967+0000","last_peered":"2026-02-13T03:34:16.790967+0000","last_clean":"2026-02-13T03:34:16.790967+0000","last_became_active":"2026-02-13T03:34:15.118656+0000","last_became_peered":"2026-02-13T03:34:15.118656+0000","last_unstale":"2026-02-13T03:34:16.790967+0000","last_undegraded":"2026-02-13T03:34:16.790967+0000","last_fullsized":"2026-02-13T03:34:16.790967+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:32:01.369279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.921188+0000","last_change":"2026-02-13T03:34:15.129750+0000","last_active":"2026-02-13T03:34:16.921188+0000","last_peered":"2026-02-13T03:34:16.921188+0000","last_clean":"2026-02-13T03:34:16.921188+0000","last_became_active":"2026-02-13T03:34:15.129277+0000","last_became_peered":"2026-02-13T03:34:15.129277+0000","last_unstale":"2026-02-13T03:34:16.921188+0000","last_undegraded":"2026-02-13T03:34:16.921188+0000","last_fullsized":"2026-02-13T03:34:16.921188+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:54:36.873732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.912899+0000","last_change":"2026-02-13T03:34:15.127742+0000","last_active":"2026-02-13T03:34:16.912899+0000","last_peered":"2026-02-13T03:34:16.912899+0000","last_clean":"2026-02-13T03:34:16.912899+0000","last_became_active":"2026-02-13T03:34:15.127189+0000","last_became_peered":"2026-02-13T03:34:15.127189+0000","last_unstale":"2026-02-13T03:34:16.912899+0000","last_undegraded":"2026-02-13T03:34:16.912899+0000","last_fullsized":"2026-02-13T03:34:16.912899+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:55:52.004058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.178276+0000","last_change":"2026-02-13T03:34:15.127809+0000","last_active":"2026-02-13T03:34:16.178276+0000","last_peered":"2026-02-13T03:34:16.178276+0000","last_clean":"2026-02-13T03:34:16.178276+0000","last_became_active":"2026-02-13T03:34:15.127680+0000","last_became_peered":"2026-02-13T03:34:15.127680+0000","last_unstale":"2026-02-13T03:34:16.178276+0000","last_undegraded":"2026-02-13T03:34:16.178276+0000","last_fullsized":"2026-02-13T03:34:16.178276+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:22:18.420199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.122122+0000","last_change":"2026-02-13T03:34:15.127680+0000","last_active":"2026-02-13T03:34:16.122122+0000","last_peered":"2026-02-13T03:34:16.122122+0000","last_clean":"2026-02-13T03:34:16.122122+0000","last_became_active":"2026-02-13T03:34:15.127508+0000","last_became_peered":"2026-02-13T03:34:15.127508+0000","last_unstale":"2026-02-13T03:34:16.122122+0000","last_undegraded":"2026-02-13T03:34:16.122122+0000","last_fullsized":"2026-02-13T03:34:16.122122+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:22:12.516766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111152+0000","last_change":"2026-02-13T03:34:15.117625+0000","last_active":"2026-02-13T03:34:16.111152+0000","last_peered":"2026-02-13T03:34:16.111152+0000","last_clean":"2026-02-13T03:34:16.111152+0000","last_became_active":"2026-02-13T03:34:15.117420+0000","last_became_peered":"2026-02-13T03:34:15.117420+0000","last_unstale":"2026-02-13T03:34:16.111152+0000","last_undegraded":"2026-02-13T03:34:16.111152+0000","last_fullsized":"2026-02-13T03:34:16.111152+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:53:17.688410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910011+0000","last_change":"2026-02-13T03:34:15.117960+0000","last_active":"2026-02-13T03:34:16.910011+0000","last_peered":"2026-02-13T03:34:16.910011+0000","last_clean":"2026-02-13T03:34:16.910011+0000","last_became_active":"2026-02-13T03:34:15.117819+0000","last_became_peered":"2026-02-13T03:34:15.117819+0000","last_unstale":"2026-02-13T03:34:16.910011+0000","last_undegraded":"2026-02-13T03:34:16.910011+0000","last_fullsized":"2026-02-13T03:34:16.910011+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:53:45.980536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909998+0000","last_change":"2026-02-13T03:34:15.113255+0000","last_active":"2026-02-13T03:34:16.909998+0000","last_peered":"2026-02-13T03:34:16.909998+0000","last_clean":"2026-02-13T03:34:16.909998+0000","last_became_active":"2026-02-13T03:34:15.112672+0000","last_became_peered":"2026-02-13T03:34:15.112672+0000","last_unstale":"2026-02-13T03:34:16.909998+0000","last_undegraded":"2026-02-13T03:34:16.909998+0000","last_fullsized":"2026-02-13T03:34:16.909998+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:28:34.724819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.920815+0000","last_change":"2026-02-13T03:34:15.127054+0000","last_active":"2026-02-13T03:34:16.920815+0000","last_peered":"2026-02-13T03:34:16.920815+0000","last_clean":"2026-02-13T03:34:16.920815+0000","last_became_active":"2026-02-13T03:34:15.126826+0000","last_became_peered":"2026-02-13T03:34:15.126826+0000","last_unstale":"2026-02-13T03:34:16.920815+0000","last_undegraded":"2026-02-13T03:34:16.920815+0000","last_fullsized":"2026-02-13T03:34:16.920815+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:07:27.160289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.949262+0000","last_change":"2026-02-13T03:34:15.119834+0000","last_active":"2026-02-13T03:34:16.949262+0000","last_peered":"2026-02-13T03:34:16.949262+0000","last_clean":"2026-02-13T03:34:16.949262+0000","last_became_active":"2026-02-13T03:34:15.119509+0000","last_became_peered":"2026-02-13T03:34:15.119509+0000","last_unstale":"2026-02-13T03:34:16.949262+0000","last_undegraded":"2026-02-13T03:34:16.949262+0000","last_fullsized":"2026-02-13T03:34:16.949262+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:42:38.192170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111254+0000","last_change":"2026-02-13T03:34:15.118027+0000","last_active":"2026-02-13T03:34:16.111254+0000","last_peered":"2026-02-13T03:34:16.111254+0000","last_clean":"2026-02-13T03:34:16.111254+0000","last_became_active":"2026-02-13T03:34:15.117809+0000","last_became_peered":"2026-02-13T03:34:15.117809+0000","last_unstale":"2026-02-13T03:34:16.111254+0000","last_undegraded":"2026-02-13T03:34:16.111254+0000","last_fullsized":"2026-02-13T03:34:16.111254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:45:41.985508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910174+0000","last_change":"2026-02-13T03:34:15.117192+0000","last_active":"2026-02-13T03:34:16.910174+0000","last_peered":"2026-02-13T03:34:16.910174+0000","last_clean":"2026-02-13T03:34:16.910174+0000","last_became_active":"2026-02-13T03:34:15.116925+0000","last_became_peered":"2026-02-13T03:34:15.116925+0000","last_unstale":"2026-02-13T03:34:16.910174+0000","last_undegraded":"2026-02-13T03:34:16.910174+0000","last_fullsized":"2026-02-13T03:34:16.910174+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:02:01.642379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.948882+0000","last_change":"2026-02-13T03:34:15.118668+0000","last_active":"2026-02-13T03:34:16.948882+0000","last_peered":"2026-02-13T03:34:16.948882+0000","last_clean":"2026-02-13T03:34:16.948882+0000","last_became_active":"2026-02-13T03:34:15.118217+0000","last_became_peered":"2026-02-13T03:34:15.118217+0000","last_unstale":"2026-02-13T03:34:16.948882+0000","last_undegraded":"2026-02-13T03:34:16.948882+0000","last_fullsized":"2026-02-13T03:34:16.948882+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:19:35.001241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111259+0000","last_change":"2026-02-13T03:34:15.116906+0000","last_active":"2026-02-13T03:34:16.111259+0000","last_peered":"2026-02-13T03:34:16.111259+0000","last_clean":"2026-02-13T03:34:16.111259+0000","last_became_active":"2026-02-13T03:34:15.116699+0000","last_became_peered":"2026-02-13T03:34:15.116699+0000","last_unstale":"2026-02-13T03:34:16.111259+0000","last_undegraded":"2026-02-13T03:34:16.111259+0000","last_fullsized":"2026-02-13T03:34:16.111259+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:47:23.331768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.920953+0000","last_change":"2026-02-13T03:34:15.127773+0000","last_active":"2026-02-13T03:34:16.920953+0000","last_peered":"2026-02-13T03:34:16.920953+0000","last_clean":"2026-02-13T03:34:16.920953+0000","last_became_active":"2026-02-13T03:34:15.127473+0000","last_became_peered":"2026-02-13T03:34:15.127473+0000","last_unstale":"2026-02-13T03:34:16.920953+0000","last_undegraded":"2026-02-13T03:34:16.920953+0000","last_fullsized":"2026-02-13T03:34:16.920953+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:27:08.244945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.790949+0000","last_change":"2026-02-13T03:34:15.118782+0000","last_active":"2026-02-13T03:34:16.790949+0000","last_peered":"2026-02-13T03:34:16.790949+0000","last_clean":"2026-02-13T03:34:16.790949+0000","last_became_active":"2026-02-13T03:34:15.117896+0000","last_became_peered":"2026-02-13T03:34:15.117896+0000","last_unstale":"2026-02-13T03:34:16.790949+0000","last_undegraded":"2026-02-13T03:34:16.790949+0000","last_fullsized":"2026-02-13T03:34:16.790949+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:21:00.365223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110942+0000","last_change":"2026-02-13T03:34:15.117507+0000","last_active":"2026-02-13T03:34:16.110942+0000","last_peered":"2026-02-13T03:34:16.110942+0000","last_clean":"2026-02-13T03:34:16.110942+0000","last_became_active":"2026-02-13T03:34:15.117084+0000","last_became_peered":"2026-02-13T03:34:15.117084+0000","last_unstale":"2026-02-13T03:34:16.110942+0000","last_undegraded":"2026-02-13T03:34:16.110942+0000","last_fullsized":"2026-02-13T03:34:16.110942+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:08:11.739974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791306+0000","last_change":"2026-02-13T03:34:15.120007+0000","last_active":"2026-02-13T03:34:16.791306+0000","last_peered":"2026-02-13T03:34:16.791306+0000","last_clean":"2026-02-13T03:34:16.791306+0000","last_became_active":"2026-02-13T03:34:15.119271+0000","last_became_peered":"2026-02-13T03:34:15.119271+0000","last_unstale":"2026-02-13T03:34:16.791306+0000","last_undegraded":"2026-02-13T03:34:16.791306+0000","last_fullsized":"2026-02-13T03:34:16.791306+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:40:54.160572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910319+0000","last_change":"2026-02-13T03:34:15.115991+0000","last_active":"2026-02-13T03:34:16.910319+0000","last_peered":"2026-02-13T03:34:16.910319+0000","last_clean":"2026-02-13T03:34:16.910319+0000","last_became_active":"2026-02-13T03:34:15.115795+0000","last_became_peered":"2026-02-13T03:34:15.115795+0000","last_unstale":"2026-02-13T03:34:16.910319+0000","last_undegraded":"2026-02-13T03:34:16.910319+0000","last_fullsized":"2026-02-13T03:34:16.910319+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:08:10.245339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.949096+0000","last_change":"2026-02-13T03:34:15.117921+0000","last_active":"2026-02-13T03:34:16.949096+0000","last_peered":"2026-02-13T03:34:16.949096+0000","last_clean":"2026-02-13T03:34:16.949096+0000","last_became_active":"2026-02-13T03:34:15.117628+0000","last_became_peered":"2026-02-13T03:34:15.117628+0000","last_unstale":"2026-02-13T03:34:16.949096+0000","last_undegraded":"2026-02-13T03:34:16.949096+0000","last_fullsized":"2026-02-13T03:34:16.949096+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:48:11.389400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111141+0000","last_change":"2026-02-13T03:34:15.115046+0000","last_active":"2026-02-13T03:34:16.111141+0000","last_peered":"2026-02-13T03:34:16.111141+0000","last_clean":"2026-02-13T03:34:16.111141+0000","last_became_active":"2026-02-13T03:34:15.114250+0000","last_became_peered":"2026-02-13T03:34:15.114250+0000","last_unstale":"2026-02-13T03:34:16.111141+0000","last_undegraded":"2026-02-13T03:34:16.111141+0000","last_fullsized":"2026-02-13T03:34:16.111141+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:58:56.156972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910188+0000","last_change":"2026-02-13T03:34:15.114493+0000","last_active":"2026-02-13T03:34:16.910188+0000","last_peered":"2026-02-13T03:34:16.910188+0000","last_clean":"2026-02-13T03:34:16.910188+0000","last_became_active":"2026-02-13T03:34:15.114096+0000","last_became_peered":"2026-02-13T03:34:15.114096+0000","last_unstale":"2026-02-13T03:34:16.910188+0000","last_undegraded":"2026-02-13T03:34:16.910188+0000","last_fullsized":"2026-02-13T03:34:16.910188+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:26:07.768976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909836+0000","last_change":"2026-02-13T03:34:15.116564+0000","last_active":"2026-02-13T03:34:16.909836+0000","last_peered":"2026-02-13T03:34:16.909836+0000","last_clean":"2026-02-13T03:34:16.909836+0000","last_became_active":"2026-02-13T03:34:15.116345+0000","last_became_peered":"2026-02-13T03:34:15.116345+0000","last_unstale":"2026-02-13T03:34:16.909836+0000","last_undegraded":"2026-02-13T03:34:16.909836+0000","last_fullsized":"2026-02-13T03:34:16.909836+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:52:47.350389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909938+0000","last_change":"2026-02-13T03:34:15.117449+0000","last_active":"2026-02-13T03:34:16.909938+0000","last_peered":"2026-02-13T03:34:16.909938+0000","last_clean":"2026-02-13T03:34:16.909938+0000","last_became_active":"2026-02-13T03:34:15.117220+0000","last_became_peered":"2026-02-13T03:34:15.117220+0000","last_unstale":"2026-02-13T03:34:16.909938+0000","last_undegraded":"2026-02-13T03:34:16.909938+0000","last_fullsized":"2026-02-13T03:34:16.909938+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:38:43.911384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.948915+0000","last_change":"2026-02-13T03:34:15.118184+0000","last_active":"2026-02-13T03:34:16.948915+0000","last_peered":"2026-02-13T03:34:16.948915+0000","last_clean":"2026-02-13T03:34:16.948915+0000","last_became_active":"2026-02-13T03:34:15.117890+0000","last_became_peered":"2026-02-13T03:34:15.117890+0000","last_unstale":"2026-02-13T03:34:16.948915+0000","last_undegraded":"2026-02-13T03:34:16.948915+0000","last_fullsized":"2026-02-13T03:34:16.948915+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:22:03.620680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909815+0000","last_change":"2026-02-13T03:34:15.116404+0000","last_active":"2026-02-13T03:34:16.909815+0000","last_peered":"2026-02-13T03:34:16.909815+0000","last_clean":"2026-02-13T03:34:16.909815+0000","last_became_active":"2026-02-13T03:34:15.116094+0000","last_became_peered":"2026-02-13T03:34:15.116094+0000","last_unstale":"2026-02-13T03:34:16.909815+0000","last_undegraded":"2026-02-13T03:34:16.909815+0000","last_fullsized":"2026-02-13T03:34:16.909815+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:58:39.719264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"68'6","reported_seq":27,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:21.139555+0000","last_change":"2026-02-13T03:34:14.110943+0000","last_active":"2026-02-13T03:34:21.139555+0000","last_peered":"2026-02-13T03:34:21.139555+0000","last_clean":"2026-02-13T03:34:21.139555+0000","last_became_active":"2026-02-13T03:34:14.110502+0000","last_became_peered":"2026-02-13T03:34:14.110502+0000","last_unstale":"2026-02-13T03:34:21.139555+0000","last_undegraded":"2026-02-13T03:34:21.139555+0000","last_fullsized":"2026-02-13T03:34:21.139555+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:59:08.057823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110955+0000","last_change":"2026-02-13T03:34:15.118165+0000","last_active":"2026-02-13T03:34:16.110955+0000","last_peered":"2026-02-13T03:34:16.110955+0000","last_clean":"2026-02-13T03:34:16.110955+0000","last_became_active":"2026-02-13T03:34:15.117801+0000","last_became_peered":"2026-02-13T03:34:15.117801+0000","last_unstale":"2026-02-13T03:34:16.110955+0000","last_undegraded":"2026-02-13T03:34:16.110955+0000","last_fullsized":"2026-02-13T03:34:16.110955+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:01:06.764674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"68'3","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.147034+0000","last_change":"2026-02-13T03:34:14.119861+0000","last_active":"2026-02-13T03:34:19.147034+0000","last_peered":"2026-02-13T03:34:19.147034+0000","last_clean":"2026-02-13T03:34:19.147034+0000","last_became_active":"2026-02-13T03:34:14.119689+0000","last_became_peered":"2026-02-13T03:34:14.119689+0000","last_unstale":"2026-02-13T03:34:19.147034+0000","last_undegraded":"2026-02-13T03:34:19.147034+0000","last_fullsized":"2026-02-13T03:34:19.147034+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:43:33.601163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"68'2","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.136796+0000","last_change":"2026-02-13T03:34:14.107989+0000","last_active":"2026-02-13T03:34:19.136796+0000","last_peered":"2026-02-13T03:34:19.136796+0000","last_clean":"2026-02-13T03:34:19.136796+0000","last_became_active":"2026-02-13T03:34:14.107837+0000","last_became_peered":"2026-02-13T03:34:14.107837+0000","last_unstale":"2026-02-13T03:34:19.136796+0000","last_undegraded":"2026-02-13T03:34:19.136796+0000","last_fullsized":"2026-02-13T03:34:19.136796+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:20:23.452500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791223+0000","last_change":"2026-02-13T03:34:15.118354+0000","last_active":"2026-02-13T03:34:16.791223+0000","last_peered":"2026-02-13T03:34:16.791223+0000","last_clean":"2026-02-13T03:34:16.791223+0000","last_became_active":"2026-02-13T03:34:15.117486+0000","last_became_peered":"2026-02-13T03:34:15.117486+0000","last_unstale":"2026-02-13T03:34:16.791223+0000","last_undegraded":"2026-02-13T03:34:16.791223+0000","last_fullsized":"2026-02-13T03:34:16.791223+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:19:01.304754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"68'1","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.962330+0000","last_change":"2026-02-13T03:34:14.111386+0000","last_active":"2026-02-13T03:34:16.962330+0000","last_peered":"2026-02-13T03:34:16.962330+0000","last_clean":"2026-02-13T03:34:16.962330+0000","last_became_active":"2026-02-13T03:34:14.110945+0000","last_became_peered":"2026-02-13T03:34:14.110945+0000","last_unstale":"2026-02-13T03:34:16.962330+0000","last_undegraded":"2026-02-13T03:34:16.962330+0000","last_fullsized":"2026-02-13T03:34:16.962330+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:44:31.307711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111198+0000","last_change":"2026-02-13T03:34:15.117944+0000","last_active":"2026-02-13T03:34:16.111198+0000","last_peered":"2026-02-13T03:34:16.111198+0000","last_clean":"2026-02-13T03:34:16.111198+0000","last_became_active":"2026-02-13T03:34:15.117759+0000","last_became_peered":"2026-02-13T03:34:15.117759+0000","last_unstale":"2026-02-13T03:34:16.111198+0000","last_undegraded":"2026-02-13T03:34:16.111198+0000","last_fullsized":"2026-02-13T03:34:16.111198+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:31:00.846376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"68'3","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.142496+0000","last_change":"2026-02-13T03:34:14.122123+0000","last_active":"2026-02-13T03:34:18.142496+0000","last_peered":"2026-02-13T03:34:18.142496+0000","last_clean":"2026-02-13T03:34:18.142496+0000","last_became_active":"2026-02-13T03:34:14.122016+0000","last_became_peered":"2026-02-13T03:34:14.122016+0000","last_unstale":"2026-02-13T03:34:18.142496+0000","last_undegraded":"2026-02-13T03:34:18.142496+0000","last_fullsized":"2026-02-13T03:34:18.142496+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:38:07.386544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.921138+0000","last_change":"2026-02-13T03:34:15.129944+0000","last_active":"2026-02-13T03:34:16.921138+0000","last_peered":"2026-02-13T03:34:16.921138+0000","last_clean":"2026-02-13T03:34:16.921138+0000","last_became_active":"2026-02-13T03:34:15.129500+0000","last_became_peered":"2026-02-13T03:34:15.129500+0000","last_unstale":"2026-02-13T03:34:16.921138+0000","last_undegraded":"2026-02-13T03:34:16.921138+0000","last_fullsized":"2026-02-13T03:34:16.921138+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:04:46.496972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"68'2","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.142125+0000","last_change":"2026-02-13T03:34:14.120290+0000","last_active":"2026-02-13T03:34:18.142125+0000","last_peered":"2026-02-13T03:34:18.142125+0000","last_clean":"2026-02-13T03:34:18.142125+0000","last_became_active":"2026-02-13T03:34:14.120111+0000","last_became_peered":"2026-02-13T03:34:14.120111+0000","last_unstale":"2026-02-13T03:34:18.142125+0000","last_undegraded":"2026-02-13T03:34:18.142125+0000","last_fullsized":"2026-02-13T03:34:18.142125+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:02:12.116257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910374+0000","last_change":"2026-02-13T03:34:15.118561+0000","last_active":"2026-02-13T03:34:16.910374+0000","last_peered":"2026-02-13T03:34:16.910374+0000","last_clean":"2026-02-13T03:34:16.910374+0000","last_became_active":"2026-02-13T03:34:15.118392+0000","last_became_peered":"2026-02-13T03:34:15.118392+0000","last_unstale":"2026-02-13T03:34:16.910374+0000","last_undegraded":"2026-02-13T03:34:16.910374+0000","last_fullsized":"2026-02-13T03:34:16.910374+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:27:31.164818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"68'4","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.131542+0000","last_change":"2026-02-13T03:34:14.111107+0000","last_active":"2026-02-13T03:34:18.131542+0000","last_peered":"2026-02-13T03:34:18.131542+0000","last_clean":"2026-02-13T03:34:18.131542+0000","last_became_active":"2026-02-13T03:34:14.110113+0000","last_became_peered":"2026-02-13T03:34:14.110113+0000","last_unstale":"2026-02-13T03:34:18.131542+0000","last_undegraded":"2026-02-13T03:34:18.131542+0000","last_fullsized":"2026-02-13T03:34:18.131542+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:34:31.930234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.920945+0000","last_change":"2026-02-13T03:34:15.127705+0000","last_active":"2026-02-13T03:34:16.920945+0000","last_peered":"2026-02-13T03:34:16.920945+0000","last_clean":"2026-02-13T03:34:16.920945+0000","last_became_active":"2026-02-13T03:34:15.127292+0000","last_became_peered":"2026-02-13T03:34:15.127292+0000","last_unstale":"2026-02-13T03:34:16.920945+0000","last_undegraded":"2026-02-13T03:34:16.920945+0000","last_fullsized":"2026-02-13T03:34:16.920945+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:08:59.692931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"68'8","reported_seq":24,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.142217+0000","last_change":"2026-02-13T03:34:14.121451+0000","last_active":"2026-02-13T03:34:18.142217+0000","last_peered":"2026-02-13T03:34:18.142217+0000","last_clean":"2026-02-13T03:34:18.142217+0000","last_became_active":"2026-02-13T03:34:14.121350+0000","last_became_peered":"2026-02-13T03:34:14.121350+0000","last_unstale":"2026-02-13T03:34:18.142217+0000","last_undegraded":"2026-02-13T03:34:18.142217+0000","last_fullsized":"2026-02-13T03:34:18.142217+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:36:35.041824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1634,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909996+0000","last_change":"2026-02-13T03:34:15.116911+0000","last_active":"2026-02-13T03:34:16.909996+0000","last_peered":"2026-02-13T03:34:16.909996+0000","last_clean":"2026-02-13T03:34:16.909996+0000","last_became_active":"2026-02-13T03:34:15.116542+0000","last_became_peered":"2026-02-13T03:34:15.116542+0000","last_unstale":"2026-02-13T03:34:16.909996+0000","last_undegraded":"2026-02-13T03:34:16.909996+0000","last_fullsized":"2026-02-13T03:34:16.909996+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:51:00.767989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"68'6","reported_seq":23,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.135867+0000","last_change":"2026-02-13T03:34:14.110089+0000","last_active":"2026-02-13T03:34:19.135867+0000","last_peered":"2026-02-13T03:34:19.135867+0000","last_clean":"2026-02-13T03:34:19.135867+0000","last_became_active":"2026-02-13T03:34:14.109857+0000","last_became_peered":"2026-02-13T03:34:14.109857+0000","last_unstale":"2026-02-13T03:34:19.135867+0000","last_undegraded":"2026-02-13T03:34:19.135867+0000","last_fullsized":"2026-02-13T03:34:19.135867+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:28:26.120434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110999+0000","last_change":"2026-02-13T03:34:15.117207+0000","last_active":"2026-02-13T03:34:16.110999+0000","last_peered":"2026-02-13T03:34:16.110999+0000","last_clean":"2026-02-13T03:34:16.110999+0000","last_became_active":"2026-02-13T03:34:15.117080+0000","last_became_peered":"2026-02-13T03:34:15.117080+0000","last_unstale":"2026-02-13T03:34:16.110999+0000","last_undegraded":"2026-02-13T03:34:16.110999+0000","last_fullsized":"2026-02-13T03:34:16.110999+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:10:21.048259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"68'3","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.131713+0000","last_change":"2026-02-13T03:34:14.110249+0000","last_active":"2026-02-13T03:34:18.131713+0000","last_peered":"2026-02-13T03:34:18.131713+0000","last_clean":"2026-02-13T03:34:18.131713+0000","last_became_active":"2026-02-13T03:34:14.109916+0000","last_became_peered":"2026-02-13T03:34:14.109916+0000","last_unstale":"2026-02-13T03:34:18.131713+0000","last_undegraded":"2026-02-13T03:34:18.131713+0000","last_fullsized":"2026-02-13T03:34:18.131713+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:10:50.121909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.178258+0000","last_change":"2026-02-13T03:34:15.128143+0000","last_active":"2026-02-13T03:34:16.178258+0000","last_peered":"2026-02-13T03:34:16.178258+0000","last_clean":"2026-02-13T03:34:16.178258+0000","last_became_active":"2026-02-13T03:34:15.128030+0000","last_became_peered":"2026-02-13T03:34:15.128030+0000","last_unstale":"2026-02-13T03:34:16.178258+0000","last_undegraded":"2026-02-13T03:34:16.178258+0000","last_fullsized":"2026-02-13T03:34:16.178258+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:06:52.963812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"68'3","reported_seq":22,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:20.149421+0000","last_change":"2026-02-13T03:34:14.119064+0000","last_active":"2026-02-13T03:34:20.149421+0000","last_peered":"2026-02-13T03:34:20.149421+0000","last_clean":"2026-02-13T03:34:20.149421+0000","last_became_active":"2026-02-13T03:34:14.118830+0000","last_became_peered":"2026-02-13T03:34:14.118830+0000","last_unstale":"2026-02-13T03:34:20.149421+0000","last_undegraded":"2026-02-13T03:34:20.149421+0000","last_fullsized":"2026-02-13T03:34:20.149421+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:53:25.966883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.177842+0000","last_change":"2026-02-13T03:34:15.129037+0000","last_active":"2026-02-13T03:34:16.177842+0000","last_peered":"2026-02-13T03:34:16.177842+0000","last_clean":"2026-02-13T03:34:16.177842+0000","last_became_active":"2026-02-13T03:34:15.128632+0000","last_became_peered":"2026-02-13T03:34:15.128632+0000","last_unstale":"2026-02-13T03:34:16.177842+0000","last_undegraded":"2026-02-13T03:34:16.177842+0000","last_fullsized":"2026-02-13T03:34:16.177842+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:19:22.180885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"68'15","reported_seq":31,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.136706+0000","last_change":"2026-02-13T03:34:14.110318+0000","last_active":"2026-02-13T03:34:19.136706+0000","last_peered":"2026-02-13T03:34:19.136706+0000","last_clean":"2026-02-13T03:34:19.136706+0000","last_became_active":"2026-02-13T03:34:14.109648+0000","last_became_peered":"2026-02-13T03:34:14.109648+0000","last_unstale":"2026-02-13T03:34:19.136706+0000","last_undegraded":"2026-02-13T03:34:19.136706+0000","last_fullsized":"2026-02-13T03:34:19.136706+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:06:33.574407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110988+0000","last_change":"2026-02-13T03:34:15.116762+0000","last_active":"2026-02-13T03:34:16.110988+0000","last_peered":"2026-02-13T03:34:16.110988+0000","last_clean":"2026-02-13T03:34:16.110988+0000","last_became_active":"2026-02-13T03:34:15.116280+0000","last_became_peered":"2026-02-13T03:34:15.116280+0000","last_unstale":"2026-02-13T03:34:16.110988+0000","last_undegraded":"2026-02-13T03:34:16.110988+0000","last_fullsized":"2026-02-13T03:34:16.110988+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:36:18.141037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"67'1","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910092+0000","last_change":"2026-02-13T03:34:14.110976+0000","last_active":"2026-02-13T03:34:16.910092+0000","last_peered":"2026-02-13T03:34:16.910092+0000","last_clean":"2026-02-13T03:34:16.910092+0000","last_became_active":"2026-02-13T03:34:14.110717+0000","last_became_peered":"2026-02-13T03:34:14.110717+0000","last_unstale":"2026-02-13T03:34:16.910092+0000","last_undegraded":"2026-02-13T03:34:16.910092+0000","last_fullsized":"2026-02-13T03:34:16.910092+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:25:27.336312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.949109+0000","last_change":"2026-02-13T03:34:15.118326+0000","last_active":"2026-02-13T03:34:16.949109+0000","last_peered":"2026-02-13T03:34:16.949109+0000","last_clean":"2026-02-13T03:34:16.949109+0000","last_became_active":"2026-02-13T03:34:15.117977+0000","last_became_peered":"2026-02-13T03:34:15.117977+0000","last_unstale":"2026-02-13T03:34:16.949109+0000","last_undegraded":"2026-02-13T03:34:16.949109+0000","last_fullsized":"2026-02-13T03:34:16.949109+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:43:03.579176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"67'2","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111152+0000","last_change":"2026-02-13T03:34:14.109555+0000","last_active":"2026-02-13T03:34:16.111152+0000","last_peered":"2026-02-13T03:34:16.111152+0000","last_clean":"2026-02-13T03:34:16.111152+0000","last_became_active":"2026-02-13T03:34:14.109369+0000","last_became_peered":"2026-02-13T03:34:14.109369+0000","last_unstale":"2026-02-13T03:34:16.111152+0000","last_undegraded":"2026-02-13T03:34:16.111152+0000","last_fullsized":"2026-02-13T03:34:16.111152+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:16:14.530159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.178325+0000","last_change":"2026-02-13T03:34:15.126930+0000","last_active":"2026-02-13T03:34:16.178325+0000","last_peered":"2026-02-13T03:34:16.178325+0000","last_clean":"2026-02-13T03:34:16.178325+0000","last_became_active":"2026-02-13T03:34:15.126768+0000","last_became_peered":"2026-02-13T03:34:15.126768+0000","last_unstale":"2026-02-13T03:34:16.178325+0000","last_undegraded":"2026-02-13T03:34:16.178325+0000","last_fullsized":"2026-02-13T03:34:16.178325+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:15:08.856303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"67'1","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.962366+0000","last_change":"2026-02-13T03:34:14.110533+0000","last_active":"2026-02-13T03:34:16.962366+0000","last_peered":"2026-02-13T03:34:16.962366+0000","last_clean":"2026-02-13T03:34:16.962366+0000","last_became_active":"2026-02-13T03:34:14.109851+0000","last_became_peered":"2026-02-13T03:34:14.109851+0000","last_unstale":"2026-02-13T03:34:16.962366+0000","last_undegraded":"2026-02-13T03:34:16.962366+0000","last_fullsized":"2026-02-13T03:34:16.962366+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:30:58.184043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"68'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:17.182704+0000","last_change":"2026-02-13T03:34:15.128728+0000","last_active":"2026-02-13T03:34:17.182704+0000","last_peered":"2026-02-13T03:34:17.182704+0000","last_clean":"2026-02-13T03:34:17.182704+0000","last_became_active":"2026-02-13T03:34:15.128579+0000","last_became_peered":"2026-02-13T03:34:15.128579+0000","last_unstale":"2026-02-13T03:34:17.182704+0000","last_undegraded":"2026-02-13T03:34:17.182704+0000","last_fullsized":"2026-02-13T03:34:17.182704+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:05:25.697309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"68'3","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.136336+0000","last_change":"2026-02-13T03:34:14.112417+0000","last_active":"2026-02-13T03:34:19.136336+0000","last_peered":"2026-02-13T03:34:19.136336+0000","last_clean":"2026-02-13T03:34:19.136336+0000","last_became_active":"2026-02-13T03:34:14.112282+0000","last_became_peered":"2026-02-13T03:34:14.112282+0000","last_unstale":"2026-02-13T03:34:19.136336+0000","last_undegraded":"2026-02-13T03:34:19.136336+0000","last_fullsized":"2026-02-13T03:34:19.136336+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:54:26.443931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.178303+0000","last_change":"2026-02-13T03:34:15.128773+0000","last_active":"2026-02-13T03:34:16.178303+0000","last_peered":"2026-02-13T03:34:16.178303+0000","last_clean":"2026-02-13T03:34:16.178303+0000","last_became_active":"2026-02-13T03:34:15.128614+0000","last_became_peered":"2026-02-13T03:34:15.128614+0000","last_unstale":"2026-02-13T03:34:16.178303+0000","last_undegraded":"2026-02-13T03:34:16.178303+0000","last_fullsized":"2026-02-13T03:34:16.178303+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:21:12.460740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'152","reported_seq":335,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.177697+0000","last_change":"2026-02-13T03:33:53.689186+0000","last_active":"2026-02-13T03:34:16.177697+0000","last_peered":"2026-02-13T03:34:16.177697+0000","last_clean":"2026-02-13T03:34:16.177697+0000","last_became_active":"2026-02-13T03:33:53.689016+0000","last_became_peered":"2026-02-13T03:33:53.689016+0000","last_unstale":"2026-02-13T03:34:16.177697+0000","last_undegraded":"2026-02-13T03:34:16.177697+0000","last_fullsized":"2026-02-13T03:34:16.177697+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:32:51.335478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:32:51.335478+0000","last_clean_scrub_stamp":"2026-02-13T03:32:51.335478+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:46:12.228415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"68'3","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:20.148489+0000","last_change":"2026-02-13T03:34:14.118073+0000","last_active":"2026-02-13T03:34:20.148489+0000","last_peered":"2026-02-13T03:34:20.148489+0000","last_clean":"2026-02-13T03:34:20.148489+0000","last_became_active":"2026-02-13T03:34:14.117930+0000","last_became_peered":"2026-02-13T03:34:14.117930+0000","last_unstale":"2026-02-13T03:34:20.148489+0000","last_undegraded":"2026-02-13T03:34:20.148489+0000","last_fullsized":"2026-02-13T03:34:20.148489+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:31:04.815698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791157+0000","last_change":"2026-02-13T03:34:15.120789+0000","last_active":"2026-02-13T03:34:16.791157+0000","last_peered":"2026-02-13T03:34:16.791157+0000","last_clean":"2026-02-13T03:34:16.791157+0000","last_became_active":"2026-02-13T03:34:15.120102+0000","last_became_peered":"2026-02-13T03:34:15.120102+0000","last_unstale":"2026-02-13T03:34:16.791157+0000","last_undegraded":"2026-02-13T03:34:16.791157+0000","last_fullsized":"2026-02-13T03:34:16.791157+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:10:29.422050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"68'3","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.147121+0000","last_change":"2026-02-13T03:34:14.119784+0000","last_active":"2026-02-13T03:34:19.147121+0000","last_peered":"2026-02-13T03:34:19.147121+0000","last_clean":"2026-02-13T03:34:19.147121+0000","last_became_active":"2026-02-13T03:34:14.119642+0000","last_became_peered":"2026-02-13T03:34:14.119642+0000","last_unstale":"2026-02-13T03:34:19.147121+0000","last_undegraded":"2026-02-13T03:34:19.147121+0000","last_fullsized":"2026-02-13T03:34:19.147121+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:15:09.988019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110957+0000","last_change":"2026-02-13T03:34:15.113490+0000","last_active":"2026-02-13T03:34:16.110957+0000","last_peered":"2026-02-13T03:34:16.110957+0000","last_clean":"2026-02-13T03:34:16.110957+0000","last_became_active":"2026-02-13T03:34:15.113119+0000","last_became_peered":"2026-02-13T03:34:15.113119+0000","last_unstale":"2026-02-13T03:34:16.110957+0000","last_undegraded":"2026-02-13T03:34:16.110957+0000","last_fullsized":"2026-02-13T03:34:16.110957+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:26:12.918710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"68'4","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.136603+0000","last_change":"2026-02-13T03:34:14.107155+0000","last_active":"2026-02-13T03:34:19.136603+0000","last_peered":"2026-02-13T03:34:19.136603+0000","last_clean":"2026-02-13T03:34:19.136603+0000","last_became_active":"2026-02-13T03:34:14.106966+0000","last_became_peered":"2026-02-13T03:34:14.106966+0000","last_unstale":"2026-02-13T03:34:19.136603+0000","last_undegraded":"2026-02-13T03:34:19.136603+0000","last_fullsized":"2026-02-13T03:34:19.136603+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:23:06.193832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110886+0000","last_change":"2026-02-13T03:34:15.116852+0000","last_active":"2026-02-13T03:34:16.110886+0000","last_peered":"2026-02-13T03:34:16.110886+0000","last_clean":"2026-02-13T03:34:16.110886+0000","last_became_active":"2026-02-13T03:34:15.116610+0000","last_became_peered":"2026-02-13T03:34:15.116610+0000","last_unstale":"2026-02-13T03:34:16.110886+0000","last_undegraded":"2026-02-13T03:34:16.110886+0000","last_fullsized":"2026-02-13T03:34:16.110886+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:13:33.504269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"68'1","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:17.182694+0000","last_change":"2026-02-13T03:34:14.118389+0000","last_active":"2026-02-13T03:34:17.182694+0000","last_peered":"2026-02-13T03:34:17.182694+0000","last_clean":"2026-02-13T03:34:17.182694+0000","last_became_active":"2026-02-13T03:34:14.118111+0000","last_became_peered":"2026-02-13T03:34:14.118111+0000","last_unstale":"2026-02-13T03:34:17.182694+0000","last_undegraded":"2026-02-13T03:34:17.182694+0000","last_fullsized":"2026-02-13T03:34:17.182694+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:26:09.727990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.912869+0000","last_change":"2026-02-13T03:34:15.129069+0000","last_active":"2026-02-13T03:34:16.912869+0000","last_peered":"2026-02-13T03:34:16.912869+0000","last_clean":"2026-02-13T03:34:16.912869+0000","last_became_active":"2026-02-13T03:34:15.128801+0000","last_became_peered":"2026-02-13T03:34:15.128801+0000","last_unstale":"2026-02-13T03:34:16.912869+0000","last_undegraded":"2026-02-13T03:34:16.912869+0000","last_fullsized":"2026-02-13T03:34:16.912869+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:05:14.500513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111153+0000","last_change":"2026-02-13T03:34:14.110643+0000","last_active":"2026-02-13T03:34:16.111153+0000","last_peered":"2026-02-13T03:34:16.111153+0000","last_clean":"2026-02-13T03:34:16.111153+0000","last_became_active":"2026-02-13T03:34:14.110456+0000","last_became_peered":"2026-02-13T03:34:14.110456+0000","last_unstale":"2026-02-13T03:34:16.111153+0000","last_undegraded":"2026-02-13T03:34:16.111153+0000","last_fullsized":"2026-02-13T03:34:16.111153+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:22:20.313197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.912847+0000","last_change":"2026-02-13T03:34:15.129233+0000","last_active":"2026-02-13T03:34:16.912847+0000","last_peered":"2026-02-13T03:34:16.912847+0000","last_clean":"2026-02-13T03:34:16.912847+0000","last_became_active":"2026-02-13T03:34:15.128972+0000","last_became_peered":"2026-02-13T03:34:15.128972+0000","last_unstale":"2026-02-13T03:34:16.912847+0000","last_undegraded":"2026-02-13T03:34:16.912847+0000","last_fullsized":"2026-02-13T03:34:16.912847+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:38:10.731668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"68'1","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910172+0000","last_change":"2026-02-13T03:34:14.110025+0000","last_active":"2026-02-13T03:34:16.910172+0000","last_peered":"2026-02-13T03:34:16.910172+0000","last_clean":"2026-02-13T03:34:16.910172+0000","last_became_active":"2026-02-13T03:34:14.109687+0000","last_became_peered":"2026-02-13T03:34:14.109687+0000","last_unstale":"2026-02-13T03:34:16.910172+0000","last_undegraded":"2026-02-13T03:34:16.910172+0000","last_fullsized":"2026-02-13T03:34:16.910172+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:58:00.997107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111247+0000","last_change":"2026-02-13T03:34:15.116452+0000","last_active":"2026-02-13T03:34:16.111247+0000","last_peered":"2026-02-13T03:34:16.111247+0000","last_clean":"2026-02-13T03:34:16.111247+0000","last_became_active":"2026-02-13T03:34:15.116297+0000","last_became_peered":"2026-02-13T03:34:15.116297+0000","last_unstale":"2026-02-13T03:34:16.111247+0000","last_undegraded":"2026-02-13T03:34:16.111247+0000","last_fullsized":"2026-02-13T03:34:16.111247+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:36:12.315236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"68'4","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.136357+0000","last_change":"2026-02-13T03:34:14.109823+0000","last_active":"2026-02-13T03:34:19.136357+0000","last_peered":"2026-02-13T03:34:19.136357+0000","last_clean":"2026-02-13T03:34:19.136357+0000","last_became_active":"2026-02-13T03:34:14.109688+0000","last_became_peered":"2026-02-13T03:34:14.109688+0000","last_unstale":"2026-02-13T03:34:19.136357+0000","last_undegraded":"2026-02-13T03:34:19.136357+0000","last_fullsized":"2026-02-13T03:34:19.136357+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:29:43.449201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791407+0000","last_change":"2026-02-13T03:34:15.120466+0000","last_active":"2026-02-13T03:34:16.791407+0000","last_peered":"2026-02-13T03:34:16.791407+0000","last_clean":"2026-02-13T03:34:16.791407+0000","last_became_active":"2026-02-13T03:34:15.119177+0000","last_became_peered":"2026-02-13T03:34:15.119177+0000","last_unstale":"2026-02-13T03:34:16.791407+0000","last_undegraded":"2026-02-13T03:34:16.791407+0000","last_fullsized":"2026-02-13T03:34:16.791407+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:38:14.396482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"68'4","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.142036+0000","last_change":"2026-02-13T03:34:14.123372+0000","last_active":"2026-02-13T03:34:18.142036+0000","last_peered":"2026-02-13T03:34:18.142036+0000","last_clean":"2026-02-13T03:34:18.142036+0000","last_became_active":"2026-02-13T03:34:14.123252+0000","last_became_peered":"2026-02-13T03:34:14.123252+0000","last_unstale":"2026-02-13T03:34:18.142036+0000","last_undegraded":"2026-02-13T03:34:18.142036+0000","last_fullsized":"2026-02-13T03:34:18.142036+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:12:44.138856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910239+0000","last_change":"2026-02-13T03:34:15.117238+0000","last_active":"2026-02-13T03:34:16.910239+0000","last_peered":"2026-02-13T03:34:16.910239+0000","last_clean":"2026-02-13T03:34:16.910239+0000","last_became_active":"2026-02-13T03:34:15.116951+0000","last_became_peered":"2026-02-13T03:34:15.116951+0000","last_unstale":"2026-02-13T03:34:16.910239+0000","last_undegraded":"2026-02-13T03:34:16.910239+0000","last_fullsized":"2026-02-13T03:34:16.910239+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:51:53.182871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.920776+0000","last_change":"2026-02-13T03:34:14.121985+0000","last_active":"2026-02-13T03:34:16.920776+0000","last_peered":"2026-02-13T03:34:16.920776+0000","last_clean":"2026-02-13T03:34:16.920776+0000","last_became_active":"2026-02-13T03:34:14.121838+0000","last_became_peered":"2026-02-13T03:34:14.121838+0000","last_unstale":"2026-02-13T03:34:16.920776+0000","last_undegraded":"2026-02-13T03:34:16.920776+0000","last_fullsized":"2026-02-13T03:34:16.920776+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:12:14.538589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909663+0000","last_change":"2026-02-13T03:34:15.117334+0000","last_active":"2026-02-13T03:34:16.909663+0000","last_peered":"2026-02-13T03:34:16.909663+0000","last_clean":"2026-02-13T03:34:16.909663+0000","last_became_active":"2026-02-13T03:34:15.117136+0000","last_became_peered":"2026-02-13T03:34:15.117136+0000","last_unstale":"2026-02-13T03:34:16.909663+0000","last_undegraded":"2026-02-13T03:34:16.909663+0000","last_fullsized":"2026-02-13T03:34:16.909663+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:09:01.863249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791138+0000","last_change":"2026-02-13T03:34:14.108168+0000","last_active":"2026-02-13T03:34:16.791138+0000","last_peered":"2026-02-13T03:34:16.791138+0000","last_clean":"2026-02-13T03:34:16.791138+0000","last_became_active":"2026-02-13T03:34:14.107598+0000","last_became_peered":"2026-02-13T03:34:14.107598+0000","last_unstale":"2026-02-13T03:34:16.791138+0000","last_undegraded":"2026-02-13T03:34:16.791138+0000","last_fullsized":"2026-02-13T03:34:16.791138+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:50:40.370428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.949003+0000","last_change":"2026-02-13T03:34:15.117553+0000","last_active":"2026-02-13T03:34:16.949003+0000","last_peered":"2026-02-13T03:34:16.949003+0000","last_clean":"2026-02-13T03:34:16.949003+0000","last_became_active":"2026-02-13T03:34:15.117298+0000","last_became_peered":"2026-02-13T03:34:15.117298+0000","last_unstale":"2026-02-13T03:34:16.949003+0000","last_undegraded":"2026-02-13T03:34:16.949003+0000","last_fullsized":"2026-02-13T03:34:16.949003+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:52:30.525618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"68'1","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909868+0000","last_change":"2026-02-13T03:34:14.110063+0000","last_active":"2026-02-13T03:34:16.909868+0000","last_peered":"2026-02-13T03:34:16.909868+0000","last_clean":"2026-02-13T03:34:16.909868+0000","last_became_active":"2026-02-13T03:34:14.109758+0000","last_became_peered":"2026-02-13T03:34:14.109758+0000","last_unstale":"2026-02-13T03:34:16.909868+0000","last_undegraded":"2026-02-13T03:34:16.909868+0000","last_fullsized":"2026-02-13T03:34:16.909868+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:51:44.239059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791368+0000","last_change":"2026-02-13T03:34:15.119669+0000","last_active":"2026-02-13T03:34:16.791368+0000","last_peered":"2026-02-13T03:34:16.791368+0000","last_clean":"2026-02-13T03:34:16.791368+0000","last_became_active":"2026-02-13T03:34:15.118420+0000","last_became_peered":"2026-02-13T03:34:15.118420+0000","last_unstale":"2026-02-13T03:34:16.791368+0000","last_undegraded":"2026-02-13T03:34:16.791368+0000","last_fullsized":"2026-02-13T03:34:16.791368+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:55:45.147665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"68'4","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.131303+0000","last_change":"2026-02-13T03:34:14.110926+0000","last_active":"2026-02-13T03:34:18.131303+0000","last_peered":"2026-02-13T03:34:18.131303+0000","last_clean":"2026-02-13T03:34:18.131303+0000","last_became_active":"2026-02-13T03:34:14.110536+0000","last_became_peered":"2026-02-13T03:34:14.110536+0000","last_unstale":"2026-02-13T03:34:18.131303+0000","last_undegraded":"2026-02-13T03:34:18.131303+0000","last_fullsized":"2026-02-13T03:34:18.131303+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:44:35.738382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.178106+0000","last_change":"2026-02-13T03:34:15.127444+0000","last_active":"2026-02-13T03:34:16.178106+0000","last_peered":"2026-02-13T03:34:16.178106+0000","last_clean":"2026-02-13T03:34:16.178106+0000","last_became_active":"2026-02-13T03:34:15.127294+0000","last_became_peered":"2026-02-13T03:34:15.127294+0000","last_unstale":"2026-02-13T03:34:16.178106+0000","last_undegraded":"2026-02-13T03:34:16.178106+0000","last_fullsized":"2026-02-13T03:34:16.178106+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:17:49.248022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110987+0000","last_change":"2026-02-13T03:34:15.117263+0000","last_active":"2026-02-13T03:34:16.110987+0000","last_peered":"2026-02-13T03:34:16.110987+0000","last_clean":"2026-02-13T03:34:16.110987+0000","last_became_active":"2026-02-13T03:34:15.116892+0000","last_became_peered":"2026-02-13T03:34:15.116892+0000","last_unstale":"2026-02-13T03:34:16.110987+0000","last_undegraded":"2026-02-13T03:34:16.110987+0000","last_fullsized":"2026-02-13T03:34:16.110987+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:06:22.105812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"67'2","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909913+0000","last_change":"2026-02-13T03:34:14.109993+0000","last_active":"2026-02-13T03:34:16.909913+0000","last_peered":"2026-02-13T03:34:16.909913+0000","last_clean":"2026-02-13T03:34:16.909913+0000","last_became_active":"2026-02-13T03:34:14.109138+0000","last_became_peered":"2026-02-13T03:34:14.109138+0000","last_unstale":"2026-02-13T03:34:16.909913+0000","last_undegraded":"2026-02-13T03:34:16.909913+0000","last_fullsized":"2026-02-13T03:34:16.909913+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:17:43.296418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.920946+0000","last_change":"2026-02-13T03:34:15.128408+0000","last_active":"2026-02-13T03:34:16.920946+0000","last_peered":"2026-02-13T03:34:16.920946+0000","last_clean":"2026-02-13T03:34:16.920946+0000","last_became_active":"2026-02-13T03:34:15.128196+0000","last_became_peered":"2026-02-13T03:34:15.128196+0000","last_unstale":"2026-02-13T03:34:16.920946+0000","last_undegraded":"2026-02-13T03:34:16.920946+0000","last_fullsized":"2026-02-13T03:34:16.920946+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:02:00.806973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"68'4","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.135705+0000","last_change":"2026-02-13T03:34:14.110147+0000","last_active":"2026-02-13T03:34:19.135705+0000","last_peered":"2026-02-13T03:34:19.135705+0000","last_clean":"2026-02-13T03:34:19.135705+0000","last_became_active":"2026-02-13T03:34:14.109661+0000","last_became_peered":"2026-02-13T03:34:14.109661+0000","last_unstale":"2026-02-13T03:34:19.135705+0000","last_undegraded":"2026-02-13T03:34:19.135705+0000","last_fullsized":"2026-02-13T03:34:19.135705+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:51:07.074657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910343+0000","last_change":"2026-02-13T03:34:15.116693+0000","last_active":"2026-02-13T03:34:16.910343+0000","last_peered":"2026-02-13T03:34:16.910343+0000","last_clean":"2026-02-13T03:34:16.910343+0000","last_became_active":"2026-02-13T03:34:15.116374+0000","last_became_peered":"2026-02-13T03:34:15.116374+0000","last_unstale":"2026-02-13T03:34:16.910343+0000","last_undegraded":"2026-02-13T03:34:16.910343+0000","last_fullsized":"2026-02-13T03:34:16.910343+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:13:05.738784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"67'1","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791416+0000","last_change":"2026-02-13T03:34:14.110655+0000","last_active":"2026-02-13T03:34:16.791416+0000","last_peered":"2026-02-13T03:34:16.791416+0000","last_clean":"2026-02-13T03:34:16.791416+0000","last_became_active":"2026-02-13T03:34:14.110497+0000","last_became_peered":"2026-02-13T03:34:14.110497+0000","last_unstale":"2026-02-13T03:34:16.791416+0000","last_undegraded":"2026-02-13T03:34:16.791416+0000","last_fullsized":"2026-02-13T03:34:16.791416+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:31:10.990787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791316+0000","last_change":"2026-02-13T03:34:15.120370+0000","last_active":"2026-02-13T03:34:16.791316+0000","last_peered":"2026-02-13T03:34:16.791316+0000","last_clean":"2026-02-13T03:34:16.791316+0000","last_became_active":"2026-02-13T03:34:15.119060+0000","last_became_peered":"2026-02-13T03:34:15.119060+0000","last_unstale":"2026-02-13T03:34:16.791316+0000","last_undegraded":"2026-02-13T03:34:16.791316+0000","last_fullsized":"2026-02-13T03:34:16.791316+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:53:52.717845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"68'9","reported_seq":26,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.136718+0000","last_change":"2026-02-13T03:34:14.109926+0000","last_active":"2026-02-13T03:34:19.136718+0000","last_peered":"2026-02-13T03:34:19.136718+0000","last_clean":"2026-02-13T03:34:19.136718+0000","last_became_active":"2026-02-13T03:34:14.109787+0000","last_became_peered":"2026-02-13T03:34:14.109787+0000","last_unstale":"2026-02-13T03:34:19.136718+0000","last_undegraded":"2026-02-13T03:34:19.136718+0000","last_fullsized":"2026-02-13T03:34:19.136718+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:32:55.723731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5630,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":120,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":16570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":98214,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":299994,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":63,"seq":270582939654,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27680,"kb_used_data":716,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":733975520,"statfs":{"total":751619276800,"available":751590932480,"internally_reserved":0,"allocated":733184,"data_stored":354254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8106,"internal_metadata":27582550},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":56,"seq":240518168583,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":947252,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":26469,"internal_metadata":27564187},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":53,"seq":227633266697,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27696,"kb_used_data":732,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":733975504,"statfs":{"total":751619276800,"available":751590916096,"internally_reserved":0,"allocated":749568,"data_stored":354490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23172,"internal_metadata":27567484},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":46,"seq":197568495626,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27696,"kb_used_data":732,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975504,"statfs":{"total":751619276800,"available":751590916096,"internally_reserved":0,"allocated":749568,"data_stored":354410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26864,"internal_metadata":27563792},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":39,"seq":167503724556,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27740,"kb_used_data":776,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975460,"statfs":{"total":751619276800,"available":751590871040,"internally_reserved":0,"allocated":794624,"data_stored":946242,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":31919,"internal_metadata":27558737},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":36,"seq":154618822669,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27680,"kb_used_data":716,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733975520,"statfs":{"total":751619276800,"available":751590932480,"internally_reserved":0,"allocated":733184,"data_stored":353740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25134,"internal_metadata":27565522},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":29,"seq":124554051599,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27752,"kb_used_data":788,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":733975448,"statfs":{"total":751619276800,"available":751590858752,"internally_reserved":0,"allocated":806912,"data_stored":945926,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":30094,"internal_metadata":27560562},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":26,"seq":111669149712,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27688,"kb_used_data":724,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975512,"statfs":{"total":751619276800,"available":751590924288,"internally_reserved":0,"allocated":741376,"data_stored":354294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36754,"internal_metadata":27553902},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":19,"seq":81604378642,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27684,"kb_used_data":720,"kb_used_omap":39,"kb_used_meta":26904,"kb_avail":733975516,"statfs":{"total":751619276800,"available":751590928384,"internally_reserved":0,"allocated":737280,"data_stored":353754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40523,"internal_metadata":27550133},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27712,"kb_used_data":748,"kb_used_omap":54,"kb_used_meta":26889,"kb_avail":733975488,"statfs":{"total":751619276800,"available":751590899712,"internally_reserved":0,"allocated":765952,"data_stored":356656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55339,"internal_metadata":27535317},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672980,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27688,"kb_used_data":724,"kb_used_omap":37,"kb_used_meta":26906,"kb_avail":733975512,"statfs":{"total":751619276800,"available":751590924288,"internally_reserved":0,"allocated":741376,"data_stored":355284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38103,"internal_metadata":27552553},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771095,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27704,"kb_used_data":740,"kb_used_omap":42,"kb_used_meta":26901,"kb_avail":733975496,"statfs":{"total":751619276800,"available":751590907904,"internally_reserved":0,"allocated":757760,"data_stored":355172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43396,"internal_metadata":27547260},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36468,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36468,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36468,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1713,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":705,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24053,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7890,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6345,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1018,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":916,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5514,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14749,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10045,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23394,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1872,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T03:34:23.321 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T03:34:23.471 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:23.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:23 trial132 ceph-mon[26888]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:34:23.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:23 trial132 ceph-mon[26888]: mgrmap e12: x(active, since 2m), standbys: z, y 2026-02-13T03:34:23.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:23 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/869300649' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:34:23.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:23 trial132 ceph-mon[26888]: pgmap v187: 97 pgs: 97 active+clean; 582 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s rd, 5.0 KiB/s wr, 17 op/s 2026-02-13T03:34:23.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:23 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/4166861408' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:34:23.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:23 trial133 ceph-mon[26943]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:34:23.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:23 trial133 ceph-mon[26943]: mgrmap e12: x(active, since 2m), standbys: z, y 2026-02-13T03:34:23.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:23 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/869300649' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:34:23.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:23 trial133 ceph-mon[26943]: pgmap v187: 97 pgs: 97 active+clean; 582 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s rd, 5.0 KiB/s wr, 17 op/s 2026-02-13T03:34:23.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:23 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/4166861408' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:34:23.592 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.586+0000 7f6a077f36c0 1 -- 10.20.193.96:0/4166469054 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6a00159a50 msgr2=0x7f6a00179eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:23.592 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.586+0000 7f6a077f36c0 1 --2- 10.20.193.96:0/4166469054 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6a00159a50 0x7f6a00179eb0 secure :-1 s=READY pgs=251 gs=1 cs=0 l=1 c_cookie=969679945111504139 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69fc00aa40 tx=0x7f69fc02fde0 comp rx=0 tx=0).stop 2026-02-13T03:34:23.592 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.586+0000 7f6a077f36c0 1 -- 10.20.193.96:0/4166469054 shutdown_connections 2026-02-13T03:34:23.592 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.586+0000 7f6a077f36c0 1 --2- 10.20.193.96:0/4166469054 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6a00159a50 0x7f6a00179eb0 unknown :-1 s=CLOSED pgs=251 gs=1 cs=0 l=1 c_cookie=969679945111504139 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:23.592 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.586+0000 7f6a077f36c0 1 --2- 10.20.193.96:0/4166469054 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6a00062fd0 0x7f6a00063400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:23.592 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.586+0000 7f6a077f36c0 1 --2- 10.20.193.96:0/4166469054 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6a000669a0 0x7f6a000629b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:23.592 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.586+0000 7f6a077f36c0 1 -- 10.20.193.96:0/4166469054 >> 10.20.193.96:0/4166469054 conn(0x7f6a000ecb00 msgr2=0x7f6a0010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:23.593 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.586+0000 7f6a077f36c0 1 -- 10.20.193.96:0/4166469054 shutdown_connections 2026-02-13T03:34:23.593 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.586+0000 7f6a077f36c0 1 -- 10.20.193.96:0/4166469054 wait complete. 2026-02-13T03:34:23.593 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.587+0000 7f6a077f36c0 1 Processor -- start 2026-02-13T03:34:23.593 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.587+0000 7f6a077f36c0 1 -- start start 2026-02-13T03:34:23.593 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.587+0000 7f6a077f36c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6a00062fd0 0x7f6a00163240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:23.593 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.587+0000 7f6a077f36c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6a00159a50 0x7f6a00163780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:23.593 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.587+0000 7f6a077f36c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6a00168af0 0x7f6a00168f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:23.593 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.587+0000 7f6a077f36c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f6a00169500 con 0x7f6a00159a50 2026-02-13T03:34:23.593 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.587+0000 7f6a077f36c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6a00169670 con 0x7f6a00168af0 2026-02-13T03:34:23.593 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.587+0000 7f6a077f36c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6a00169830 con 0x7f6a00062fd0 2026-02-13T03:34:23.594 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.587+0000 7f6a04d636c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6a00159a50 0x7f6a00163780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:23.594 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.587+0000 7f6a04d636c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6a00159a50 0x7f6a00163780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:48816/0 (socket says 10.20.193.96:48816) 2026-02-13T03:34:23.594 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.587+0000 7f6a04d636c0 1 -- 10.20.193.96:0/4119867314 learned_addr learned my addr 10.20.193.96:0/4119867314 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:23.594 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.587+0000 7f6a055646c0 1 --2- 10.20.193.96:0/4119867314 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6a00062fd0 0x7f6a00163240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:23.594 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.587+0000 7f6a04d636c0 1 -- 10.20.193.96:0/4119867314 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6a00062fd0 msgr2=0x7f6a00163240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:23.594 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.587+0000 7f6a04d636c0 1 --2- 10.20.193.96:0/4119867314 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6a00062fd0 0x7f6a00163240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:23.594 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.587+0000 7f6a05d656c0 1 --2- 10.20.193.96:0/4119867314 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6a00168af0 0x7f6a00168f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:23.594 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.587+0000 7f6a04d636c0 1 -- 10.20.193.96:0/4119867314 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6a00168af0 msgr2=0x7f6a00168f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:23.594 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.587+0000 7f6a04d636c0 1 --2- 10.20.193.96:0/4119867314 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6a00168af0 0x7f6a00168f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:23.594 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.587+0000 7f6a04d636c0 1 -- 10.20.193.96:0/4119867314 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69fc00a660 con 0x7f6a00159a50 2026-02-13T03:34:23.594 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.587+0000 7f6a05d656c0 1 --2- 10.20.193.96:0/4119867314 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6a00168af0 0x7f6a00168f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:34:23.595 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.587+0000 7f6a04d636c0 1 --2- 10.20.193.96:0/4119867314 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6a00159a50 0x7f6a00163780 secure :-1 s=READY pgs=252 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69f4005dc0 tx=0x7f69f400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:23.595 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.587+0000 7f69ee7fc6c0 1 -- 10.20.193.96:0/4119867314 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f69f4004250 con 0x7f6a00159a50 2026-02-13T03:34:23.595 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.587+0000 7f69ee7fc6c0 1 -- 10.20.193.96:0/4119867314 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f69f4009070 con 0x7f6a00159a50 2026-02-13T03:34:23.595 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.587+0000 7f6a077f36c0 1 -- 10.20.193.96:0/4119867314 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a00157910 con 0x7f6a00159a50 2026-02-13T03:34:23.595 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.587+0000 7f69ee7fc6c0 1 -- 10.20.193.96:0/4119867314 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f69f400cdb0 con 0x7f6a00159a50 2026-02-13T03:34:23.595 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.588+0000 7f6a077f36c0 1 -- 10.20.193.96:0/4119867314 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a00157df0 con 0x7f6a00159a50 2026-02-13T03:34:23.595 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.588+0000 7f6a077f36c0 1 -- 10.20.193.96:0/4119867314 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a00063ec0 con 0x7f6a00159a50 2026-02-13T03:34:23.596 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.589+0000 7f69ee7fc6c0 1 -- 10.20.193.96:0/4119867314 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f69f40028c0 con 0x7f6a00159a50 2026-02-13T03:34:23.596 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.590+0000 7f69ee7fc6c0 1 --2- 10.20.193.96:0/4119867314 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f69dc0b5710 0x7f69dc0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:23.596 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.590+0000 7f6a055646c0 1 --2- 10.20.193.96:0/4119867314 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f69dc0b5710 0x7f69dc0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:23.597 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.590+0000 7f69ee7fc6c0 1 -- 10.20.193.96:0/4119867314 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f69f40e3a80 con 0x7f6a00159a50 2026-02-13T03:34:23.597 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.590+0000 7f6a055646c0 1 --2- 10.20.193.96:0/4119867314 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f69dc0b5710 0x7f69dc0d5bc0 secure :-1 s=READY pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69f0006b60 tx=0x7f69f0006af0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:23.597 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.590+0000 7f69ee7fc6c0 1 -- 10.20.193.96:0/4119867314 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f69f40a64e0 con 0x7f6a00159a50 2026-02-13T03:34:23.684 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.681+0000 7f6a077f36c0 1 -- 10.20.193.96:0/4119867314 --> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6a001643a0 con 0x7f69dc0b5710 2026-02-13T03:34:23.686 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.683+0000 7f69ee7fc6c0 1 -- 10.20.193.96:0/4119867314 <== mgr.14116 v2:10.20.193.96:6800/1736050816 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258925 (secure 0 0 0) 0x7f6a001643a0 con 0x7f69dc0b5710 2026-02-13T03:34:23.690 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:23.691 INFO:teuthology.orchestra.run.trial096.stderr:dumped all 2026-02-13T03:34:23.693 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.685+0000 7f6a077f36c0 1 -- 10.20.193.96:0/4119867314 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f69dc0b5710 msgr2=0x7f69dc0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:23.693 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.685+0000 7f6a077f36c0 1 --2- 10.20.193.96:0/4119867314 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f69dc0b5710 0x7f69dc0d5bc0 secure :-1 s=READY pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69f0006b60 tx=0x7f69f0006af0 comp rx=0 tx=0).stop 2026-02-13T03:34:23.693 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.685+0000 7f6a077f36c0 1 -- 10.20.193.96:0/4119867314 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6a00159a50 msgr2=0x7f6a00163780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:23.693 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.685+0000 7f6a077f36c0 1 --2- 10.20.193.96:0/4119867314 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6a00159a50 0x7f6a00163780 secure :-1 s=READY pgs=252 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69f4005dc0 tx=0x7f69f400bbb0 comp rx=0 tx=0).stop 2026-02-13T03:34:23.693 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.685+0000 7f6a077f36c0 1 -- 10.20.193.96:0/4119867314 shutdown_connections 2026-02-13T03:34:23.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.685+0000 7f6a077f36c0 1 --2- 10.20.193.96:0/4119867314 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f69dc0b5710 0x7f69dc0d5bc0 unknown :-1 s=CLOSED pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:23.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.685+0000 7f6a077f36c0 1 --2- 10.20.193.96:0/4119867314 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f6a00168af0 0x7f6a00168f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:23.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.685+0000 7f6a077f36c0 1 --2- 10.20.193.96:0/4119867314 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f6a00159a50 0x7f6a00163780 unknown :-1 s=CLOSED pgs=252 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:23.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.685+0000 7f6a077f36c0 1 --2- 10.20.193.96:0/4119867314 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f6a00062fd0 0x7f6a00163240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:23.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.685+0000 7f6a077f36c0 1 -- 10.20.193.96:0/4119867314 >> 10.20.193.96:0/4119867314 conn(0x7f6a000ecb00 msgr2=0x7f6a0010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:23.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.685+0000 7f6a077f36c0 1 -- 10.20.193.96:0/4119867314 shutdown_connections 2026-02-13T03:34:23.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:23.685+0000 7f6a077f36c0 1 -- 10.20.193.96:0/4119867314 wait complete. 2026-02-13T03:34:23.729 INFO:teuthology.orchestra.run.trial096.stdout:{"pg_ready":true,"pg_map":{"version":187,"stamp":"2026-02-13T03:34:22.578691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596115,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":123,"num_read_kb":105,"num_write":310,"num_write_kb":3756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":257,"ondisk_log_size":257,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":279,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":332488,"kb_used_data":8920,"kb_used_omap":376,"kb_used_meta":322951,"kb_avail":8807705912,"statfs":{"total":9019431321600,"available":9019090853888,"internally_reserved":0,"allocated":9134080,"data_stored":6031474,"data_compressed":114354,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":385873,"internal_metadata":330701999},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5747,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":121,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001529"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.949202+0000","last_change":"2026-02-13T03:34:15.119248+0000","last_active":"2026-02-13T03:34:16.949202+0000","last_peered":"2026-02-13T03:34:16.949202+0000","last_clean":"2026-02-13T03:34:16.949202+0000","last_became_active":"2026-02-13T03:34:15.118886+0000","last_became_peered":"2026-02-13T03:34:15.118886+0000","last_unstale":"2026-02-13T03:34:16.949202+0000","last_undegraded":"2026-02-13T03:34:16.949202+0000","last_fullsized":"2026-02-13T03:34:16.949202+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:56:49.614786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910225+0000","last_change":"2026-02-13T03:34:15.118140+0000","last_active":"2026-02-13T03:34:16.910225+0000","last_peered":"2026-02-13T03:34:16.910225+0000","last_clean":"2026-02-13T03:34:16.910225+0000","last_became_active":"2026-02-13T03:34:15.117796+0000","last_became_peered":"2026-02-13T03:34:15.117796+0000","last_unstale":"2026-02-13T03:34:16.910225+0000","last_undegraded":"2026-02-13T03:34:16.910225+0000","last_fullsized":"2026-02-13T03:34:16.910225+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:08:34.780460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910178+0000","last_change":"2026-02-13T03:34:15.116927+0000","last_active":"2026-02-13T03:34:16.910178+0000","last_peered":"2026-02-13T03:34:16.910178+0000","last_clean":"2026-02-13T03:34:16.910178+0000","last_became_active":"2026-02-13T03:34:15.116646+0000","last_became_peered":"2026-02-13T03:34:15.116646+0000","last_unstale":"2026-02-13T03:34:16.910178+0000","last_undegraded":"2026-02-13T03:34:16.910178+0000","last_fullsized":"2026-02-13T03:34:16.910178+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:24:45.374886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.122075+0000","last_change":"2026-02-13T03:34:15.127414+0000","last_active":"2026-02-13T03:34:16.122075+0000","last_peered":"2026-02-13T03:34:16.122075+0000","last_clean":"2026-02-13T03:34:16.122075+0000","last_became_active":"2026-02-13T03:34:15.127284+0000","last_became_peered":"2026-02-13T03:34:15.127284+0000","last_unstale":"2026-02-13T03:34:16.122075+0000","last_undegraded":"2026-02-13T03:34:16.122075+0000","last_fullsized":"2026-02-13T03:34:16.122075+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:10:58.233447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909667+0000","last_change":"2026-02-13T03:34:15.117815+0000","last_active":"2026-02-13T03:34:16.909667+0000","last_peered":"2026-02-13T03:34:16.909667+0000","last_clean":"2026-02-13T03:34:16.909667+0000","last_became_active":"2026-02-13T03:34:15.117642+0000","last_became_peered":"2026-02-13T03:34:15.117642+0000","last_unstale":"2026-02-13T03:34:16.909667+0000","last_undegraded":"2026-02-13T03:34:16.909667+0000","last_fullsized":"2026-02-13T03:34:16.909667+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:06:59.379987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.912593+0000","last_change":"2026-02-13T03:34:15.127838+0000","last_active":"2026-02-13T03:34:16.912593+0000","last_peered":"2026-02-13T03:34:16.912593+0000","last_clean":"2026-02-13T03:34:16.912593+0000","last_became_active":"2026-02-13T03:34:15.127492+0000","last_became_peered":"2026-02-13T03:34:15.127492+0000","last_unstale":"2026-02-13T03:34:16.912593+0000","last_undegraded":"2026-02-13T03:34:16.912593+0000","last_fullsized":"2026-02-13T03:34:16.912593+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:10:44.948452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.177724+0000","last_change":"2026-02-13T03:34:15.128751+0000","last_active":"2026-02-13T03:34:16.177724+0000","last_peered":"2026-02-13T03:34:16.177724+0000","last_clean":"2026-02-13T03:34:16.177724+0000","last_became_active":"2026-02-13T03:34:15.128588+0000","last_became_peered":"2026-02-13T03:34:15.128588+0000","last_unstale":"2026-02-13T03:34:16.177724+0000","last_undegraded":"2026-02-13T03:34:16.177724+0000","last_fullsized":"2026-02-13T03:34:16.177724+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:46:50.929612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.790967+0000","last_change":"2026-02-13T03:34:15.119765+0000","last_active":"2026-02-13T03:34:16.790967+0000","last_peered":"2026-02-13T03:34:16.790967+0000","last_clean":"2026-02-13T03:34:16.790967+0000","last_became_active":"2026-02-13T03:34:15.118656+0000","last_became_peered":"2026-02-13T03:34:15.118656+0000","last_unstale":"2026-02-13T03:34:16.790967+0000","last_undegraded":"2026-02-13T03:34:16.790967+0000","last_fullsized":"2026-02-13T03:34:16.790967+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:32:01.369279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.921188+0000","last_change":"2026-02-13T03:34:15.129750+0000","last_active":"2026-02-13T03:34:16.921188+0000","last_peered":"2026-02-13T03:34:16.921188+0000","last_clean":"2026-02-13T03:34:16.921188+0000","last_became_active":"2026-02-13T03:34:15.129277+0000","last_became_peered":"2026-02-13T03:34:15.129277+0000","last_unstale":"2026-02-13T03:34:16.921188+0000","last_undegraded":"2026-02-13T03:34:16.921188+0000","last_fullsized":"2026-02-13T03:34:16.921188+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:54:36.873732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.912899+0000","last_change":"2026-02-13T03:34:15.127742+0000","last_active":"2026-02-13T03:34:16.912899+0000","last_peered":"2026-02-13T03:34:16.912899+0000","last_clean":"2026-02-13T03:34:16.912899+0000","last_became_active":"2026-02-13T03:34:15.127189+0000","last_became_peered":"2026-02-13T03:34:15.127189+0000","last_unstale":"2026-02-13T03:34:16.912899+0000","last_undegraded":"2026-02-13T03:34:16.912899+0000","last_fullsized":"2026-02-13T03:34:16.912899+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:55:52.004058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.178276+0000","last_change":"2026-02-13T03:34:15.127809+0000","last_active":"2026-02-13T03:34:16.178276+0000","last_peered":"2026-02-13T03:34:16.178276+0000","last_clean":"2026-02-13T03:34:16.178276+0000","last_became_active":"2026-02-13T03:34:15.127680+0000","last_became_peered":"2026-02-13T03:34:15.127680+0000","last_unstale":"2026-02-13T03:34:16.178276+0000","last_undegraded":"2026-02-13T03:34:16.178276+0000","last_fullsized":"2026-02-13T03:34:16.178276+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:22:18.420199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.122122+0000","last_change":"2026-02-13T03:34:15.127680+0000","last_active":"2026-02-13T03:34:16.122122+0000","last_peered":"2026-02-13T03:34:16.122122+0000","last_clean":"2026-02-13T03:34:16.122122+0000","last_became_active":"2026-02-13T03:34:15.127508+0000","last_became_peered":"2026-02-13T03:34:15.127508+0000","last_unstale":"2026-02-13T03:34:16.122122+0000","last_undegraded":"2026-02-13T03:34:16.122122+0000","last_fullsized":"2026-02-13T03:34:16.122122+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:22:12.516766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111152+0000","last_change":"2026-02-13T03:34:15.117625+0000","last_active":"2026-02-13T03:34:16.111152+0000","last_peered":"2026-02-13T03:34:16.111152+0000","last_clean":"2026-02-13T03:34:16.111152+0000","last_became_active":"2026-02-13T03:34:15.117420+0000","last_became_peered":"2026-02-13T03:34:15.117420+0000","last_unstale":"2026-02-13T03:34:16.111152+0000","last_undegraded":"2026-02-13T03:34:16.111152+0000","last_fullsized":"2026-02-13T03:34:16.111152+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:53:17.688410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910011+0000","last_change":"2026-02-13T03:34:15.117960+0000","last_active":"2026-02-13T03:34:16.910011+0000","last_peered":"2026-02-13T03:34:16.910011+0000","last_clean":"2026-02-13T03:34:16.910011+0000","last_became_active":"2026-02-13T03:34:15.117819+0000","last_became_peered":"2026-02-13T03:34:15.117819+0000","last_unstale":"2026-02-13T03:34:16.910011+0000","last_undegraded":"2026-02-13T03:34:16.910011+0000","last_fullsized":"2026-02-13T03:34:16.910011+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:53:45.980536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909998+0000","last_change":"2026-02-13T03:34:15.113255+0000","last_active":"2026-02-13T03:34:16.909998+0000","last_peered":"2026-02-13T03:34:16.909998+0000","last_clean":"2026-02-13T03:34:16.909998+0000","last_became_active":"2026-02-13T03:34:15.112672+0000","last_became_peered":"2026-02-13T03:34:15.112672+0000","last_unstale":"2026-02-13T03:34:16.909998+0000","last_undegraded":"2026-02-13T03:34:16.909998+0000","last_fullsized":"2026-02-13T03:34:16.909998+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:28:34.724819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.920815+0000","last_change":"2026-02-13T03:34:15.127054+0000","last_active":"2026-02-13T03:34:16.920815+0000","last_peered":"2026-02-13T03:34:16.920815+0000","last_clean":"2026-02-13T03:34:16.920815+0000","last_became_active":"2026-02-13T03:34:15.126826+0000","last_became_peered":"2026-02-13T03:34:15.126826+0000","last_unstale":"2026-02-13T03:34:16.920815+0000","last_undegraded":"2026-02-13T03:34:16.920815+0000","last_fullsized":"2026-02-13T03:34:16.920815+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:07:27.160289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.949262+0000","last_change":"2026-02-13T03:34:15.119834+0000","last_active":"2026-02-13T03:34:16.949262+0000","last_peered":"2026-02-13T03:34:16.949262+0000","last_clean":"2026-02-13T03:34:16.949262+0000","last_became_active":"2026-02-13T03:34:15.119509+0000","last_became_peered":"2026-02-13T03:34:15.119509+0000","last_unstale":"2026-02-13T03:34:16.949262+0000","last_undegraded":"2026-02-13T03:34:16.949262+0000","last_fullsized":"2026-02-13T03:34:16.949262+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:42:38.192170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111254+0000","last_change":"2026-02-13T03:34:15.118027+0000","last_active":"2026-02-13T03:34:16.111254+0000","last_peered":"2026-02-13T03:34:16.111254+0000","last_clean":"2026-02-13T03:34:16.111254+0000","last_became_active":"2026-02-13T03:34:15.117809+0000","last_became_peered":"2026-02-13T03:34:15.117809+0000","last_unstale":"2026-02-13T03:34:16.111254+0000","last_undegraded":"2026-02-13T03:34:16.111254+0000","last_fullsized":"2026-02-13T03:34:16.111254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:45:41.985508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910174+0000","last_change":"2026-02-13T03:34:15.117192+0000","last_active":"2026-02-13T03:34:16.910174+0000","last_peered":"2026-02-13T03:34:16.910174+0000","last_clean":"2026-02-13T03:34:16.910174+0000","last_became_active":"2026-02-13T03:34:15.116925+0000","last_became_peered":"2026-02-13T03:34:15.116925+0000","last_unstale":"2026-02-13T03:34:16.910174+0000","last_undegraded":"2026-02-13T03:34:16.910174+0000","last_fullsized":"2026-02-13T03:34:16.910174+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:02:01.642379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.948882+0000","last_change":"2026-02-13T03:34:15.118668+0000","last_active":"2026-02-13T03:34:16.948882+0000","last_peered":"2026-02-13T03:34:16.948882+0000","last_clean":"2026-02-13T03:34:16.948882+0000","last_became_active":"2026-02-13T03:34:15.118217+0000","last_became_peered":"2026-02-13T03:34:15.118217+0000","last_unstale":"2026-02-13T03:34:16.948882+0000","last_undegraded":"2026-02-13T03:34:16.948882+0000","last_fullsized":"2026-02-13T03:34:16.948882+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:19:35.001241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111259+0000","last_change":"2026-02-13T03:34:15.116906+0000","last_active":"2026-02-13T03:34:16.111259+0000","last_peered":"2026-02-13T03:34:16.111259+0000","last_clean":"2026-02-13T03:34:16.111259+0000","last_became_active":"2026-02-13T03:34:15.116699+0000","last_became_peered":"2026-02-13T03:34:15.116699+0000","last_unstale":"2026-02-13T03:34:16.111259+0000","last_undegraded":"2026-02-13T03:34:16.111259+0000","last_fullsized":"2026-02-13T03:34:16.111259+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:47:23.331768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.920953+0000","last_change":"2026-02-13T03:34:15.127773+0000","last_active":"2026-02-13T03:34:16.920953+0000","last_peered":"2026-02-13T03:34:16.920953+0000","last_clean":"2026-02-13T03:34:16.920953+0000","last_became_active":"2026-02-13T03:34:15.127473+0000","last_became_peered":"2026-02-13T03:34:15.127473+0000","last_unstale":"2026-02-13T03:34:16.920953+0000","last_undegraded":"2026-02-13T03:34:16.920953+0000","last_fullsized":"2026-02-13T03:34:16.920953+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:27:08.244945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.790949+0000","last_change":"2026-02-13T03:34:15.118782+0000","last_active":"2026-02-13T03:34:16.790949+0000","last_peered":"2026-02-13T03:34:16.790949+0000","last_clean":"2026-02-13T03:34:16.790949+0000","last_became_active":"2026-02-13T03:34:15.117896+0000","last_became_peered":"2026-02-13T03:34:15.117896+0000","last_unstale":"2026-02-13T03:34:16.790949+0000","last_undegraded":"2026-02-13T03:34:16.790949+0000","last_fullsized":"2026-02-13T03:34:16.790949+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:21:00.365223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110942+0000","last_change":"2026-02-13T03:34:15.117507+0000","last_active":"2026-02-13T03:34:16.110942+0000","last_peered":"2026-02-13T03:34:16.110942+0000","last_clean":"2026-02-13T03:34:16.110942+0000","last_became_active":"2026-02-13T03:34:15.117084+0000","last_became_peered":"2026-02-13T03:34:15.117084+0000","last_unstale":"2026-02-13T03:34:16.110942+0000","last_undegraded":"2026-02-13T03:34:16.110942+0000","last_fullsized":"2026-02-13T03:34:16.110942+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:08:11.739974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791306+0000","last_change":"2026-02-13T03:34:15.120007+0000","last_active":"2026-02-13T03:34:16.791306+0000","last_peered":"2026-02-13T03:34:16.791306+0000","last_clean":"2026-02-13T03:34:16.791306+0000","last_became_active":"2026-02-13T03:34:15.119271+0000","last_became_peered":"2026-02-13T03:34:15.119271+0000","last_unstale":"2026-02-13T03:34:16.791306+0000","last_undegraded":"2026-02-13T03:34:16.791306+0000","last_fullsized":"2026-02-13T03:34:16.791306+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:40:54.160572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910319+0000","last_change":"2026-02-13T03:34:15.115991+0000","last_active":"2026-02-13T03:34:16.910319+0000","last_peered":"2026-02-13T03:34:16.910319+0000","last_clean":"2026-02-13T03:34:16.910319+0000","last_became_active":"2026-02-13T03:34:15.115795+0000","last_became_peered":"2026-02-13T03:34:15.115795+0000","last_unstale":"2026-02-13T03:34:16.910319+0000","last_undegraded":"2026-02-13T03:34:16.910319+0000","last_fullsized":"2026-02-13T03:34:16.910319+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:08:10.245339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.949096+0000","last_change":"2026-02-13T03:34:15.117921+0000","last_active":"2026-02-13T03:34:16.949096+0000","last_peered":"2026-02-13T03:34:16.949096+0000","last_clean":"2026-02-13T03:34:16.949096+0000","last_became_active":"2026-02-13T03:34:15.117628+0000","last_became_peered":"2026-02-13T03:34:15.117628+0000","last_unstale":"2026-02-13T03:34:16.949096+0000","last_undegraded":"2026-02-13T03:34:16.949096+0000","last_fullsized":"2026-02-13T03:34:16.949096+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:48:11.389400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111141+0000","last_change":"2026-02-13T03:34:15.115046+0000","last_active":"2026-02-13T03:34:16.111141+0000","last_peered":"2026-02-13T03:34:16.111141+0000","last_clean":"2026-02-13T03:34:16.111141+0000","last_became_active":"2026-02-13T03:34:15.114250+0000","last_became_peered":"2026-02-13T03:34:15.114250+0000","last_unstale":"2026-02-13T03:34:16.111141+0000","last_undegraded":"2026-02-13T03:34:16.111141+0000","last_fullsized":"2026-02-13T03:34:16.111141+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:58:56.156972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910188+0000","last_change":"2026-02-13T03:34:15.114493+0000","last_active":"2026-02-13T03:34:16.910188+0000","last_peered":"2026-02-13T03:34:16.910188+0000","last_clean":"2026-02-13T03:34:16.910188+0000","last_became_active":"2026-02-13T03:34:15.114096+0000","last_became_peered":"2026-02-13T03:34:15.114096+0000","last_unstale":"2026-02-13T03:34:16.910188+0000","last_undegraded":"2026-02-13T03:34:16.910188+0000","last_fullsized":"2026-02-13T03:34:16.910188+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:26:07.768976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909836+0000","last_change":"2026-02-13T03:34:15.116564+0000","last_active":"2026-02-13T03:34:16.909836+0000","last_peered":"2026-02-13T03:34:16.909836+0000","last_clean":"2026-02-13T03:34:16.909836+0000","last_became_active":"2026-02-13T03:34:15.116345+0000","last_became_peered":"2026-02-13T03:34:15.116345+0000","last_unstale":"2026-02-13T03:34:16.909836+0000","last_undegraded":"2026-02-13T03:34:16.909836+0000","last_fullsized":"2026-02-13T03:34:16.909836+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:52:47.350389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909938+0000","last_change":"2026-02-13T03:34:15.117449+0000","last_active":"2026-02-13T03:34:16.909938+0000","last_peered":"2026-02-13T03:34:16.909938+0000","last_clean":"2026-02-13T03:34:16.909938+0000","last_became_active":"2026-02-13T03:34:15.117220+0000","last_became_peered":"2026-02-13T03:34:15.117220+0000","last_unstale":"2026-02-13T03:34:16.909938+0000","last_undegraded":"2026-02-13T03:34:16.909938+0000","last_fullsized":"2026-02-13T03:34:16.909938+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:38:43.911384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.948915+0000","last_change":"2026-02-13T03:34:15.118184+0000","last_active":"2026-02-13T03:34:16.948915+0000","last_peered":"2026-02-13T03:34:16.948915+0000","last_clean":"2026-02-13T03:34:16.948915+0000","last_became_active":"2026-02-13T03:34:15.117890+0000","last_became_peered":"2026-02-13T03:34:15.117890+0000","last_unstale":"2026-02-13T03:34:16.948915+0000","last_undegraded":"2026-02-13T03:34:16.948915+0000","last_fullsized":"2026-02-13T03:34:16.948915+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:22:03.620680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909815+0000","last_change":"2026-02-13T03:34:15.116404+0000","last_active":"2026-02-13T03:34:16.909815+0000","last_peered":"2026-02-13T03:34:16.909815+0000","last_clean":"2026-02-13T03:34:16.909815+0000","last_became_active":"2026-02-13T03:34:15.116094+0000","last_became_peered":"2026-02-13T03:34:15.116094+0000","last_unstale":"2026-02-13T03:34:16.909815+0000","last_undegraded":"2026-02-13T03:34:16.909815+0000","last_fullsized":"2026-02-13T03:34:16.909815+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:58:39.719264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"68'6","reported_seq":27,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:21.139555+0000","last_change":"2026-02-13T03:34:14.110943+0000","last_active":"2026-02-13T03:34:21.139555+0000","last_peered":"2026-02-13T03:34:21.139555+0000","last_clean":"2026-02-13T03:34:21.139555+0000","last_became_active":"2026-02-13T03:34:14.110502+0000","last_became_peered":"2026-02-13T03:34:14.110502+0000","last_unstale":"2026-02-13T03:34:21.139555+0000","last_undegraded":"2026-02-13T03:34:21.139555+0000","last_fullsized":"2026-02-13T03:34:21.139555+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:59:08.057823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110955+0000","last_change":"2026-02-13T03:34:15.118165+0000","last_active":"2026-02-13T03:34:16.110955+0000","last_peered":"2026-02-13T03:34:16.110955+0000","last_clean":"2026-02-13T03:34:16.110955+0000","last_became_active":"2026-02-13T03:34:15.117801+0000","last_became_peered":"2026-02-13T03:34:15.117801+0000","last_unstale":"2026-02-13T03:34:16.110955+0000","last_undegraded":"2026-02-13T03:34:16.110955+0000","last_fullsized":"2026-02-13T03:34:16.110955+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:01:06.764674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"68'3","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.147034+0000","last_change":"2026-02-13T03:34:14.119861+0000","last_active":"2026-02-13T03:34:19.147034+0000","last_peered":"2026-02-13T03:34:19.147034+0000","last_clean":"2026-02-13T03:34:19.147034+0000","last_became_active":"2026-02-13T03:34:14.119689+0000","last_became_peered":"2026-02-13T03:34:14.119689+0000","last_unstale":"2026-02-13T03:34:19.147034+0000","last_undegraded":"2026-02-13T03:34:19.147034+0000","last_fullsized":"2026-02-13T03:34:19.147034+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:43:33.601163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"68'2","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.136796+0000","last_change":"2026-02-13T03:34:14.107989+0000","last_active":"2026-02-13T03:34:19.136796+0000","last_peered":"2026-02-13T03:34:19.136796+0000","last_clean":"2026-02-13T03:34:19.136796+0000","last_became_active":"2026-02-13T03:34:14.107837+0000","last_became_peered":"2026-02-13T03:34:14.107837+0000","last_unstale":"2026-02-13T03:34:19.136796+0000","last_undegraded":"2026-02-13T03:34:19.136796+0000","last_fullsized":"2026-02-13T03:34:19.136796+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:20:23.452500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791223+0000","last_change":"2026-02-13T03:34:15.118354+0000","last_active":"2026-02-13T03:34:16.791223+0000","last_peered":"2026-02-13T03:34:16.791223+0000","last_clean":"2026-02-13T03:34:16.791223+0000","last_became_active":"2026-02-13T03:34:15.117486+0000","last_became_peered":"2026-02-13T03:34:15.117486+0000","last_unstale":"2026-02-13T03:34:16.791223+0000","last_undegraded":"2026-02-13T03:34:16.791223+0000","last_fullsized":"2026-02-13T03:34:16.791223+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:19:01.304754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"68'1","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.962330+0000","last_change":"2026-02-13T03:34:14.111386+0000","last_active":"2026-02-13T03:34:16.962330+0000","last_peered":"2026-02-13T03:34:16.962330+0000","last_clean":"2026-02-13T03:34:16.962330+0000","last_became_active":"2026-02-13T03:34:14.110945+0000","last_became_peered":"2026-02-13T03:34:14.110945+0000","last_unstale":"2026-02-13T03:34:16.962330+0000","last_undegraded":"2026-02-13T03:34:16.962330+0000","last_fullsized":"2026-02-13T03:34:16.962330+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:44:31.307711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111198+0000","last_change":"2026-02-13T03:34:15.117944+0000","last_active":"2026-02-13T03:34:16.111198+0000","last_peered":"2026-02-13T03:34:16.111198+0000","last_clean":"2026-02-13T03:34:16.111198+0000","last_became_active":"2026-02-13T03:34:15.117759+0000","last_became_peered":"2026-02-13T03:34:15.117759+0000","last_unstale":"2026-02-13T03:34:16.111198+0000","last_undegraded":"2026-02-13T03:34:16.111198+0000","last_fullsized":"2026-02-13T03:34:16.111198+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:31:00.846376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"68'3","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.142496+0000","last_change":"2026-02-13T03:34:14.122123+0000","last_active":"2026-02-13T03:34:18.142496+0000","last_peered":"2026-02-13T03:34:18.142496+0000","last_clean":"2026-02-13T03:34:18.142496+0000","last_became_active":"2026-02-13T03:34:14.122016+0000","last_became_peered":"2026-02-13T03:34:14.122016+0000","last_unstale":"2026-02-13T03:34:18.142496+0000","last_undegraded":"2026-02-13T03:34:18.142496+0000","last_fullsized":"2026-02-13T03:34:18.142496+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:38:07.386544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.921138+0000","last_change":"2026-02-13T03:34:15.129944+0000","last_active":"2026-02-13T03:34:16.921138+0000","last_peered":"2026-02-13T03:34:16.921138+0000","last_clean":"2026-02-13T03:34:16.921138+0000","last_became_active":"2026-02-13T03:34:15.129500+0000","last_became_peered":"2026-02-13T03:34:15.129500+0000","last_unstale":"2026-02-13T03:34:16.921138+0000","last_undegraded":"2026-02-13T03:34:16.921138+0000","last_fullsized":"2026-02-13T03:34:16.921138+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:04:46.496972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"68'2","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.142125+0000","last_change":"2026-02-13T03:34:14.120290+0000","last_active":"2026-02-13T03:34:18.142125+0000","last_peered":"2026-02-13T03:34:18.142125+0000","last_clean":"2026-02-13T03:34:18.142125+0000","last_became_active":"2026-02-13T03:34:14.120111+0000","last_became_peered":"2026-02-13T03:34:14.120111+0000","last_unstale":"2026-02-13T03:34:18.142125+0000","last_undegraded":"2026-02-13T03:34:18.142125+0000","last_fullsized":"2026-02-13T03:34:18.142125+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:02:12.116257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910374+0000","last_change":"2026-02-13T03:34:15.118561+0000","last_active":"2026-02-13T03:34:16.910374+0000","last_peered":"2026-02-13T03:34:16.910374+0000","last_clean":"2026-02-13T03:34:16.910374+0000","last_became_active":"2026-02-13T03:34:15.118392+0000","last_became_peered":"2026-02-13T03:34:15.118392+0000","last_unstale":"2026-02-13T03:34:16.910374+0000","last_undegraded":"2026-02-13T03:34:16.910374+0000","last_fullsized":"2026-02-13T03:34:16.910374+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:27:31.164818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"68'4","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.131542+0000","last_change":"2026-02-13T03:34:14.111107+0000","last_active":"2026-02-13T03:34:18.131542+0000","last_peered":"2026-02-13T03:34:18.131542+0000","last_clean":"2026-02-13T03:34:18.131542+0000","last_became_active":"2026-02-13T03:34:14.110113+0000","last_became_peered":"2026-02-13T03:34:14.110113+0000","last_unstale":"2026-02-13T03:34:18.131542+0000","last_undegraded":"2026-02-13T03:34:18.131542+0000","last_fullsized":"2026-02-13T03:34:18.131542+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:34:31.930234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.920945+0000","last_change":"2026-02-13T03:34:15.127705+0000","last_active":"2026-02-13T03:34:16.920945+0000","last_peered":"2026-02-13T03:34:16.920945+0000","last_clean":"2026-02-13T03:34:16.920945+0000","last_became_active":"2026-02-13T03:34:15.127292+0000","last_became_peered":"2026-02-13T03:34:15.127292+0000","last_unstale":"2026-02-13T03:34:16.920945+0000","last_undegraded":"2026-02-13T03:34:16.920945+0000","last_fullsized":"2026-02-13T03:34:16.920945+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:08:59.692931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"68'8","reported_seq":24,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.142217+0000","last_change":"2026-02-13T03:34:14.121451+0000","last_active":"2026-02-13T03:34:18.142217+0000","last_peered":"2026-02-13T03:34:18.142217+0000","last_clean":"2026-02-13T03:34:18.142217+0000","last_became_active":"2026-02-13T03:34:14.121350+0000","last_became_peered":"2026-02-13T03:34:14.121350+0000","last_unstale":"2026-02-13T03:34:18.142217+0000","last_undegraded":"2026-02-13T03:34:18.142217+0000","last_fullsized":"2026-02-13T03:34:18.142217+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:36:35.041824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1634,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909996+0000","last_change":"2026-02-13T03:34:15.116911+0000","last_active":"2026-02-13T03:34:16.909996+0000","last_peered":"2026-02-13T03:34:16.909996+0000","last_clean":"2026-02-13T03:34:16.909996+0000","last_became_active":"2026-02-13T03:34:15.116542+0000","last_became_peered":"2026-02-13T03:34:15.116542+0000","last_unstale":"2026-02-13T03:34:16.909996+0000","last_undegraded":"2026-02-13T03:34:16.909996+0000","last_fullsized":"2026-02-13T03:34:16.909996+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:51:00.767989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"68'6","reported_seq":23,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.135867+0000","last_change":"2026-02-13T03:34:14.110089+0000","last_active":"2026-02-13T03:34:19.135867+0000","last_peered":"2026-02-13T03:34:19.135867+0000","last_clean":"2026-02-13T03:34:19.135867+0000","last_became_active":"2026-02-13T03:34:14.109857+0000","last_became_peered":"2026-02-13T03:34:14.109857+0000","last_unstale":"2026-02-13T03:34:19.135867+0000","last_undegraded":"2026-02-13T03:34:19.135867+0000","last_fullsized":"2026-02-13T03:34:19.135867+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:28:26.120434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110999+0000","last_change":"2026-02-13T03:34:15.117207+0000","last_active":"2026-02-13T03:34:16.110999+0000","last_peered":"2026-02-13T03:34:16.110999+0000","last_clean":"2026-02-13T03:34:16.110999+0000","last_became_active":"2026-02-13T03:34:15.117080+0000","last_became_peered":"2026-02-13T03:34:15.117080+0000","last_unstale":"2026-02-13T03:34:16.110999+0000","last_undegraded":"2026-02-13T03:34:16.110999+0000","last_fullsized":"2026-02-13T03:34:16.110999+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:10:21.048259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"68'3","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.131713+0000","last_change":"2026-02-13T03:34:14.110249+0000","last_active":"2026-02-13T03:34:18.131713+0000","last_peered":"2026-02-13T03:34:18.131713+0000","last_clean":"2026-02-13T03:34:18.131713+0000","last_became_active":"2026-02-13T03:34:14.109916+0000","last_became_peered":"2026-02-13T03:34:14.109916+0000","last_unstale":"2026-02-13T03:34:18.131713+0000","last_undegraded":"2026-02-13T03:34:18.131713+0000","last_fullsized":"2026-02-13T03:34:18.131713+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:10:50.121909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.178258+0000","last_change":"2026-02-13T03:34:15.128143+0000","last_active":"2026-02-13T03:34:16.178258+0000","last_peered":"2026-02-13T03:34:16.178258+0000","last_clean":"2026-02-13T03:34:16.178258+0000","last_became_active":"2026-02-13T03:34:15.128030+0000","last_became_peered":"2026-02-13T03:34:15.128030+0000","last_unstale":"2026-02-13T03:34:16.178258+0000","last_undegraded":"2026-02-13T03:34:16.178258+0000","last_fullsized":"2026-02-13T03:34:16.178258+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:06:52.963812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"68'3","reported_seq":22,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:20.149421+0000","last_change":"2026-02-13T03:34:14.119064+0000","last_active":"2026-02-13T03:34:20.149421+0000","last_peered":"2026-02-13T03:34:20.149421+0000","last_clean":"2026-02-13T03:34:20.149421+0000","last_became_active":"2026-02-13T03:34:14.118830+0000","last_became_peered":"2026-02-13T03:34:14.118830+0000","last_unstale":"2026-02-13T03:34:20.149421+0000","last_undegraded":"2026-02-13T03:34:20.149421+0000","last_fullsized":"2026-02-13T03:34:20.149421+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:53:25.966883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.177842+0000","last_change":"2026-02-13T03:34:15.129037+0000","last_active":"2026-02-13T03:34:16.177842+0000","last_peered":"2026-02-13T03:34:16.177842+0000","last_clean":"2026-02-13T03:34:16.177842+0000","last_became_active":"2026-02-13T03:34:15.128632+0000","last_became_peered":"2026-02-13T03:34:15.128632+0000","last_unstale":"2026-02-13T03:34:16.177842+0000","last_undegraded":"2026-02-13T03:34:16.177842+0000","last_fullsized":"2026-02-13T03:34:16.177842+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:19:22.180885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"68'15","reported_seq":31,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.136706+0000","last_change":"2026-02-13T03:34:14.110318+0000","last_active":"2026-02-13T03:34:19.136706+0000","last_peered":"2026-02-13T03:34:19.136706+0000","last_clean":"2026-02-13T03:34:19.136706+0000","last_became_active":"2026-02-13T03:34:14.109648+0000","last_became_peered":"2026-02-13T03:34:14.109648+0000","last_unstale":"2026-02-13T03:34:19.136706+0000","last_undegraded":"2026-02-13T03:34:19.136706+0000","last_fullsized":"2026-02-13T03:34:19.136706+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:06:33.574407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110988+0000","last_change":"2026-02-13T03:34:15.116762+0000","last_active":"2026-02-13T03:34:16.110988+0000","last_peered":"2026-02-13T03:34:16.110988+0000","last_clean":"2026-02-13T03:34:16.110988+0000","last_became_active":"2026-02-13T03:34:15.116280+0000","last_became_peered":"2026-02-13T03:34:15.116280+0000","last_unstale":"2026-02-13T03:34:16.110988+0000","last_undegraded":"2026-02-13T03:34:16.110988+0000","last_fullsized":"2026-02-13T03:34:16.110988+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:36:18.141037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"67'1","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910092+0000","last_change":"2026-02-13T03:34:14.110976+0000","last_active":"2026-02-13T03:34:16.910092+0000","last_peered":"2026-02-13T03:34:16.910092+0000","last_clean":"2026-02-13T03:34:16.910092+0000","last_became_active":"2026-02-13T03:34:14.110717+0000","last_became_peered":"2026-02-13T03:34:14.110717+0000","last_unstale":"2026-02-13T03:34:16.910092+0000","last_undegraded":"2026-02-13T03:34:16.910092+0000","last_fullsized":"2026-02-13T03:34:16.910092+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:25:27.336312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.949109+0000","last_change":"2026-02-13T03:34:15.118326+0000","last_active":"2026-02-13T03:34:16.949109+0000","last_peered":"2026-02-13T03:34:16.949109+0000","last_clean":"2026-02-13T03:34:16.949109+0000","last_became_active":"2026-02-13T03:34:15.117977+0000","last_became_peered":"2026-02-13T03:34:15.117977+0000","last_unstale":"2026-02-13T03:34:16.949109+0000","last_undegraded":"2026-02-13T03:34:16.949109+0000","last_fullsized":"2026-02-13T03:34:16.949109+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:43:03.579176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"67'2","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111152+0000","last_change":"2026-02-13T03:34:14.109555+0000","last_active":"2026-02-13T03:34:16.111152+0000","last_peered":"2026-02-13T03:34:16.111152+0000","last_clean":"2026-02-13T03:34:16.111152+0000","last_became_active":"2026-02-13T03:34:14.109369+0000","last_became_peered":"2026-02-13T03:34:14.109369+0000","last_unstale":"2026-02-13T03:34:16.111152+0000","last_undegraded":"2026-02-13T03:34:16.111152+0000","last_fullsized":"2026-02-13T03:34:16.111152+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:16:14.530159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.178325+0000","last_change":"2026-02-13T03:34:15.126930+0000","last_active":"2026-02-13T03:34:16.178325+0000","last_peered":"2026-02-13T03:34:16.178325+0000","last_clean":"2026-02-13T03:34:16.178325+0000","last_became_active":"2026-02-13T03:34:15.126768+0000","last_became_peered":"2026-02-13T03:34:15.126768+0000","last_unstale":"2026-02-13T03:34:16.178325+0000","last_undegraded":"2026-02-13T03:34:16.178325+0000","last_fullsized":"2026-02-13T03:34:16.178325+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:15:08.856303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"67'1","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.962366+0000","last_change":"2026-02-13T03:34:14.110533+0000","last_active":"2026-02-13T03:34:16.962366+0000","last_peered":"2026-02-13T03:34:16.962366+0000","last_clean":"2026-02-13T03:34:16.962366+0000","last_became_active":"2026-02-13T03:34:14.109851+0000","last_became_peered":"2026-02-13T03:34:14.109851+0000","last_unstale":"2026-02-13T03:34:16.962366+0000","last_undegraded":"2026-02-13T03:34:16.962366+0000","last_fullsized":"2026-02-13T03:34:16.962366+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:30:58.184043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"68'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:17.182704+0000","last_change":"2026-02-13T03:34:15.128728+0000","last_active":"2026-02-13T03:34:17.182704+0000","last_peered":"2026-02-13T03:34:17.182704+0000","last_clean":"2026-02-13T03:34:17.182704+0000","last_became_active":"2026-02-13T03:34:15.128579+0000","last_became_peered":"2026-02-13T03:34:15.128579+0000","last_unstale":"2026-02-13T03:34:17.182704+0000","last_undegraded":"2026-02-13T03:34:17.182704+0000","last_fullsized":"2026-02-13T03:34:17.182704+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:05:25.697309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"68'3","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.136336+0000","last_change":"2026-02-13T03:34:14.112417+0000","last_active":"2026-02-13T03:34:19.136336+0000","last_peered":"2026-02-13T03:34:19.136336+0000","last_clean":"2026-02-13T03:34:19.136336+0000","last_became_active":"2026-02-13T03:34:14.112282+0000","last_became_peered":"2026-02-13T03:34:14.112282+0000","last_unstale":"2026-02-13T03:34:19.136336+0000","last_undegraded":"2026-02-13T03:34:19.136336+0000","last_fullsized":"2026-02-13T03:34:19.136336+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:54:26.443931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.178303+0000","last_change":"2026-02-13T03:34:15.128773+0000","last_active":"2026-02-13T03:34:16.178303+0000","last_peered":"2026-02-13T03:34:16.178303+0000","last_clean":"2026-02-13T03:34:16.178303+0000","last_became_active":"2026-02-13T03:34:15.128614+0000","last_became_peered":"2026-02-13T03:34:15.128614+0000","last_unstale":"2026-02-13T03:34:16.178303+0000","last_undegraded":"2026-02-13T03:34:16.178303+0000","last_fullsized":"2026-02-13T03:34:16.178303+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:21:12.460740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'152","reported_seq":335,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.177697+0000","last_change":"2026-02-13T03:33:53.689186+0000","last_active":"2026-02-13T03:34:16.177697+0000","last_peered":"2026-02-13T03:34:16.177697+0000","last_clean":"2026-02-13T03:34:16.177697+0000","last_became_active":"2026-02-13T03:33:53.689016+0000","last_became_peered":"2026-02-13T03:33:53.689016+0000","last_unstale":"2026-02-13T03:34:16.177697+0000","last_undegraded":"2026-02-13T03:34:16.177697+0000","last_fullsized":"2026-02-13T03:34:16.177697+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:32:51.335478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:32:51.335478+0000","last_clean_scrub_stamp":"2026-02-13T03:32:51.335478+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:46:12.228415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"68'3","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:20.148489+0000","last_change":"2026-02-13T03:34:14.118073+0000","last_active":"2026-02-13T03:34:20.148489+0000","last_peered":"2026-02-13T03:34:20.148489+0000","last_clean":"2026-02-13T03:34:20.148489+0000","last_became_active":"2026-02-13T03:34:14.117930+0000","last_became_peered":"2026-02-13T03:34:14.117930+0000","last_unstale":"2026-02-13T03:34:20.148489+0000","last_undegraded":"2026-02-13T03:34:20.148489+0000","last_fullsized":"2026-02-13T03:34:20.148489+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:31:04.815698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791157+0000","last_change":"2026-02-13T03:34:15.120789+0000","last_active":"2026-02-13T03:34:16.791157+0000","last_peered":"2026-02-13T03:34:16.791157+0000","last_clean":"2026-02-13T03:34:16.791157+0000","last_became_active":"2026-02-13T03:34:15.120102+0000","last_became_peered":"2026-02-13T03:34:15.120102+0000","last_unstale":"2026-02-13T03:34:16.791157+0000","last_undegraded":"2026-02-13T03:34:16.791157+0000","last_fullsized":"2026-02-13T03:34:16.791157+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:10:29.422050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"68'3","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.147121+0000","last_change":"2026-02-13T03:34:14.119784+0000","last_active":"2026-02-13T03:34:19.147121+0000","last_peered":"2026-02-13T03:34:19.147121+0000","last_clean":"2026-02-13T03:34:19.147121+0000","last_became_active":"2026-02-13T03:34:14.119642+0000","last_became_peered":"2026-02-13T03:34:14.119642+0000","last_unstale":"2026-02-13T03:34:19.147121+0000","last_undegraded":"2026-02-13T03:34:19.147121+0000","last_fullsized":"2026-02-13T03:34:19.147121+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:15:09.988019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110957+0000","last_change":"2026-02-13T03:34:15.113490+0000","last_active":"2026-02-13T03:34:16.110957+0000","last_peered":"2026-02-13T03:34:16.110957+0000","last_clean":"2026-02-13T03:34:16.110957+0000","last_became_active":"2026-02-13T03:34:15.113119+0000","last_became_peered":"2026-02-13T03:34:15.113119+0000","last_unstale":"2026-02-13T03:34:16.110957+0000","last_undegraded":"2026-02-13T03:34:16.110957+0000","last_fullsized":"2026-02-13T03:34:16.110957+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:26:12.918710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"68'4","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.136603+0000","last_change":"2026-02-13T03:34:14.107155+0000","last_active":"2026-02-13T03:34:19.136603+0000","last_peered":"2026-02-13T03:34:19.136603+0000","last_clean":"2026-02-13T03:34:19.136603+0000","last_became_active":"2026-02-13T03:34:14.106966+0000","last_became_peered":"2026-02-13T03:34:14.106966+0000","last_unstale":"2026-02-13T03:34:19.136603+0000","last_undegraded":"2026-02-13T03:34:19.136603+0000","last_fullsized":"2026-02-13T03:34:19.136603+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:23:06.193832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110886+0000","last_change":"2026-02-13T03:34:15.116852+0000","last_active":"2026-02-13T03:34:16.110886+0000","last_peered":"2026-02-13T03:34:16.110886+0000","last_clean":"2026-02-13T03:34:16.110886+0000","last_became_active":"2026-02-13T03:34:15.116610+0000","last_became_peered":"2026-02-13T03:34:15.116610+0000","last_unstale":"2026-02-13T03:34:16.110886+0000","last_undegraded":"2026-02-13T03:34:16.110886+0000","last_fullsized":"2026-02-13T03:34:16.110886+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:13:33.504269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"68'1","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:17.182694+0000","last_change":"2026-02-13T03:34:14.118389+0000","last_active":"2026-02-13T03:34:17.182694+0000","last_peered":"2026-02-13T03:34:17.182694+0000","last_clean":"2026-02-13T03:34:17.182694+0000","last_became_active":"2026-02-13T03:34:14.118111+0000","last_became_peered":"2026-02-13T03:34:14.118111+0000","last_unstale":"2026-02-13T03:34:17.182694+0000","last_undegraded":"2026-02-13T03:34:17.182694+0000","last_fullsized":"2026-02-13T03:34:17.182694+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:26:09.727990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.912869+0000","last_change":"2026-02-13T03:34:15.129069+0000","last_active":"2026-02-13T03:34:16.912869+0000","last_peered":"2026-02-13T03:34:16.912869+0000","last_clean":"2026-02-13T03:34:16.912869+0000","last_became_active":"2026-02-13T03:34:15.128801+0000","last_became_peered":"2026-02-13T03:34:15.128801+0000","last_unstale":"2026-02-13T03:34:16.912869+0000","last_undegraded":"2026-02-13T03:34:16.912869+0000","last_fullsized":"2026-02-13T03:34:16.912869+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:05:14.500513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111153+0000","last_change":"2026-02-13T03:34:14.110643+0000","last_active":"2026-02-13T03:34:16.111153+0000","last_peered":"2026-02-13T03:34:16.111153+0000","last_clean":"2026-02-13T03:34:16.111153+0000","last_became_active":"2026-02-13T03:34:14.110456+0000","last_became_peered":"2026-02-13T03:34:14.110456+0000","last_unstale":"2026-02-13T03:34:16.111153+0000","last_undegraded":"2026-02-13T03:34:16.111153+0000","last_fullsized":"2026-02-13T03:34:16.111153+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:22:20.313197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.912847+0000","last_change":"2026-02-13T03:34:15.129233+0000","last_active":"2026-02-13T03:34:16.912847+0000","last_peered":"2026-02-13T03:34:16.912847+0000","last_clean":"2026-02-13T03:34:16.912847+0000","last_became_active":"2026-02-13T03:34:15.128972+0000","last_became_peered":"2026-02-13T03:34:15.128972+0000","last_unstale":"2026-02-13T03:34:16.912847+0000","last_undegraded":"2026-02-13T03:34:16.912847+0000","last_fullsized":"2026-02-13T03:34:16.912847+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:38:10.731668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"68'1","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910172+0000","last_change":"2026-02-13T03:34:14.110025+0000","last_active":"2026-02-13T03:34:16.910172+0000","last_peered":"2026-02-13T03:34:16.910172+0000","last_clean":"2026-02-13T03:34:16.910172+0000","last_became_active":"2026-02-13T03:34:14.109687+0000","last_became_peered":"2026-02-13T03:34:14.109687+0000","last_unstale":"2026-02-13T03:34:16.910172+0000","last_undegraded":"2026-02-13T03:34:16.910172+0000","last_fullsized":"2026-02-13T03:34:16.910172+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:58:00.997107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111247+0000","last_change":"2026-02-13T03:34:15.116452+0000","last_active":"2026-02-13T03:34:16.111247+0000","last_peered":"2026-02-13T03:34:16.111247+0000","last_clean":"2026-02-13T03:34:16.111247+0000","last_became_active":"2026-02-13T03:34:15.116297+0000","last_became_peered":"2026-02-13T03:34:15.116297+0000","last_unstale":"2026-02-13T03:34:16.111247+0000","last_undegraded":"2026-02-13T03:34:16.111247+0000","last_fullsized":"2026-02-13T03:34:16.111247+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:36:12.315236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"68'4","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.136357+0000","last_change":"2026-02-13T03:34:14.109823+0000","last_active":"2026-02-13T03:34:19.136357+0000","last_peered":"2026-02-13T03:34:19.136357+0000","last_clean":"2026-02-13T03:34:19.136357+0000","last_became_active":"2026-02-13T03:34:14.109688+0000","last_became_peered":"2026-02-13T03:34:14.109688+0000","last_unstale":"2026-02-13T03:34:19.136357+0000","last_undegraded":"2026-02-13T03:34:19.136357+0000","last_fullsized":"2026-02-13T03:34:19.136357+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:29:43.449201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791407+0000","last_change":"2026-02-13T03:34:15.120466+0000","last_active":"2026-02-13T03:34:16.791407+0000","last_peered":"2026-02-13T03:34:16.791407+0000","last_clean":"2026-02-13T03:34:16.791407+0000","last_became_active":"2026-02-13T03:34:15.119177+0000","last_became_peered":"2026-02-13T03:34:15.119177+0000","last_unstale":"2026-02-13T03:34:16.791407+0000","last_undegraded":"2026-02-13T03:34:16.791407+0000","last_fullsized":"2026-02-13T03:34:16.791407+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:38:14.396482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"68'4","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.142036+0000","last_change":"2026-02-13T03:34:14.123372+0000","last_active":"2026-02-13T03:34:18.142036+0000","last_peered":"2026-02-13T03:34:18.142036+0000","last_clean":"2026-02-13T03:34:18.142036+0000","last_became_active":"2026-02-13T03:34:14.123252+0000","last_became_peered":"2026-02-13T03:34:14.123252+0000","last_unstale":"2026-02-13T03:34:18.142036+0000","last_undegraded":"2026-02-13T03:34:18.142036+0000","last_fullsized":"2026-02-13T03:34:18.142036+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:12:44.138856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910239+0000","last_change":"2026-02-13T03:34:15.117238+0000","last_active":"2026-02-13T03:34:16.910239+0000","last_peered":"2026-02-13T03:34:16.910239+0000","last_clean":"2026-02-13T03:34:16.910239+0000","last_became_active":"2026-02-13T03:34:15.116951+0000","last_became_peered":"2026-02-13T03:34:15.116951+0000","last_unstale":"2026-02-13T03:34:16.910239+0000","last_undegraded":"2026-02-13T03:34:16.910239+0000","last_fullsized":"2026-02-13T03:34:16.910239+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:51:53.182871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.920776+0000","last_change":"2026-02-13T03:34:14.121985+0000","last_active":"2026-02-13T03:34:16.920776+0000","last_peered":"2026-02-13T03:34:16.920776+0000","last_clean":"2026-02-13T03:34:16.920776+0000","last_became_active":"2026-02-13T03:34:14.121838+0000","last_became_peered":"2026-02-13T03:34:14.121838+0000","last_unstale":"2026-02-13T03:34:16.920776+0000","last_undegraded":"2026-02-13T03:34:16.920776+0000","last_fullsized":"2026-02-13T03:34:16.920776+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:12:14.538589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909663+0000","last_change":"2026-02-13T03:34:15.117334+0000","last_active":"2026-02-13T03:34:16.909663+0000","last_peered":"2026-02-13T03:34:16.909663+0000","last_clean":"2026-02-13T03:34:16.909663+0000","last_became_active":"2026-02-13T03:34:15.117136+0000","last_became_peered":"2026-02-13T03:34:15.117136+0000","last_unstale":"2026-02-13T03:34:16.909663+0000","last_undegraded":"2026-02-13T03:34:16.909663+0000","last_fullsized":"2026-02-13T03:34:16.909663+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:09:01.863249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791138+0000","last_change":"2026-02-13T03:34:14.108168+0000","last_active":"2026-02-13T03:34:16.791138+0000","last_peered":"2026-02-13T03:34:16.791138+0000","last_clean":"2026-02-13T03:34:16.791138+0000","last_became_active":"2026-02-13T03:34:14.107598+0000","last_became_peered":"2026-02-13T03:34:14.107598+0000","last_unstale":"2026-02-13T03:34:16.791138+0000","last_undegraded":"2026-02-13T03:34:16.791138+0000","last_fullsized":"2026-02-13T03:34:16.791138+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:50:40.370428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.949003+0000","last_change":"2026-02-13T03:34:15.117553+0000","last_active":"2026-02-13T03:34:16.949003+0000","last_peered":"2026-02-13T03:34:16.949003+0000","last_clean":"2026-02-13T03:34:16.949003+0000","last_became_active":"2026-02-13T03:34:15.117298+0000","last_became_peered":"2026-02-13T03:34:15.117298+0000","last_unstale":"2026-02-13T03:34:16.949003+0000","last_undegraded":"2026-02-13T03:34:16.949003+0000","last_fullsized":"2026-02-13T03:34:16.949003+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:52:30.525618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"68'1","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909868+0000","last_change":"2026-02-13T03:34:14.110063+0000","last_active":"2026-02-13T03:34:16.909868+0000","last_peered":"2026-02-13T03:34:16.909868+0000","last_clean":"2026-02-13T03:34:16.909868+0000","last_became_active":"2026-02-13T03:34:14.109758+0000","last_became_peered":"2026-02-13T03:34:14.109758+0000","last_unstale":"2026-02-13T03:34:16.909868+0000","last_undegraded":"2026-02-13T03:34:16.909868+0000","last_fullsized":"2026-02-13T03:34:16.909868+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:51:44.239059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791368+0000","last_change":"2026-02-13T03:34:15.119669+0000","last_active":"2026-02-13T03:34:16.791368+0000","last_peered":"2026-02-13T03:34:16.791368+0000","last_clean":"2026-02-13T03:34:16.791368+0000","last_became_active":"2026-02-13T03:34:15.118420+0000","last_became_peered":"2026-02-13T03:34:15.118420+0000","last_unstale":"2026-02-13T03:34:16.791368+0000","last_undegraded":"2026-02-13T03:34:16.791368+0000","last_fullsized":"2026-02-13T03:34:16.791368+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:55:45.147665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"68'4","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.131303+0000","last_change":"2026-02-13T03:34:14.110926+0000","last_active":"2026-02-13T03:34:18.131303+0000","last_peered":"2026-02-13T03:34:18.131303+0000","last_clean":"2026-02-13T03:34:18.131303+0000","last_became_active":"2026-02-13T03:34:14.110536+0000","last_became_peered":"2026-02-13T03:34:14.110536+0000","last_unstale":"2026-02-13T03:34:18.131303+0000","last_undegraded":"2026-02-13T03:34:18.131303+0000","last_fullsized":"2026-02-13T03:34:18.131303+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:44:35.738382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.178106+0000","last_change":"2026-02-13T03:34:15.127444+0000","last_active":"2026-02-13T03:34:16.178106+0000","last_peered":"2026-02-13T03:34:16.178106+0000","last_clean":"2026-02-13T03:34:16.178106+0000","last_became_active":"2026-02-13T03:34:15.127294+0000","last_became_peered":"2026-02-13T03:34:15.127294+0000","last_unstale":"2026-02-13T03:34:16.178106+0000","last_undegraded":"2026-02-13T03:34:16.178106+0000","last_fullsized":"2026-02-13T03:34:16.178106+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:17:49.248022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110987+0000","last_change":"2026-02-13T03:34:15.117263+0000","last_active":"2026-02-13T03:34:16.110987+0000","last_peered":"2026-02-13T03:34:16.110987+0000","last_clean":"2026-02-13T03:34:16.110987+0000","last_became_active":"2026-02-13T03:34:15.116892+0000","last_became_peered":"2026-02-13T03:34:15.116892+0000","last_unstale":"2026-02-13T03:34:16.110987+0000","last_undegraded":"2026-02-13T03:34:16.110987+0000","last_fullsized":"2026-02-13T03:34:16.110987+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:06:22.105812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"67'2","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909913+0000","last_change":"2026-02-13T03:34:14.109993+0000","last_active":"2026-02-13T03:34:16.909913+0000","last_peered":"2026-02-13T03:34:16.909913+0000","last_clean":"2026-02-13T03:34:16.909913+0000","last_became_active":"2026-02-13T03:34:14.109138+0000","last_became_peered":"2026-02-13T03:34:14.109138+0000","last_unstale":"2026-02-13T03:34:16.909913+0000","last_undegraded":"2026-02-13T03:34:16.909913+0000","last_fullsized":"2026-02-13T03:34:16.909913+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:17:43.296418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.920946+0000","last_change":"2026-02-13T03:34:15.128408+0000","last_active":"2026-02-13T03:34:16.920946+0000","last_peered":"2026-02-13T03:34:16.920946+0000","last_clean":"2026-02-13T03:34:16.920946+0000","last_became_active":"2026-02-13T03:34:15.128196+0000","last_became_peered":"2026-02-13T03:34:15.128196+0000","last_unstale":"2026-02-13T03:34:16.920946+0000","last_undegraded":"2026-02-13T03:34:16.920946+0000","last_fullsized":"2026-02-13T03:34:16.920946+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:02:00.806973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"68'4","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.135705+0000","last_change":"2026-02-13T03:34:14.110147+0000","last_active":"2026-02-13T03:34:19.135705+0000","last_peered":"2026-02-13T03:34:19.135705+0000","last_clean":"2026-02-13T03:34:19.135705+0000","last_became_active":"2026-02-13T03:34:14.109661+0000","last_became_peered":"2026-02-13T03:34:14.109661+0000","last_unstale":"2026-02-13T03:34:19.135705+0000","last_undegraded":"2026-02-13T03:34:19.135705+0000","last_fullsized":"2026-02-13T03:34:19.135705+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:51:07.074657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910343+0000","last_change":"2026-02-13T03:34:15.116693+0000","last_active":"2026-02-13T03:34:16.910343+0000","last_peered":"2026-02-13T03:34:16.910343+0000","last_clean":"2026-02-13T03:34:16.910343+0000","last_became_active":"2026-02-13T03:34:15.116374+0000","last_became_peered":"2026-02-13T03:34:15.116374+0000","last_unstale":"2026-02-13T03:34:16.910343+0000","last_undegraded":"2026-02-13T03:34:16.910343+0000","last_fullsized":"2026-02-13T03:34:16.910343+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:13:05.738784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"67'1","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791416+0000","last_change":"2026-02-13T03:34:14.110655+0000","last_active":"2026-02-13T03:34:16.791416+0000","last_peered":"2026-02-13T03:34:16.791416+0000","last_clean":"2026-02-13T03:34:16.791416+0000","last_became_active":"2026-02-13T03:34:14.110497+0000","last_became_peered":"2026-02-13T03:34:14.110497+0000","last_unstale":"2026-02-13T03:34:16.791416+0000","last_undegraded":"2026-02-13T03:34:16.791416+0000","last_fullsized":"2026-02-13T03:34:16.791416+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:31:10.990787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791316+0000","last_change":"2026-02-13T03:34:15.120370+0000","last_active":"2026-02-13T03:34:16.791316+0000","last_peered":"2026-02-13T03:34:16.791316+0000","last_clean":"2026-02-13T03:34:16.791316+0000","last_became_active":"2026-02-13T03:34:15.119060+0000","last_became_peered":"2026-02-13T03:34:15.119060+0000","last_unstale":"2026-02-13T03:34:16.791316+0000","last_undegraded":"2026-02-13T03:34:16.791316+0000","last_fullsized":"2026-02-13T03:34:16.791316+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:53:52.717845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"68'9","reported_seq":26,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.136718+0000","last_change":"2026-02-13T03:34:14.109926+0000","last_active":"2026-02-13T03:34:19.136718+0000","last_peered":"2026-02-13T03:34:19.136718+0000","last_clean":"2026-02-13T03:34:19.136718+0000","last_became_active":"2026-02-13T03:34:14.109787+0000","last_became_peered":"2026-02-13T03:34:14.109787+0000","last_unstale":"2026-02-13T03:34:19.136718+0000","last_undegraded":"2026-02-13T03:34:19.136718+0000","last_fullsized":"2026-02-13T03:34:19.136718+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:32:55.723731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5630,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":120,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":16570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":98214,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":299994,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":63,"seq":270582939654,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27680,"kb_used_data":716,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":733975520,"statfs":{"total":751619276800,"available":751590932480,"internally_reserved":0,"allocated":733184,"data_stored":354254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8106,"internal_metadata":27582550},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":56,"seq":240518168583,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":947252,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":26469,"internal_metadata":27564187},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":53,"seq":227633266697,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27696,"kb_used_data":732,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":733975504,"statfs":{"total":751619276800,"available":751590916096,"internally_reserved":0,"allocated":749568,"data_stored":354490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23172,"internal_metadata":27567484},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":46,"seq":197568495626,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27696,"kb_used_data":732,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975504,"statfs":{"total":751619276800,"available":751590916096,"internally_reserved":0,"allocated":749568,"data_stored":354410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26864,"internal_metadata":27563792},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":39,"seq":167503724556,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27740,"kb_used_data":776,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975460,"statfs":{"total":751619276800,"available":751590871040,"internally_reserved":0,"allocated":794624,"data_stored":946242,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":31919,"internal_metadata":27558737},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":36,"seq":154618822669,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27680,"kb_used_data":716,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733975520,"statfs":{"total":751619276800,"available":751590932480,"internally_reserved":0,"allocated":733184,"data_stored":353740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25134,"internal_metadata":27565522},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":29,"seq":124554051599,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27752,"kb_used_data":788,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":733975448,"statfs":{"total":751619276800,"available":751590858752,"internally_reserved":0,"allocated":806912,"data_stored":945926,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":30094,"internal_metadata":27560562},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":26,"seq":111669149712,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27688,"kb_used_data":724,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975512,"statfs":{"total":751619276800,"available":751590924288,"internally_reserved":0,"allocated":741376,"data_stored":354294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36754,"internal_metadata":27553902},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":19,"seq":81604378642,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27684,"kb_used_data":720,"kb_used_omap":39,"kb_used_meta":26904,"kb_avail":733975516,"statfs":{"total":751619276800,"available":751590928384,"internally_reserved":0,"allocated":737280,"data_stored":353754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40523,"internal_metadata":27550133},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27712,"kb_used_data":748,"kb_used_omap":54,"kb_used_meta":26889,"kb_avail":733975488,"statfs":{"total":751619276800,"available":751590899712,"internally_reserved":0,"allocated":765952,"data_stored":356656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55339,"internal_metadata":27535317},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672980,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27688,"kb_used_data":724,"kb_used_omap":37,"kb_used_meta":26906,"kb_avail":733975512,"statfs":{"total":751619276800,"available":751590924288,"internally_reserved":0,"allocated":741376,"data_stored":355284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38103,"internal_metadata":27552553},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771095,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27704,"kb_used_data":740,"kb_used_omap":42,"kb_used_meta":26901,"kb_avail":733975496,"statfs":{"total":751619276800,"available":751590907904,"internally_reserved":0,"allocated":757760,"data_stored":355172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43396,"internal_metadata":27547260},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36468,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36468,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36468,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1713,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":705,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24053,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7890,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6345,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1018,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":916,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5514,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14749,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10045,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23394,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1872,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T03:34:23.735 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-13T03:34:23.736 INFO:tasks.cephadm:Setting up client nodes... 2026-02-13T03:34:23.737 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-13T03:34:23.887 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:24.012 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a563a06c0 1 -- 10.20.193.96:0/1778554042 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2a5010eec0 msgr2=0x7f2a5010f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:24.012 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a563a06c0 1 --2- 10.20.193.96:0/1778554042 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2a5010eec0 0x7f2a5010f2b0 secure :-1 s=READY pgs=253 gs=1 cs=0 l=1 c_cookie=17196298124045508322 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a3c009970 tx=0x7f2a3c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:24.012 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a563a06c0 1 -- 10.20.193.96:0/1778554042 shutdown_connections 2026-02-13T03:34:24.012 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a563a06c0 1 --2- 10.20.193.96:0/1778554042 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2a501109f0 0x7f2a50171380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.012 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a563a06c0 1 --2- 10.20.193.96:0/1778554042 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2a50110040 0x7f2a501104b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.012 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a563a06c0 1 --2- 10.20.193.96:0/1778554042 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2a5010eec0 0x7f2a5010f2b0 unknown :-1 s=CLOSED pgs=253 gs=1 cs=0 l=1 c_cookie=17196298124045508322 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.013 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a563a06c0 1 -- 10.20.193.96:0/1778554042 >> 10.20.193.96:0/1778554042 conn(0x7f2a500ec5c0 msgr2=0x7f2a5010c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:24.013 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a563a06c0 1 -- 10.20.193.96:0/1778554042 shutdown_connections 2026-02-13T03:34:24.013 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a563a06c0 1 -- 10.20.193.96:0/1778554042 wait complete. 2026-02-13T03:34:24.013 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a563a06c0 1 Processor -- start 2026-02-13T03:34:24.013 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a563a06c0 1 -- start start 2026-02-13T03:34:24.013 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a563a06c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2a5010eec0 0x7f2a500f9000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:24.013 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a563a06c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2a50110040 0x7f2a50171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:24.013 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a563a06c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2a501109f0 0x7f2a500f9860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:24.013 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a563a06c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2a500fa490 con 0x7f2a5010eec0 2026-02-13T03:34:24.013 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a563a06c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2a500fa600 con 0x7f2a501109f0 2026-02-13T03:34:24.013 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a563a06c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2a500fa7c0 con 0x7f2a50110040 2026-02-13T03:34:24.013 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a4ffff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2a5010eec0 0x7f2a500f9000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:24.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a4ffff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2a5010eec0 0x7f2a500f9000 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:48846/0 (socket says 10.20.193.96:48846) 2026-02-13T03:34:24.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a4ffff6c0 1 -- 10.20.193.96:0/747289454 learned_addr learned my addr 10.20.193.96:0/747289454 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:24.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a4f7fe6c0 1 --2- 10.20.193.96:0/747289454 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2a50110040 0x7f2a50171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:24.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a549126c0 1 --2- 10.20.193.96:0/747289454 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2a501109f0 0x7f2a500f9860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:24.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a4ffff6c0 1 -- 10.20.193.96:0/747289454 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2a50110040 msgr2=0x7f2a50171380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:24.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a4ffff6c0 1 --2- 10.20.193.96:0/747289454 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2a50110040 0x7f2a50171380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a4ffff6c0 1 -- 10.20.193.96:0/747289454 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2a501109f0 msgr2=0x7f2a500f9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:24.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a4ffff6c0 1 --2- 10.20.193.96:0/747289454 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2a501109f0 0x7f2a500f9860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.007+0000 7f2a4ffff6c0 1 -- 10.20.193.96:0/747289454 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a3c009590 con 0x7f2a5010eec0 2026-02-13T03:34:24.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.008+0000 7f2a4ffff6c0 1 --2- 10.20.193.96:0/747289454 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2a5010eec0 0x7f2a500f9000 secure :-1 s=READY pgs=254 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a3c02ff00 tx=0x7f2a3c004670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:24.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.008+0000 7f2a4d7fa6c0 1 -- 10.20.193.96:0/747289454 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a3c002ba0 con 0x7f2a5010eec0 2026-02-13T03:34:24.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.008+0000 7f2a4d7fa6c0 1 -- 10.20.193.96:0/747289454 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f2a3c002d00 con 0x7f2a5010eec0 2026-02-13T03:34:24.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.008+0000 7f2a563a06c0 1 -- 10.20.193.96:0/747289454 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a500faa40 con 0x7f2a5010eec0 2026-02-13T03:34:24.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.008+0000 7f2a4d7fa6c0 1 -- 10.20.193.96:0/747289454 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a3c031320 con 0x7f2a5010eec0 2026-02-13T03:34:24.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.008+0000 7f2a563a06c0 1 -- 10.20.193.96:0/747289454 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a500faf10 con 0x7f2a5010eec0 2026-02-13T03:34:24.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.008+0000 7f2a563a06c0 1 -- 10.20.193.96:0/747289454 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a501753d0 con 0x7f2a5010eec0 2026-02-13T03:34:24.016 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.010+0000 7f2a4d7fa6c0 1 -- 10.20.193.96:0/747289454 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f2a3c007a60 con 0x7f2a5010eec0 2026-02-13T03:34:24.016 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.010+0000 7f2a4d7fa6c0 1 --2- 10.20.193.96:0/747289454 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f2a240b5710 0x7f2a240d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:24.016 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.010+0000 7f2a4f7fe6c0 1 --2- 10.20.193.96:0/747289454 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f2a240b5710 0x7f2a240d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:24.016 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.011+0000 7f2a4d7fa6c0 1 -- 10.20.193.96:0/747289454 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f2a3c107d50 con 0x7f2a5010eec0 2026-02-13T03:34:24.016 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.011+0000 7f2a4f7fe6c0 1 --2- 10.20.193.96:0/747289454 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f2a240b5710 0x7f2a240d5bc0 secure :-1 s=READY pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a40005980 tx=0x7f2a40005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:24.017 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.011+0000 7f2a4d7fa6c0 1 -- 10.20.193.96:0/747289454 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2a3c0cd920 con 0x7f2a5010eec0 2026-02-13T03:34:24.151 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.148+0000 7f2a563a06c0 1 -- 10.20.193.96:0/747289454 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f2a5010f290 con 0x7f2a5010eec0 2026-02-13T03:34:24.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.149+0000 7f2a4d7fa6c0 1 -- 10.20.193.96:0/747289454 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) ==== 170+0+59 (secure 0 0 0) 0x7f2a3c0cdb00 con 0x7f2a5010eec0 2026-02-13T03:34:24.152 INFO:teuthology.orchestra.run.trial096.stdout:[client.0] 2026-02-13T03:34:24.153 INFO:teuthology.orchestra.run.trial096.stdout: key = AQDAm45pR/TzCBAAdTaMjLbSXhAiQ+Z9l4fE9Q== 2026-02-13T03:34:24.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.150+0000 7f2a563a06c0 1 -- 10.20.193.96:0/747289454 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f2a240b5710 msgr2=0x7f2a240d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:24.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.150+0000 7f2a563a06c0 1 --2- 10.20.193.96:0/747289454 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f2a240b5710 0x7f2a240d5bc0 secure :-1 s=READY pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a40005980 tx=0x7f2a40005910 comp rx=0 tx=0).stop 2026-02-13T03:34:24.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.150+0000 7f2a563a06c0 1 -- 10.20.193.96:0/747289454 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2a5010eec0 msgr2=0x7f2a500f9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:24.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.150+0000 7f2a563a06c0 1 --2- 10.20.193.96:0/747289454 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2a5010eec0 0x7f2a500f9000 secure :-1 s=READY pgs=254 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a3c02ff00 tx=0x7f2a3c004670 comp rx=0 tx=0).stop 2026-02-13T03:34:24.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.151+0000 7f2a563a06c0 1 -- 10.20.193.96:0/747289454 shutdown_connections 2026-02-13T03:34:24.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.151+0000 7f2a563a06c0 1 --2- 10.20.193.96:0/747289454 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f2a240b5710 0x7f2a240d5bc0 unknown :-1 s=CLOSED pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.151+0000 7f2a563a06c0 1 --2- 10.20.193.96:0/747289454 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2a501109f0 0x7f2a500f9860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.151+0000 7f2a563a06c0 1 --2- 10.20.193.96:0/747289454 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2a50110040 0x7f2a50171380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.151+0000 7f2a563a06c0 1 --2- 10.20.193.96:0/747289454 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2a5010eec0 0x7f2a500f9000 unknown :-1 s=CLOSED pgs=254 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.151+0000 7f2a563a06c0 1 -- 10.20.193.96:0/747289454 >> 10.20.193.96:0/747289454 conn(0x7f2a500ec5c0 msgr2=0x7f2a500ef560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:24.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.151+0000 7f2a563a06c0 1 -- 10.20.193.96:0/747289454 shutdown_connections 2026-02-13T03:34:24.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.151+0000 7f2a563a06c0 1 -- 10.20.193.96:0/747289454 wait complete. 2026-02-13T03:34:24.194 DEBUG:teuthology.orchestra.run.trial096:> set -ex 2026-02-13T03:34:24.194 DEBUG:teuthology.orchestra.run.trial096:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-13T03:34:24.194 DEBUG:teuthology.orchestra.run.trial096:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-13T03:34:24.231 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph config log 1 --format=json 2026-02-13T03:34:24.386 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:24.409 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:24 trial096 ceph-mon[24671]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:34:24.409 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:24 trial096 ceph-mon[24671]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:34:24.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:24 trial132 ceph-mon[26888]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:34:24.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:24 trial132 ceph-mon[26888]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:34:24.503 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.498+0000 7faae4d216c0 1 -- 10.20.193.96:0/2907905885 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faae0115440 msgr2=0x7faae0175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:24.503 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.498+0000 7faae4d216c0 1 --2- 10.20.193.96:0/2907905885 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faae0115440 0x7faae0175de0 secure :-1 s=READY pgs=255 gs=1 cs=0 l=1 c_cookie=15878615200071432285 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faad000aa70 tx=0x7faad002fde0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.503 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.498+0000 7faae4d216c0 1 -- 10.20.193.96:0/2907905885 shutdown_connections 2026-02-13T03:34:24.503 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.498+0000 7faae4d216c0 1 --2- 10.20.193.96:0/2907905885 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faae0115440 0x7faae0175de0 unknown :-1 s=CLOSED pgs=255 gs=1 cs=0 l=1 c_cookie=15878615200071432285 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.503 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.498+0000 7faae4d216c0 1 --2- 10.20.193.96:0/2907905885 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7faae010fc20 0x7faae0114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.504 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.498+0000 7faae4d216c0 1 --2- 10.20.193.96:0/2907905885 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7faae010f230 0x7faae010f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.504 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.498+0000 7faae4d216c0 1 -- 10.20.193.96:0/2907905885 >> 10.20.193.96:0/2907905885 conn(0x7faae00ecb30 msgr2=0x7faae010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:24.504 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.498+0000 7faae4d216c0 1 -- 10.20.193.96:0/2907905885 shutdown_connections 2026-02-13T03:34:24.504 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.498+0000 7faae4d216c0 1 -- 10.20.193.96:0/2907905885 wait complete. 2026-02-13T03:34:24.504 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.498+0000 7faae4d216c0 1 Processor -- start 2026-02-13T03:34:24.504 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.498+0000 7faae4d216c0 1 -- start start 2026-02-13T03:34:24.504 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.499+0000 7faae4d216c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7faae010f230 0x7faae011d100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:24.504 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.499+0000 7faae4d216c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7faae0115440 0x7faae011d640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:24.504 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.499+0000 7faae4d216c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faae0122a00 0x7faae0122ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:24.504 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.499+0000 7faae4d216c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7faae0123410 con 0x7faae0122a00 2026-02-13T03:34:24.504 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.499+0000 7faae4d216c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7faae0123580 con 0x7faae0115440 2026-02-13T03:34:24.505 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.499+0000 7faae4d216c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7faae0123740 con 0x7faae010f230 2026-02-13T03:34:24.505 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.499+0000 7faaded766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faae0122a00 0x7faae0122ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:24.505 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.499+0000 7faaded766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faae0122a00 0x7faae0122ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:48862/0 (socket says 10.20.193.96:48862) 2026-02-13T03:34:24.505 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.499+0000 7faaded766c0 1 -- 10.20.193.96:0/3515532946 learned_addr learned my addr 10.20.193.96:0/3515532946 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:24.505 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.499+0000 7faaddd746c0 1 --2- 10.20.193.96:0/3515532946 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7faae0115440 0x7faae011d640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:24.505 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.499+0000 7faaded766c0 1 -- 10.20.193.96:0/3515532946 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7faae010f230 msgr2=0x7faae011d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:24.505 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.499+0000 7faade5756c0 1 --2- 10.20.193.96:0/3515532946 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7faae010f230 0x7faae011d100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:24.505 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.499+0000 7faaded766c0 1 --2- 10.20.193.96:0/3515532946 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7faae010f230 0x7faae011d100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.505 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.499+0000 7faaded766c0 1 -- 10.20.193.96:0/3515532946 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7faae0115440 msgr2=0x7faae011d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:24.505 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.499+0000 7faaded766c0 1 --2- 10.20.193.96:0/3515532946 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7faae0115440 0x7faae011d640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.505 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.499+0000 7faaded766c0 1 -- 10.20.193.96:0/3515532946 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad000a660 con 0x7faae0122a00 2026-02-13T03:34:24.505 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.499+0000 7faade5756c0 1 --2- 10.20.193.96:0/3515532946 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7faae010f230 0x7faae011d100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:34:24.506 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.499+0000 7faaded766c0 1 --2- 10.20.193.96:0/3515532946 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faae0122a00 0x7faae0122ea0 secure :-1 s=READY pgs=256 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faad000ab70 tx=0x7faad00054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:24.506 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.499+0000 7faac77fe6c0 1 -- 10.20.193.96:0/3515532946 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faad0030d10 con 0x7faae0122a00 2026-02-13T03:34:24.506 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.499+0000 7faac77fe6c0 1 -- 10.20.193.96:0/3515532946 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7faad0032e80 con 0x7faae0122a00 2026-02-13T03:34:24.506 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.499+0000 7faae4d216c0 1 -- 10.20.193.96:0/3515532946 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faae0163b90 con 0x7faae0122a00 2026-02-13T03:34:24.506 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.499+0000 7faac77fe6c0 1 -- 10.20.193.96:0/3515532946 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faad0008430 con 0x7faae0122a00 2026-02-13T03:34:24.506 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.499+0000 7faae4d216c0 1 -- 10.20.193.96:0/3515532946 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faae0163fc0 con 0x7faae0122a00 2026-02-13T03:34:24.506 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.499+0000 7faae4d216c0 1 -- 10.20.193.96:0/3515532946 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faae0110500 con 0x7faae0122a00 2026-02-13T03:34:24.507 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.501+0000 7faac77fe6c0 1 -- 10.20.193.96:0/3515532946 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7faad0003810 con 0x7faae0122a00 2026-02-13T03:34:24.507 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.501+0000 7faac77fe6c0 1 --2- 10.20.193.96:0/3515532946 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7faab80b5710 0x7faab80d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:24.507 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.501+0000 7faac77fe6c0 1 -- 10.20.193.96:0/3515532946 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7faad0108ee0 con 0x7faae0122a00 2026-02-13T03:34:24.507 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.501+0000 7faade5756c0 1 --2- 10.20.193.96:0/3515532946 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7faab80b5710 0x7faab80d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:24.507 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.502+0000 7faade5756c0 1 --2- 10.20.193.96:0/3515532946 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7faab80b5710 0x7faab80d5bc0 secure :-1 s=READY pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faad4005980 tx=0x7faad4005df0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:24.507 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.502+0000 7faac77fe6c0 1 -- 10.20.193.96:0/3515532946 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7faad00cb900 con 0x7faae0122a00 2026-02-13T03:34:24.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:24 trial133 ceph-mon[26943]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:34:24.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:24 trial133 ceph-mon[26943]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:34:24.598 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.595+0000 7faae4d216c0 1 -- 10.20.193.96:0/3515532946 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7faae010f600 con 0x7faae0122a00 2026-02-13T03:34:24.598 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.595+0000 7faac77fe6c0 1 -- 10.20.193.96:0/3515532946 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v46) ==== 86+0+133 (secure 0 0 0) 0x7faad00ceab0 con 0x7faae0122a00 2026-02-13T03:34:24.598 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:24.599 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.596+0000 7faae4d216c0 1 -- 10.20.193.96:0/3515532946 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7faab80b5710 msgr2=0x7faab80d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:24.599 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.596+0000 7faae4d216c0 1 --2- 10.20.193.96:0/3515532946 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7faab80b5710 0x7faab80d5bc0 secure :-1 s=READY pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faad4005980 tx=0x7faad4005df0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.596+0000 7faae4d216c0 1 -- 10.20.193.96:0/3515532946 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faae0122a00 msgr2=0x7faae0122ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:24.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.596+0000 7faae4d216c0 1 --2- 10.20.193.96:0/3515532946 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faae0122a00 0x7faae0122ea0 secure :-1 s=READY pgs=256 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faad000ab70 tx=0x7faad00054b0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.596+0000 7faae4d216c0 1 -- 10.20.193.96:0/3515532946 shutdown_connections 2026-02-13T03:34:24.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.596+0000 7faae4d216c0 1 --2- 10.20.193.96:0/3515532946 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7faab80b5710 0x7faab80d5bc0 unknown :-1 s=CLOSED pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.596+0000 7faae4d216c0 1 --2- 10.20.193.96:0/3515532946 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faae0122a00 0x7faae0122ea0 unknown :-1 s=CLOSED pgs=256 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.596+0000 7faae4d216c0 1 --2- 10.20.193.96:0/3515532946 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7faae0115440 0x7faae011d640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.596+0000 7faae4d216c0 1 --2- 10.20.193.96:0/3515532946 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7faae010f230 0x7faae011d100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.596+0000 7faae4d216c0 1 -- 10.20.193.96:0/3515532946 >> 10.20.193.96:0/3515532946 conn(0x7faae00ecb30 msgr2=0x7faae010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:24.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.596+0000 7faae4d216c0 1 -- 10.20.193.96:0/3515532946 shutdown_connections 2026-02-13T03:34:24.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.596+0000 7faae4d216c0 1 -- 10.20.193.96:0/3515532946 wait complete. 2026-02-13T03:34:24.640 INFO:teuthology.orchestra.run.trial096.stdout:[{"version":46,"timestamp":"2026-02-13T03:34:09.290508+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2026-02-13T03:34:24.641 INFO:tasks.ceph_manager:config epoch is 46 2026-02-13T03:34:24.641 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-13T03:34:24.641 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-13T03:34:24.641 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-13T03:34:24.759 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:24.879 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.874+0000 7fe8007356c0 1 -- 10.20.193.96:0/2656140830 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe7f8113190 msgr2=0x7fe7f8173b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:24.879 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.874+0000 7fe8007356c0 1 --2- 10.20.193.96:0/2656140830 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe7f8113190 0x7fe7f8173b30 secure :-1 s=READY pgs=257 gs=1 cs=0 l=1 c_cookie=2594465950193121237 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7f400aa70 tx=0x7fe7f402fde0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.880 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.874+0000 7fe8007356c0 1 -- 10.20.193.96:0/2656140830 shutdown_connections 2026-02-13T03:34:24.880 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.874+0000 7fe8007356c0 1 --2- 10.20.193.96:0/2656140830 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe7f8113190 0x7fe7f8173b30 unknown :-1 s=CLOSED pgs=257 gs=1 cs=0 l=1 c_cookie=2594465950193121237 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.880 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.874+0000 7fe8007356c0 1 --2- 10.20.193.96:0/2656140830 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe7f810d970 0x7fe7f81129b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.880 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.874+0000 7fe8007356c0 1 --2- 10.20.193.96:0/2656140830 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe7f810cf80 0x7fe7f810d350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.880 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.874+0000 7fe8007356c0 1 -- 10.20.193.96:0/2656140830 >> 10.20.193.96:0/2656140830 conn(0x7fe7f80ea880 msgr2=0x7fe7f810ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:24.880 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.874+0000 7fe8007356c0 1 -- 10.20.193.96:0/2656140830 shutdown_connections 2026-02-13T03:34:24.880 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.874+0000 7fe8007356c0 1 -- 10.20.193.96:0/2656140830 wait complete. 2026-02-13T03:34:24.880 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.875+0000 7fe8007356c0 1 Processor -- start 2026-02-13T03:34:24.880 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.875+0000 7fe8007356c0 1 -- start start 2026-02-13T03:34:24.880 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.875+0000 7fe8007356c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe7f810cf80 0x7fe7f8060700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:24.881 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.875+0000 7fe8007356c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe7f8113190 0x7fe7f8060c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:24.881 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.875+0000 7fe8007356c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe7f8061180 0x7fe7f81631f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:24.881 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.875+0000 7fe8007356c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f8163730 con 0x7fe7f8061180 2026-02-13T03:34:24.881 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.875+0000 7fe8007356c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f81638a0 con 0x7fe7f8113190 2026-02-13T03:34:24.881 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.875+0000 7fe8007356c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f8163a60 con 0x7fe7f810cf80 2026-02-13T03:34:24.881 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.875+0000 7fe7feca76c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe7f8061180 0x7fe7f81631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:24.881 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.875+0000 7fe7feca76c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe7f8061180 0x7fe7f81631f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:48890/0 (socket says 10.20.193.96:48890) 2026-02-13T03:34:24.881 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.875+0000 7fe7feca76c0 1 -- 10.20.193.96:0/3441751430 learned_addr learned my addr 10.20.193.96:0/3441751430 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:24.881 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.875+0000 7fe7fe4a66c0 1 --2- 10.20.193.96:0/3441751430 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe7f810cf80 0x7fe7f8060700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:24.881 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.875+0000 7fe7feca76c0 1 -- 10.20.193.96:0/3441751430 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe7f810cf80 msgr2=0x7fe7f8060700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:24.881 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.875+0000 7fe7feca76c0 1 --2- 10.20.193.96:0/3441751430 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe7f810cf80 0x7fe7f8060700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.881 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.875+0000 7fe7feca76c0 1 -- 10.20.193.96:0/3441751430 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe7f8113190 msgr2=0x7fe7f8060c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:24.882 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.875+0000 7fe7feca76c0 1 --2- 10.20.193.96:0/3441751430 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe7f8113190 0x7fe7f8060c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:24.882 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.875+0000 7fe7feca76c0 1 -- 10.20.193.96:0/3441751430 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f400a660 con 0x7fe7f8061180 2026-02-13T03:34:24.882 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.875+0000 7fe7feca76c0 1 --2- 10.20.193.96:0/3441751430 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe7f8061180 0x7fe7f81631f0 secure :-1 s=READY pgs=258 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7f400ab70 tx=0x7fe7f40054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:24.882 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.875+0000 7fe7df7fe6c0 1 -- 10.20.193.96:0/3441751430 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7f4030d10 con 0x7fe7f8061180 2026-02-13T03:34:24.882 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.875+0000 7fe7df7fe6c0 1 -- 10.20.193.96:0/3441751430 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fe7f4030e70 con 0x7fe7f8061180 2026-02-13T03:34:24.882 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.875+0000 7fe8007356c0 1 -- 10.20.193.96:0/3441751430 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7f8163ce0 con 0x7fe7f8061180 2026-02-13T03:34:24.882 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.875+0000 7fe7df7fe6c0 1 -- 10.20.193.96:0/3441751430 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7f4032920 con 0x7fe7f8061180 2026-02-13T03:34:24.882 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.875+0000 7fe8007356c0 1 -- 10.20.193.96:0/3441751430 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7f8164160 con 0x7fe7f8061180 2026-02-13T03:34:24.882 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.876+0000 7fe8007356c0 1 -- 10.20.193.96:0/3441751430 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7f810e250 con 0x7fe7f8061180 2026-02-13T03:34:24.883 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.877+0000 7fe7df7fe6c0 1 -- 10.20.193.96:0/3441751430 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fe7f4032030 con 0x7fe7f8061180 2026-02-13T03:34:24.883 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.878+0000 7fe7df7fe6c0 1 --2- 10.20.193.96:0/3441751430 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe7d40b5710 0x7fe7d40d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:24.883 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.878+0000 7fe7df7fe6c0 1 -- 10.20.193.96:0/3441751430 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7fe7f4108d00 con 0x7fe7f8061180 2026-02-13T03:34:24.883 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.878+0000 7fe7fe4a66c0 1 --2- 10.20.193.96:0/3441751430 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe7d40b5710 0x7fe7d40d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:24.883 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.878+0000 7fe7fe4a66c0 1 --2- 10.20.193.96:0/3441751430 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe7d40b5710 0x7fe7d40d5bc0 secure :-1 s=READY pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7e8004750 tx=0x7fe7e8009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:24.884 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:24.879+0000 7fe7df7fe6c0 1 -- 10.20.193.96:0/3441751430 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe7f40cb720 con 0x7fe7f8061180 2026-02-13T03:34:25.003 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.000+0000 7fe8007356c0 1 -- 10.20.193.96:0/3441751430 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fe7f8061a00 con 0x7fe7f8061180 2026-02-13T03:34:25.005 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.002+0000 7fe7df7fe6c0 1 -- 10.20.193.96:0/3441751430 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v12) ==== 74+0+297578 (secure 0 0 0) 0x7fe7f40ce8d0 con 0x7fe7f8061180 2026-02-13T03:34:25.008 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:25.011 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.004+0000 7fe8007356c0 1 -- 10.20.193.96:0/3441751430 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe7d40b5710 msgr2=0x7fe7d40d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:25.011 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.004+0000 7fe8007356c0 1 --2- 10.20.193.96:0/3441751430 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe7d40b5710 0x7fe7d40d5bc0 secure :-1 s=READY pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7e8004750 tx=0x7fe7e8009260 comp rx=0 tx=0).stop 2026-02-13T03:34:25.011 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.004+0000 7fe8007356c0 1 -- 10.20.193.96:0/3441751430 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe7f8061180 msgr2=0x7fe7f81631f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:25.011 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.004+0000 7fe8007356c0 1 --2- 10.20.193.96:0/3441751430 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe7f8061180 0x7fe7f81631f0 secure :-1 s=READY pgs=258 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7f400ab70 tx=0x7fe7f40054b0 comp rx=0 tx=0).stop 2026-02-13T03:34:25.011 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.004+0000 7fe8007356c0 1 -- 10.20.193.96:0/3441751430 shutdown_connections 2026-02-13T03:34:25.011 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.004+0000 7fe8007356c0 1 --2- 10.20.193.96:0/3441751430 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe7d40b5710 0x7fe7d40d5bc0 unknown :-1 s=CLOSED pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:25.011 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.004+0000 7fe8007356c0 1 --2- 10.20.193.96:0/3441751430 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe7f8061180 0x7fe7f81631f0 unknown :-1 s=CLOSED pgs=258 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:25.011 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.004+0000 7fe8007356c0 1 --2- 10.20.193.96:0/3441751430 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe7f8113190 0x7fe7f8060c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:25.012 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.004+0000 7fe8007356c0 1 --2- 10.20.193.96:0/3441751430 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe7f810cf80 0x7fe7f8060700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:25.012 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.004+0000 7fe8007356c0 1 -- 10.20.193.96:0/3441751430 >> 10.20.193.96:0/3441751430 conn(0x7fe7f80ea880 msgr2=0x7fe7f810ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:25.012 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.004+0000 7fe8007356c0 1 -- 10.20.193.96:0/3441751430 shutdown_connections 2026-02-13T03:34:25.012 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.004+0000 7fe8007356c0 1 -- 10.20.193.96:0/3441751430 wait complete. 2026-02-13T03:34:25.048 INFO:teuthology.orchestra.run.trial096.stdout:{"epoch":12,"flags":0,"active_gid":14116,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6800","nonce":1736050816},{"type":"v1","addr":"10.20.193.96:6801","nonce":1736050816}]},"active_addr":"10.20.193.96:6801/1736050816","active_change":"2026-02-13T03:31:51.784978+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[{"gid":14271,"name":"z","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24107,"name":"y","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":2,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.96:0","nonce":1121763488}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.96:0","nonce":3356222727}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.96:0","nonce":4158424980}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.96:0","nonce":3005822436}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.96:0","nonce":187719444}]}]} 2026-02-13T03:34:25.059 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-13T03:34:25.060 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-13T03:34:25.060 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T03:34:25.210 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:25.256 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:25 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/747289454' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T03:34:25.257 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:25 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/747289454' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T03:34:25.257 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:25 trial096 ceph-mon[24671]: pgmap v188: 97 pgs: 97 active+clean; 582 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.5 KiB/s rd, 4.3 KiB/s wr, 15 op/s 2026-02-13T03:34:25.257 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:25 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3515532946' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T03:34:25.257 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:25 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3441751430' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T03:34:25.324 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.320+0000 7f69c16796c0 1 -- 10.20.193.96:0/2542288391 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f69bc0607a0 msgr2=0x7f69bc060b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:25.325 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.320+0000 7f69c16796c0 1 --2- 10.20.193.96:0/2542288391 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f69bc0607a0 0x7f69bc060b70 secure :-1 s=READY pgs=259 gs=1 cs=0 l=1 c_cookie=8235684860206299057 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69b0009970 tx=0x7f69b002ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:25.325 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.320+0000 7f69c16796c0 1 -- 10.20.193.96:0/2542288391 shutdown_connections 2026-02-13T03:34:25.325 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.320+0000 7f69c16796c0 1 --2- 10.20.193.96:0/2542288391 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f69bc155630 0x7f69bc175a10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:25.325 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.320+0000 7f69c16796c0 1 --2- 10.20.193.96:0/2542288391 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f69bc0610b0 0x7f69bc1550f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:25.325 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.320+0000 7f69c16796c0 1 --2- 10.20.193.96:0/2542288391 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f69bc0607a0 0x7f69bc060b70 unknown :-1 s=CLOSED pgs=259 gs=1 cs=0 l=1 c_cookie=8235684860206299057 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:25.325 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.320+0000 7f69c16796c0 1 -- 10.20.193.96:0/2542288391 >> 10.20.193.96:0/2542288391 conn(0x7f69bc0ea880 msgr2=0x7f69bc10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:25.325 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.320+0000 7f69c16796c0 1 -- 10.20.193.96:0/2542288391 shutdown_connections 2026-02-13T03:34:25.325 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.320+0000 7f69c16796c0 1 -- 10.20.193.96:0/2542288391 wait complete. 2026-02-13T03:34:25.325 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.320+0000 7f69c16796c0 1 Processor -- start 2026-02-13T03:34:25.325 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.320+0000 7f69c16796c0 1 -- start start 2026-02-13T03:34:25.326 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.320+0000 7f69c16796c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f69bc0607a0 0x7f69bc1613f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:25.326 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.320+0000 7f69c16796c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f69bc0610b0 0x7f69bc161930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:25.326 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.320+0000 7f69c16796c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f69bc155630 0x7f69bc166cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:25.326 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.320+0000 7f69c16796c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc167340 con 0x7f69bc0610b0 2026-02-13T03:34:25.326 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.320+0000 7f69c16796c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc1674b0 con 0x7f69bc0607a0 2026-02-13T03:34:25.326 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.320+0000 7f69c16796c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc167670 con 0x7f69bc155630 2026-02-13T03:34:25.326 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.320+0000 7f69ba7fc6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f69bc0610b0 0x7f69bc161930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:25.326 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.320+0000 7f69ba7fc6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f69bc0610b0 0x7f69bc161930 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:48914/0 (socket says 10.20.193.96:48914) 2026-02-13T03:34:25.326 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.320+0000 7f69ba7fc6c0 1 -- 10.20.193.96:0/2610852866 learned_addr learned my addr 10.20.193.96:0/2610852866 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:25.326 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.320+0000 7f69bb7fe6c0 1 --2- 10.20.193.96:0/2610852866 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f69bc155630 0x7f69bc166cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:25.326 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.320+0000 7f69ba7fc6c0 1 -- 10.20.193.96:0/2610852866 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f69bc155630 msgr2=0x7f69bc166cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:25.326 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.320+0000 7f69ba7fc6c0 1 --2- 10.20.193.96:0/2610852866 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f69bc155630 0x7f69bc166cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:25.327 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.320+0000 7f69ba7fc6c0 1 -- 10.20.193.96:0/2610852866 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f69bc0607a0 msgr2=0x7f69bc1613f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:25.327 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.321+0000 7f69ba7fc6c0 1 --2- 10.20.193.96:0/2610852866 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f69bc0607a0 0x7f69bc1613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:25.327 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.321+0000 7f69ba7fc6c0 1 -- 10.20.193.96:0/2610852866 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b0009590 con 0x7f69bc0610b0 2026-02-13T03:34:25.327 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.321+0000 7f69ba7fc6c0 1 --2- 10.20.193.96:0/2610852866 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f69bc0610b0 0x7f69bc161930 secure :-1 s=READY pgs=260 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69a400b710 tx=0x7f69a400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:25.327 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.321+0000 7f699bfff6c0 1 -- 10.20.193.96:0/2610852866 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f69a4004250 con 0x7f69bc0610b0 2026-02-13T03:34:25.327 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.321+0000 7f699bfff6c0 1 -- 10.20.193.96:0/2610852866 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f69a4002da0 con 0x7f69bc0610b0 2026-02-13T03:34:25.327 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.321+0000 7f699bfff6c0 1 -- 10.20.193.96:0/2610852866 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f69a400ce30 con 0x7f69bc0610b0 2026-02-13T03:34:25.327 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.321+0000 7f69c16796c0 1 -- 10.20.193.96:0/2610852866 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69bc167950 con 0x7f69bc0610b0 2026-02-13T03:34:25.327 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.321+0000 7f69c16796c0 1 -- 10.20.193.96:0/2610852866 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69bc151260 con 0x7f69bc0610b0 2026-02-13T03:34:25.327 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.321+0000 7f69c16796c0 1 -- 10.20.193.96:0/2610852866 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69bc167b70 con 0x7f69bc0610b0 2026-02-13T03:34:25.328 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.323+0000 7f699bfff6c0 1 -- 10.20.193.96:0/2610852866 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f69a40028c0 con 0x7f69bc0610b0 2026-02-13T03:34:25.328 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.323+0000 7f699bfff6c0 1 --2- 10.20.193.96:0/2610852866 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f69900b5710 0x7f69900d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:25.328 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.323+0000 7f699bfff6c0 1 -- 10.20.193.96:0/2610852866 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f69a40e3c10 con 0x7f69bc0610b0 2026-02-13T03:34:25.329 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.323+0000 7f69baffd6c0 1 --2- 10.20.193.96:0/2610852866 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f69900b5710 0x7f69900d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:25.329 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.324+0000 7f69baffd6c0 1 --2- 10.20.193.96:0/2610852866 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f69900b5710 0x7f69900d5bc0 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69b0005b40 tx=0x7f69b0005c20 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:25.329 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.324+0000 7f699bfff6c0 1 -- 10.20.193.96:0/2610852866 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f69a40a6630 con 0x7f69bc0610b0 2026-02-13T03:34:25.418 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.415+0000 7f69c16796c0 1 -- 10.20.193.96:0/2610852866 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f69bc061cb0 con 0x7f69bc0610b0 2026-02-13T03:34:25.419 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.416+0000 7f699bfff6c0 1 -- 10.20.193.96:0/2610852866 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+22059 (secure 0 0 0) 0x7f69a40a97e0 con 0x7f69bc0610b0 2026-02-13T03:34:25.419 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:25.419 INFO:teuthology.orchestra.run.trial096.stdout:{"epoch":68,"fsid":"7c123de8-088c-11f1-84f7-d404e6e7d460","created":"2026-02-13T03:31:45.642136+0000","modified":"2026-02-13T03:34:16.108938+0000","last_up_change":"2026-02-13T03:33:56.962006+0000","last_in_change":"2026-02-13T03:33:48.669890+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T03:32:50.622231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T03:34:12.297405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T03:34:13.482715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b4f15df-2bc8-4596-a5de-6b2c54cdf01c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6802","nonce":1861813169},{"type":"v1","addr":"10.20.193.96:6803","nonce":1861813169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6804","nonce":1861813169},{"type":"v1","addr":"10.20.193.96:6805","nonce":1861813169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6808","nonce":1861813169},{"type":"v1","addr":"10.20.193.96:6809","nonce":1861813169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6806","nonce":1861813169},{"type":"v1","addr":"10.20.193.96:6807","nonce":1861813169}]},"public_addr":"10.20.193.96:6803/1861813169","cluster_addr":"10.20.193.96:6805/1861813169","heartbeat_back_addr":"10.20.193.96:6809/1861813169","heartbeat_front_addr":"10.20.193.96:6807/1861813169","state":["exists","up"]},{"osd":1,"uuid":"4238865b-e38e-494d-b2cd-4ee08715f004","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6800","nonce":3550689941},{"type":"v1","addr":"10.20.193.132:6801","nonce":3550689941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6802","nonce":3550689941},{"type":"v1","addr":"10.20.193.132:6803","nonce":3550689941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6806","nonce":3550689941},{"type":"v1","addr":"10.20.193.132:6807","nonce":3550689941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6804","nonce":3550689941},{"type":"v1","addr":"10.20.193.132:6805","nonce":3550689941}]},"public_addr":"10.20.193.132:6801/3550689941","cluster_addr":"10.20.193.132:6803/3550689941","heartbeat_back_addr":"10.20.193.132:6807/3550689941","heartbeat_front_addr":"10.20.193.132:6805/3550689941","state":["exists","up"]},{"osd":2,"uuid":"85769516-916b-43ce-aec8-36a3011ae085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6800","nonce":4145071410},{"type":"v1","addr":"10.20.193.133:6801","nonce":4145071410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6802","nonce":4145071410},{"type":"v1","addr":"10.20.193.133:6803","nonce":4145071410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6806","nonce":4145071410},{"type":"v1","addr":"10.20.193.133:6807","nonce":4145071410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6804","nonce":4145071410},{"type":"v1","addr":"10.20.193.133:6805","nonce":4145071410}]},"public_addr":"10.20.193.133:6801/4145071410","cluster_addr":"10.20.193.133:6803/4145071410","heartbeat_back_addr":"10.20.193.133:6807/4145071410","heartbeat_front_addr":"10.20.193.133:6805/4145071410","state":["exists","up"]},{"osd":3,"uuid":"2fb1e80f-f91e-4f43-a277-ae0f650cbbf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6810","nonce":2289717362},{"type":"v1","addr":"10.20.193.96:6811","nonce":2289717362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6812","nonce":2289717362},{"type":"v1","addr":"10.20.193.96:6813","nonce":2289717362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6816","nonce":2289717362},{"type":"v1","addr":"10.20.193.96:6817","nonce":2289717362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6814","nonce":2289717362},{"type":"v1","addr":"10.20.193.96:6815","nonce":2289717362}]},"public_addr":"10.20.193.96:6811/2289717362","cluster_addr":"10.20.193.96:6813/2289717362","heartbeat_back_addr":"10.20.193.96:6817/2289717362","heartbeat_front_addr":"10.20.193.96:6815/2289717362","state":["exists","up"]},{"osd":4,"uuid":"fc59010d-7a40-47e0-8111-85c564c60c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6808","nonce":421645986},{"type":"v1","addr":"10.20.193.132:6809","nonce":421645986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6810","nonce":421645986},{"type":"v1","addr":"10.20.193.132:6811","nonce":421645986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6814","nonce":421645986},{"type":"v1","addr":"10.20.193.132:6815","nonce":421645986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6812","nonce":421645986},{"type":"v1","addr":"10.20.193.132:6813","nonce":421645986}]},"public_addr":"10.20.193.132:6809/421645986","cluster_addr":"10.20.193.132:6811/421645986","heartbeat_back_addr":"10.20.193.132:6815/421645986","heartbeat_front_addr":"10.20.193.132:6813/421645986","state":["exists","up"]},{"osd":5,"uuid":"301e3dbb-5341-4fda-9c71-7f2fa3f983b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6808","nonce":3625077127},{"type":"v1","addr":"10.20.193.133:6809","nonce":3625077127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6810","nonce":3625077127},{"type":"v1","addr":"10.20.193.133:6811","nonce":3625077127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6814","nonce":3625077127},{"type":"v1","addr":"10.20.193.133:6815","nonce":3625077127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6812","nonce":3625077127},{"type":"v1","addr":"10.20.193.133:6813","nonce":3625077127}]},"public_addr":"10.20.193.133:6809/3625077127","cluster_addr":"10.20.193.133:6811/3625077127","heartbeat_back_addr":"10.20.193.133:6815/3625077127","heartbeat_front_addr":"10.20.193.133:6813/3625077127","state":["exists","up"]},{"osd":6,"uuid":"5d25b12d-8499-4f12-91ca-ce4953256678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6818","nonce":4035362295},{"type":"v1","addr":"10.20.193.96:6819","nonce":4035362295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6820","nonce":4035362295},{"type":"v1","addr":"10.20.193.96:6821","nonce":4035362295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6824","nonce":4035362295},{"type":"v1","addr":"10.20.193.96:6825","nonce":4035362295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6822","nonce":4035362295},{"type":"v1","addr":"10.20.193.96:6823","nonce":4035362295}]},"public_addr":"10.20.193.96:6819/4035362295","cluster_addr":"10.20.193.96:6821/4035362295","heartbeat_back_addr":"10.20.193.96:6825/4035362295","heartbeat_front_addr":"10.20.193.96:6823/4035362295","state":["exists","up"]},{"osd":7,"uuid":"c7d1b3d6-d6c9-4ee2-a767-45dc6a68e941","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6816","nonce":2832704836},{"type":"v1","addr":"10.20.193.132:6817","nonce":2832704836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6818","nonce":2832704836},{"type":"v1","addr":"10.20.193.132:6819","nonce":2832704836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6822","nonce":2832704836},{"type":"v1","addr":"10.20.193.132:6823","nonce":2832704836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6820","nonce":2832704836},{"type":"v1","addr":"10.20.193.132:6821","nonce":2832704836}]},"public_addr":"10.20.193.132:6817/2832704836","cluster_addr":"10.20.193.132:6819/2832704836","heartbeat_back_addr":"10.20.193.132:6823/2832704836","heartbeat_front_addr":"10.20.193.132:6821/2832704836","state":["exists","up"]},{"osd":8,"uuid":"27d57241-5de9-4678-a519-7d218f165183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6816","nonce":3678366387},{"type":"v1","addr":"10.20.193.133:6817","nonce":3678366387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6818","nonce":3678366387},{"type":"v1","addr":"10.20.193.133:6819","nonce":3678366387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6822","nonce":3678366387},{"type":"v1","addr":"10.20.193.133:6823","nonce":3678366387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6820","nonce":3678366387},{"type":"v1","addr":"10.20.193.133:6821","nonce":3678366387}]},"public_addr":"10.20.193.133:6817/3678366387","cluster_addr":"10.20.193.133:6819/3678366387","heartbeat_back_addr":"10.20.193.133:6823/3678366387","heartbeat_front_addr":"10.20.193.133:6821/3678366387","state":["exists","up"]},{"osd":9,"uuid":"93c1ae3e-3b87-4e71-b876-dcd60bbefd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6826","nonce":1024808447},{"type":"v1","addr":"10.20.193.96:6827","nonce":1024808447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6828","nonce":1024808447},{"type":"v1","addr":"10.20.193.96:6829","nonce":1024808447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6832","nonce":1024808447},{"type":"v1","addr":"10.20.193.96:6833","nonce":1024808447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6830","nonce":1024808447},{"type":"v1","addr":"10.20.193.96:6831","nonce":1024808447}]},"public_addr":"10.20.193.96:6827/1024808447","cluster_addr":"10.20.193.96:6829/1024808447","heartbeat_back_addr":"10.20.193.96:6833/1024808447","heartbeat_front_addr":"10.20.193.96:6831/1024808447","state":["exists","up"]},{"osd":10,"uuid":"0e027d3a-fcab-46b0-8719-d335e01449da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6824","nonce":921326908},{"type":"v1","addr":"10.20.193.132:6825","nonce":921326908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6826","nonce":921326908},{"type":"v1","addr":"10.20.193.132:6827","nonce":921326908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6830","nonce":921326908},{"type":"v1","addr":"10.20.193.132:6831","nonce":921326908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6828","nonce":921326908},{"type":"v1","addr":"10.20.193.132:6829","nonce":921326908}]},"public_addr":"10.20.193.132:6825/921326908","cluster_addr":"10.20.193.132:6827/921326908","heartbeat_back_addr":"10.20.193.132:6831/921326908","heartbeat_front_addr":"10.20.193.132:6829/921326908","state":["exists","up"]},{"osd":11,"uuid":"28fa6f6e-6515-49ae-930f-22e18eecefde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6824","nonce":4255173938},{"type":"v1","addr":"10.20.193.133:6825","nonce":4255173938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6826","nonce":4255173938},{"type":"v1","addr":"10.20.193.133:6827","nonce":4255173938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6830","nonce":4255173938},{"type":"v1","addr":"10.20.193.133:6831","nonce":4255173938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6828","nonce":4255173938},{"type":"v1","addr":"10.20.193.133:6829","nonce":4255173938}]},"public_addr":"10.20.193.133:6825/4255173938","cluster_addr":"10.20.193.133:6827/4255173938","heartbeat_back_addr":"10.20.193.133:6831/4255173938","heartbeat_front_addr":"10.20.193.133:6829/4255173938","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:32:33.954605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:32:41.279739+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:32:48.625772+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:32:56.120770+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:03.397402+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:10.481915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:18.008023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:25.421134+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:32.867800+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:40.330823+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:47.773798+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:55.228505+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.96:0/2938583287":"2026-02-14T03:31:51.784882+0000","10.20.193.96:0/3118819056":"2026-02-14T03:31:51.784882+0000","10.20.193.96:6801/955566313":"2026-02-14T03:31:51.784882+0000","10.20.193.96:6800/955566313":"2026-02-14T03:31:51.784882+0000","10.20.193.96:0/135845931":"2026-02-14T03:31:51.784882+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T03:34:25.421 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.417+0000 7f69c16796c0 1 -- 10.20.193.96:0/2610852866 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f69900b5710 msgr2=0x7f69900d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:25.421 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.417+0000 7f69c16796c0 1 --2- 10.20.193.96:0/2610852866 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f69900b5710 0x7f69900d5bc0 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69b0005b40 tx=0x7f69b0005c20 comp rx=0 tx=0).stop 2026-02-13T03:34:25.421 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.417+0000 7f69c16796c0 1 -- 10.20.193.96:0/2610852866 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f69bc0610b0 msgr2=0x7f69bc161930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:25.421 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.417+0000 7f69c16796c0 1 --2- 10.20.193.96:0/2610852866 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f69bc0610b0 0x7f69bc161930 secure :-1 s=READY pgs=260 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69a400b710 tx=0x7f69a400bbe0 comp rx=0 tx=0).stop 2026-02-13T03:34:25.421 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.417+0000 7f69c16796c0 1 -- 10.20.193.96:0/2610852866 shutdown_connections 2026-02-13T03:34:25.421 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.417+0000 7f69c16796c0 1 --2- 10.20.193.96:0/2610852866 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f69900b5710 0x7f69900d5bc0 unknown :-1 s=CLOSED pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:25.421 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.417+0000 7f69c16796c0 1 --2- 10.20.193.96:0/2610852866 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f69bc155630 0x7f69bc166cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:25.421 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.417+0000 7f69c16796c0 1 --2- 10.20.193.96:0/2610852866 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f69bc0610b0 0x7f69bc161930 unknown :-1 s=CLOSED pgs=260 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:25.421 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.417+0000 7f69c16796c0 1 --2- 10.20.193.96:0/2610852866 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f69bc0607a0 0x7f69bc1613f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:25.421 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.417+0000 7f69c16796c0 1 -- 10.20.193.96:0/2610852866 >> 10.20.193.96:0/2610852866 conn(0x7f69bc0ea880 msgr2=0x7f69bc10ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:25.422 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.417+0000 7f69c16796c0 1 -- 10.20.193.96:0/2610852866 shutdown_connections 2026-02-13T03:34:25.422 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.417+0000 7f69c16796c0 1 -- 10.20.193.96:0/2610852866 wait complete. 2026-02-13T03:34:25.463 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-13T03:34:25.463 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T03:34:25.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:25 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/747289454' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T03:34:25.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:25 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/747289454' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T03:34:25.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:25 trial132 ceph-mon[26888]: pgmap v188: 97 pgs: 97 active+clean; 582 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.5 KiB/s rd, 4.3 KiB/s wr, 15 op/s 2026-02-13T03:34:25.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:25 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3515532946' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T03:34:25.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:25 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3441751430' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T03:34:25.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:25 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/747289454' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T03:34:25.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:25 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/747289454' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T03:34:25.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:25 trial133 ceph-mon[26943]: pgmap v188: 97 pgs: 97 active+clean; 582 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.5 KiB/s rd, 4.3 KiB/s wr, 15 op/s 2026-02-13T03:34:25.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:25 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3515532946' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T03:34:25.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:25 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3441751430' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T03:34:25.577 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:25.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.691+0000 7f9b2daa46c0 1 -- 10.20.193.96:0/458322521 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9b2810fbf0 msgr2=0x7f9b28114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:25.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.691+0000 7f9b2daa46c0 1 --2- 10.20.193.96:0/458322521 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9b2810fbf0 0x7f9b28114c30 secure :-1 s=READY pgs=261 gs=1 cs=0 l=1 c_cookie=9166211282848741876 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b180099a0 tx=0x7f9b1802ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:25.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.691+0000 7f9b2daa46c0 1 -- 10.20.193.96:0/458322521 shutdown_connections 2026-02-13T03:34:25.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.691+0000 7f9b2daa46c0 1 --2- 10.20.193.96:0/458322521 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9b28115410 0x7f9b28175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:25.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.691+0000 7f9b2daa46c0 1 --2- 10.20.193.96:0/458322521 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9b2810fbf0 0x7f9b28114c30 unknown :-1 s=CLOSED pgs=261 gs=1 cs=0 l=1 c_cookie=9166211282848741876 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:25.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.691+0000 7f9b2daa46c0 1 --2- 10.20.193.96:0/458322521 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9b2810f200 0x7f9b2810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:25.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.691+0000 7f9b2daa46c0 1 -- 10.20.193.96:0/458322521 >> 10.20.193.96:0/458322521 conn(0x7f9b280ecb00 msgr2=0x7f9b2810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:25.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.691+0000 7f9b2daa46c0 1 -- 10.20.193.96:0/458322521 shutdown_connections 2026-02-13T03:34:25.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.691+0000 7f9b2daa46c0 1 -- 10.20.193.96:0/458322521 wait complete. 2026-02-13T03:34:25.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.691+0000 7f9b2daa46c0 1 Processor -- start 2026-02-13T03:34:25.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.691+0000 7f9b2daa46c0 1 -- start start 2026-02-13T03:34:25.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.692+0000 7f9b2daa46c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9b2810f200 0x7f9b280f4b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:25.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.692+0000 7f9b2daa46c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9b28115410 0x7f9b28175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:25.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.692+0000 7f9b2daa46c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9b280f5150 0x7f9b280fa420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:25.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.692+0000 7f9b2daa46c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9b280f5840 con 0x7f9b28115410 2026-02-13T03:34:25.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.692+0000 7f9b2daa46c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9b280fa960 con 0x7f9b280f5150 2026-02-13T03:34:25.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.692+0000 7f9b2daa46c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9b280fab20 con 0x7f9b2810f200 2026-02-13T03:34:25.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.692+0000 7f9b26ffd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9b28115410 0x7f9b28175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:25.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.692+0000 7f9b26ffd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9b28115410 0x7f9b28175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:48938/0 (socket says 10.20.193.96:48938) 2026-02-13T03:34:25.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.692+0000 7f9b26ffd6c0 1 -- 10.20.193.96:0/3421782545 learned_addr learned my addr 10.20.193.96:0/3421782545 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:25.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.692+0000 7f9b277fe6c0 1 --2- 10.20.193.96:0/3421782545 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9b2810f200 0x7f9b280f4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:25.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.692+0000 7f9b26ffd6c0 1 -- 10.20.193.96:0/3421782545 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9b2810f200 msgr2=0x7f9b280f4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:25.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.692+0000 7f9b26ffd6c0 1 --2- 10.20.193.96:0/3421782545 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9b2810f200 0x7f9b280f4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:25.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.692+0000 7f9b26ffd6c0 1 -- 10.20.193.96:0/3421782545 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9b280f5150 msgr2=0x7f9b280fa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:25.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.692+0000 7f9b26ffd6c0 1 --2- 10.20.193.96:0/3421782545 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9b280f5150 0x7f9b280fa420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:25.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.692+0000 7f9b26ffd6c0 1 -- 10.20.193.96:0/3421782545 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b18009590 con 0x7f9b28115410 2026-02-13T03:34:25.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.692+0000 7f9b277fe6c0 1 --2- 10.20.193.96:0/3421782545 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9b2810f200 0x7f9b280f4b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:34:25.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.692+0000 7f9b26ffd6c0 1 --2- 10.20.193.96:0/3421782545 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9b28115410 0x7f9b28175cb0 secure :-1 s=READY pgs=262 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b18005b40 tx=0x7f9b1802fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:25.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.692+0000 7f9b24ff96c0 1 -- 10.20.193.96:0/3421782545 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b18002ae0 con 0x7f9b28115410 2026-02-13T03:34:25.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.692+0000 7f9b24ff96c0 1 -- 10.20.193.96:0/3421782545 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f9b18002c40 con 0x7f9b28115410 2026-02-13T03:34:25.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.692+0000 7f9b24ff96c0 1 -- 10.20.193.96:0/3421782545 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b180312b0 con 0x7f9b28115410 2026-02-13T03:34:25.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.692+0000 7f9b2daa46c0 1 -- 10.20.193.96:0/3421782545 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b280fada0 con 0x7f9b28115410 2026-02-13T03:34:25.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.692+0000 7f9b2daa46c0 1 -- 10.20.193.96:0/3421782545 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b280fb1d0 con 0x7f9b28115410 2026-02-13T03:34:25.696 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.692+0000 7f9b2daa46c0 1 -- 10.20.193.96:0/3421782545 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b281104d0 con 0x7f9b28115410 2026-02-13T03:34:25.696 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.693+0000 7f9b24ff96c0 1 -- 10.20.193.96:0/3421782545 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f9b18007960 con 0x7f9b28115410 2026-02-13T03:34:25.697 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.694+0000 7f9b24ff96c0 1 --2- 10.20.193.96:0/3421782545 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9afc0b5710 0x7f9afc0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:25.697 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.694+0000 7f9b277fe6c0 1 --2- 10.20.193.96:0/3421782545 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9afc0b5710 0x7f9afc0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:25.697 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.694+0000 7f9b24ff96c0 1 -- 10.20.193.96:0/3421782545 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f9b18107d30 con 0x7f9b28115410 2026-02-13T03:34:25.697 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.694+0000 7f9b277fe6c0 1 --2- 10.20.193.96:0/3421782545 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9afc0b5710 0x7f9afc0d5bc0 secure :-1 s=READY pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b14004750 tx=0x7f9b14005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:25.697 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.695+0000 7f9b24ff96c0 1 -- 10.20.193.96:0/3421782545 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9b180ca750 con 0x7f9b28115410 2026-02-13T03:34:25.790 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.787+0000 7f9b2daa46c0 1 -- 10.20.193.96:0/3421782545 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b2810fbf0 con 0x7f9b28115410 2026-02-13T03:34:25.791 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.788+0000 7f9b24ff96c0 1 -- 10.20.193.96:0/3421782545 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+22059 (secure 0 0 0) 0x7f9b18002db0 con 0x7f9b28115410 2026-02-13T03:34:25.791 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:25.791 INFO:teuthology.orchestra.run.trial096.stdout:{"epoch":68,"fsid":"7c123de8-088c-11f1-84f7-d404e6e7d460","created":"2026-02-13T03:31:45.642136+0000","modified":"2026-02-13T03:34:16.108938+0000","last_up_change":"2026-02-13T03:33:56.962006+0000","last_in_change":"2026-02-13T03:33:48.669890+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T03:32:50.622231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T03:34:12.297405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T03:34:13.482715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b4f15df-2bc8-4596-a5de-6b2c54cdf01c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6802","nonce":1861813169},{"type":"v1","addr":"10.20.193.96:6803","nonce":1861813169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6804","nonce":1861813169},{"type":"v1","addr":"10.20.193.96:6805","nonce":1861813169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6808","nonce":1861813169},{"type":"v1","addr":"10.20.193.96:6809","nonce":1861813169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6806","nonce":1861813169},{"type":"v1","addr":"10.20.193.96:6807","nonce":1861813169}]},"public_addr":"10.20.193.96:6803/1861813169","cluster_addr":"10.20.193.96:6805/1861813169","heartbeat_back_addr":"10.20.193.96:6809/1861813169","heartbeat_front_addr":"10.20.193.96:6807/1861813169","state":["exists","up"]},{"osd":1,"uuid":"4238865b-e38e-494d-b2cd-4ee08715f004","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6800","nonce":3550689941},{"type":"v1","addr":"10.20.193.132:6801","nonce":3550689941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6802","nonce":3550689941},{"type":"v1","addr":"10.20.193.132:6803","nonce":3550689941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6806","nonce":3550689941},{"type":"v1","addr":"10.20.193.132:6807","nonce":3550689941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6804","nonce":3550689941},{"type":"v1","addr":"10.20.193.132:6805","nonce":3550689941}]},"public_addr":"10.20.193.132:6801/3550689941","cluster_addr":"10.20.193.132:6803/3550689941","heartbeat_back_addr":"10.20.193.132:6807/3550689941","heartbeat_front_addr":"10.20.193.132:6805/3550689941","state":["exists","up"]},{"osd":2,"uuid":"85769516-916b-43ce-aec8-36a3011ae085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6800","nonce":4145071410},{"type":"v1","addr":"10.20.193.133:6801","nonce":4145071410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6802","nonce":4145071410},{"type":"v1","addr":"10.20.193.133:6803","nonce":4145071410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6806","nonce":4145071410},{"type":"v1","addr":"10.20.193.133:6807","nonce":4145071410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6804","nonce":4145071410},{"type":"v1","addr":"10.20.193.133:6805","nonce":4145071410}]},"public_addr":"10.20.193.133:6801/4145071410","cluster_addr":"10.20.193.133:6803/4145071410","heartbeat_back_addr":"10.20.193.133:6807/4145071410","heartbeat_front_addr":"10.20.193.133:6805/4145071410","state":["exists","up"]},{"osd":3,"uuid":"2fb1e80f-f91e-4f43-a277-ae0f650cbbf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6810","nonce":2289717362},{"type":"v1","addr":"10.20.193.96:6811","nonce":2289717362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6812","nonce":2289717362},{"type":"v1","addr":"10.20.193.96:6813","nonce":2289717362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6816","nonce":2289717362},{"type":"v1","addr":"10.20.193.96:6817","nonce":2289717362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6814","nonce":2289717362},{"type":"v1","addr":"10.20.193.96:6815","nonce":2289717362}]},"public_addr":"10.20.193.96:6811/2289717362","cluster_addr":"10.20.193.96:6813/2289717362","heartbeat_back_addr":"10.20.193.96:6817/2289717362","heartbeat_front_addr":"10.20.193.96:6815/2289717362","state":["exists","up"]},{"osd":4,"uuid":"fc59010d-7a40-47e0-8111-85c564c60c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6808","nonce":421645986},{"type":"v1","addr":"10.20.193.132:6809","nonce":421645986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6810","nonce":421645986},{"type":"v1","addr":"10.20.193.132:6811","nonce":421645986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6814","nonce":421645986},{"type":"v1","addr":"10.20.193.132:6815","nonce":421645986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6812","nonce":421645986},{"type":"v1","addr":"10.20.193.132:6813","nonce":421645986}]},"public_addr":"10.20.193.132:6809/421645986","cluster_addr":"10.20.193.132:6811/421645986","heartbeat_back_addr":"10.20.193.132:6815/421645986","heartbeat_front_addr":"10.20.193.132:6813/421645986","state":["exists","up"]},{"osd":5,"uuid":"301e3dbb-5341-4fda-9c71-7f2fa3f983b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6808","nonce":3625077127},{"type":"v1","addr":"10.20.193.133:6809","nonce":3625077127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6810","nonce":3625077127},{"type":"v1","addr":"10.20.193.133:6811","nonce":3625077127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6814","nonce":3625077127},{"type":"v1","addr":"10.20.193.133:6815","nonce":3625077127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6812","nonce":3625077127},{"type":"v1","addr":"10.20.193.133:6813","nonce":3625077127}]},"public_addr":"10.20.193.133:6809/3625077127","cluster_addr":"10.20.193.133:6811/3625077127","heartbeat_back_addr":"10.20.193.133:6815/3625077127","heartbeat_front_addr":"10.20.193.133:6813/3625077127","state":["exists","up"]},{"osd":6,"uuid":"5d25b12d-8499-4f12-91ca-ce4953256678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6818","nonce":4035362295},{"type":"v1","addr":"10.20.193.96:6819","nonce":4035362295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6820","nonce":4035362295},{"type":"v1","addr":"10.20.193.96:6821","nonce":4035362295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6824","nonce":4035362295},{"type":"v1","addr":"10.20.193.96:6825","nonce":4035362295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6822","nonce":4035362295},{"type":"v1","addr":"10.20.193.96:6823","nonce":4035362295}]},"public_addr":"10.20.193.96:6819/4035362295","cluster_addr":"10.20.193.96:6821/4035362295","heartbeat_back_addr":"10.20.193.96:6825/4035362295","heartbeat_front_addr":"10.20.193.96:6823/4035362295","state":["exists","up"]},{"osd":7,"uuid":"c7d1b3d6-d6c9-4ee2-a767-45dc6a68e941","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6816","nonce":2832704836},{"type":"v1","addr":"10.20.193.132:6817","nonce":2832704836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6818","nonce":2832704836},{"type":"v1","addr":"10.20.193.132:6819","nonce":2832704836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6822","nonce":2832704836},{"type":"v1","addr":"10.20.193.132:6823","nonce":2832704836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6820","nonce":2832704836},{"type":"v1","addr":"10.20.193.132:6821","nonce":2832704836}]},"public_addr":"10.20.193.132:6817/2832704836","cluster_addr":"10.20.193.132:6819/2832704836","heartbeat_back_addr":"10.20.193.132:6823/2832704836","heartbeat_front_addr":"10.20.193.132:6821/2832704836","state":["exists","up"]},{"osd":8,"uuid":"27d57241-5de9-4678-a519-7d218f165183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6816","nonce":3678366387},{"type":"v1","addr":"10.20.193.133:6817","nonce":3678366387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6818","nonce":3678366387},{"type":"v1","addr":"10.20.193.133:6819","nonce":3678366387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6822","nonce":3678366387},{"type":"v1","addr":"10.20.193.133:6823","nonce":3678366387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6820","nonce":3678366387},{"type":"v1","addr":"10.20.193.133:6821","nonce":3678366387}]},"public_addr":"10.20.193.133:6817/3678366387","cluster_addr":"10.20.193.133:6819/3678366387","heartbeat_back_addr":"10.20.193.133:6823/3678366387","heartbeat_front_addr":"10.20.193.133:6821/3678366387","state":["exists","up"]},{"osd":9,"uuid":"93c1ae3e-3b87-4e71-b876-dcd60bbefd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6826","nonce":1024808447},{"type":"v1","addr":"10.20.193.96:6827","nonce":1024808447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6828","nonce":1024808447},{"type":"v1","addr":"10.20.193.96:6829","nonce":1024808447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6832","nonce":1024808447},{"type":"v1","addr":"10.20.193.96:6833","nonce":1024808447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.96:6830","nonce":1024808447},{"type":"v1","addr":"10.20.193.96:6831","nonce":1024808447}]},"public_addr":"10.20.193.96:6827/1024808447","cluster_addr":"10.20.193.96:6829/1024808447","heartbeat_back_addr":"10.20.193.96:6833/1024808447","heartbeat_front_addr":"10.20.193.96:6831/1024808447","state":["exists","up"]},{"osd":10,"uuid":"0e027d3a-fcab-46b0-8719-d335e01449da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6824","nonce":921326908},{"type":"v1","addr":"10.20.193.132:6825","nonce":921326908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6826","nonce":921326908},{"type":"v1","addr":"10.20.193.132:6827","nonce":921326908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6830","nonce":921326908},{"type":"v1","addr":"10.20.193.132:6831","nonce":921326908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.132:6828","nonce":921326908},{"type":"v1","addr":"10.20.193.132:6829","nonce":921326908}]},"public_addr":"10.20.193.132:6825/921326908","cluster_addr":"10.20.193.132:6827/921326908","heartbeat_back_addr":"10.20.193.132:6831/921326908","heartbeat_front_addr":"10.20.193.132:6829/921326908","state":["exists","up"]},{"osd":11,"uuid":"28fa6f6e-6515-49ae-930f-22e18eecefde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6824","nonce":4255173938},{"type":"v1","addr":"10.20.193.133:6825","nonce":4255173938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6826","nonce":4255173938},{"type":"v1","addr":"10.20.193.133:6827","nonce":4255173938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6830","nonce":4255173938},{"type":"v1","addr":"10.20.193.133:6831","nonce":4255173938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.133:6828","nonce":4255173938},{"type":"v1","addr":"10.20.193.133:6829","nonce":4255173938}]},"public_addr":"10.20.193.133:6825/4255173938","cluster_addr":"10.20.193.133:6827/4255173938","heartbeat_back_addr":"10.20.193.133:6831/4255173938","heartbeat_front_addr":"10.20.193.133:6829/4255173938","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:32:33.954605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:32:41.279739+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:32:48.625772+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:32:56.120770+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:03.397402+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:10.481915+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:18.008023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:25.421134+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:32.867800+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:40.330823+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:47.773798+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:33:55.228505+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.96:0/2938583287":"2026-02-14T03:31:51.784882+0000","10.20.193.96:0/3118819056":"2026-02-14T03:31:51.784882+0000","10.20.193.96:6801/955566313":"2026-02-14T03:31:51.784882+0000","10.20.193.96:6800/955566313":"2026-02-14T03:31:51.784882+0000","10.20.193.96:0/135845931":"2026-02-14T03:31:51.784882+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T03:34:25.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.789+0000 7f9b2daa46c0 1 -- 10.20.193.96:0/3421782545 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9afc0b5710 msgr2=0x7f9afc0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:25.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.789+0000 7f9b2daa46c0 1 --2- 10.20.193.96:0/3421782545 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9afc0b5710 0x7f9afc0d5bc0 secure :-1 s=READY pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b14004750 tx=0x7f9b14005f10 comp rx=0 tx=0).stop 2026-02-13T03:34:25.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.789+0000 7f9b2daa46c0 1 -- 10.20.193.96:0/3421782545 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9b28115410 msgr2=0x7f9b28175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:25.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.789+0000 7f9b2daa46c0 1 --2- 10.20.193.96:0/3421782545 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9b28115410 0x7f9b28175cb0 secure :-1 s=READY pgs=262 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b18005b40 tx=0x7f9b1802fc60 comp rx=0 tx=0).stop 2026-02-13T03:34:25.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.789+0000 7f9b2daa46c0 1 -- 10.20.193.96:0/3421782545 shutdown_connections 2026-02-13T03:34:25.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.789+0000 7f9b2daa46c0 1 --2- 10.20.193.96:0/3421782545 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9afc0b5710 0x7f9afc0d5bc0 unknown :-1 s=CLOSED pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:25.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.789+0000 7f9b2daa46c0 1 --2- 10.20.193.96:0/3421782545 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9b280f5150 0x7f9b280fa420 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:25.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.789+0000 7f9b2daa46c0 1 --2- 10.20.193.96:0/3421782545 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9b28115410 0x7f9b28175cb0 unknown :-1 s=CLOSED pgs=262 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:25.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.789+0000 7f9b2daa46c0 1 --2- 10.20.193.96:0/3421782545 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9b2810f200 0x7f9b280f4b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:25.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.789+0000 7f9b2daa46c0 1 -- 10.20.193.96:0/3421782545 >> 10.20.193.96:0/3421782545 conn(0x7f9b280ecb00 msgr2=0x7f9b28113bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:25.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.789+0000 7f9b2daa46c0 1 -- 10.20.193.96:0/3421782545 shutdown_connections 2026-02-13T03:34:25.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:25.789+0000 7f9b2daa46c0 1 -- 10.20.193.96:0/3421782545 wait complete. 2026-02-13T03:34:25.832 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-13T03:34:25.833 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-13T03:34:25.833 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-13T03:34:25.833 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-13T03:34:25.833 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph tell osd.4 flush_pg_stats 2026-02-13T03:34:25.833 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph tell osd.5 flush_pg_stats 2026-02-13T03:34:25.833 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph tell osd.6 flush_pg_stats 2026-02-13T03:34:25.833 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph tell osd.7 flush_pg_stats 2026-02-13T03:34:25.834 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph tell osd.8 flush_pg_stats 2026-02-13T03:34:25.834 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph tell osd.9 flush_pg_stats 2026-02-13T03:34:25.834 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph tell osd.10 flush_pg_stats 2026-02-13T03:34:25.834 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph tell osd.11 flush_pg_stats 2026-02-13T03:34:25.969 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:25.969 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:25.975 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:25.976 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:25.977 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:25.977 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:25.981 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:25.981 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:25.983 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:25.983 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:25.988 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:25.989 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:26.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.125+0000 7f84b913c6c0 1 -- 10.20.193.96:0/3388425106 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f84b410d9a0 msgr2=0x7f84b41129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.125+0000 7f84b913c6c0 1 --2- 10.20.193.96:0/3388425106 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f84b410d9a0 0x7f84b41129e0 secure :-1 s=READY pgs=263 gs=1 cs=0 l=1 c_cookie=11294348323547031406 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f849c0099a0 tx=0x7f849c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:26.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.125+0000 7f84b913c6c0 1 -- 10.20.193.96:0/3388425106 shutdown_connections 2026-02-13T03:34:26.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.125+0000 7f84b913c6c0 1 --2- 10.20.193.96:0/3388425106 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f84b41131c0 0x7f84b4173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.125+0000 7f84b913c6c0 1 --2- 10.20.193.96:0/3388425106 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f84b410d9a0 0x7f84b41129e0 unknown :-1 s=CLOSED pgs=263 gs=1 cs=0 l=1 c_cookie=11294348323547031406 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.125+0000 7f84b913c6c0 1 --2- 10.20.193.96:0/3388425106 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f84b410cfb0 0x7f84b410d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.125+0000 7f84b913c6c0 1 -- 10.20.193.96:0/3388425106 >> 10.20.193.96:0/3388425106 conn(0x7f84b40ea8b0 msgr2=0x7f84b410acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.125+0000 7f84b913c6c0 1 -- 10.20.193.96:0/3388425106 shutdown_connections 2026-02-13T03:34:26.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.125+0000 7f84b913c6c0 1 -- 10.20.193.96:0/3388425106 wait complete. 2026-02-13T03:34:26.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.125+0000 7ff8a8f236c0 1 -- 10.20.193.96:0/1195491796 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8a410f230 msgr2=0x7ff8a410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.125+0000 7ff8a8f236c0 1 --2- 10.20.193.96:0/1195491796 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8a410f230 0x7ff8a410f600 secure :-1 s=READY pgs=264 gs=1 cs=0 l=1 c_cookie=15869710823520079370 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8980099a0 tx=0x7ff89802ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:26.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.125+0000 7ff8a8f236c0 1 -- 10.20.193.96:0/1195491796 shutdown_connections 2026-02-13T03:34:26.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.125+0000 7ff8a8f236c0 1 --2- 10.20.193.96:0/1195491796 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff8a4115440 0x7ff8a4175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.125+0000 7ff8a8f236c0 1 --2- 10.20.193.96:0/1195491796 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff8a410fc20 0x7ff8a4114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.125+0000 7ff8a8f236c0 1 --2- 10.20.193.96:0/1195491796 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8a410f230 0x7ff8a410f600 unknown :-1 s=CLOSED pgs=264 gs=1 cs=0 l=1 c_cookie=15869710823520079370 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.129 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.125+0000 7ff8a8f236c0 1 -- 10.20.193.96:0/1195491796 >> 10.20.193.96:0/1195491796 conn(0x7ff8a40ecb30 msgr2=0x7ff8a410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.129 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.125+0000 7ff8a8f236c0 1 -- 10.20.193.96:0/1195491796 shutdown_connections 2026-02-13T03:34:26.129 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.125+0000 7ff8a8f236c0 1 -- 10.20.193.96:0/1195491796 wait complete. 2026-02-13T03:34:26.129 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.125+0000 7f84b913c6c0 1 Processor -- start 2026-02-13T03:34:26.129 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7f84b913c6c0 1 -- start start 2026-02-13T03:34:26.129 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7f84b913c6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f84b410cfb0 0x7f84b4060700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.129 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7f84b913c6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f84b41131c0 0x7f84b4060c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.129 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7ff8a8f236c0 1 Processor -- start 2026-02-13T03:34:26.129 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7f84b913c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f84b4061180 0x7f84b41632c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.129 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7f84b913c6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f84b4062700 con 0x7f84b4061180 2026-02-13T03:34:26.129 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7f84b913c6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f84b4163800 con 0x7f84b41131c0 2026-02-13T03:34:26.129 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7f84b913c6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f84b41639c0 con 0x7f84b410cfb0 2026-02-13T03:34:26.129 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7ff8a8f236c0 1 -- start start 2026-02-13T03:34:26.129 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7f84b25756c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f84b41131c0 0x7f84b4060c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.129 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7f84b25756c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f84b41131c0 0x7f84b4060c40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.132:3300/0 says I am v2:10.20.193.96:36232/0 (socket says 10.20.193.96:36232) 2026-02-13T03:34:26.129 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7f84b25756c0 1 -- 10.20.193.96:0/4145606229 learned_addr learned my addr 10.20.193.96:0/4145606229 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:26.129 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7f84b35776c0 1 --2- 10.20.193.96:0/4145606229 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f84b4061180 0x7f84b41632c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7f84b2d766c0 1 --2- 10.20.193.96:0/4145606229 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f84b410cfb0 0x7f84b4060700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7ff8a8f236c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff8a410f230 0x7ff8a411d280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7ff8a8f236c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8a4115440 0x7ff8a411d7c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7ff8a8f236c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff8a4122b80 0x7ff8a4123020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7ff8a8f236c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a4123590 con 0x7ff8a4115440 2026-02-13T03:34:26.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7ff8a8f236c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a4123700 con 0x7ff8a4122b80 2026-02-13T03:34:26.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7ff8a8f236c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a41238c0 con 0x7ff8a410f230 2026-02-13T03:34:26.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7ff8a1d746c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8a4115440 0x7ff8a411d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7ff8a1d746c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8a4115440 0x7ff8a411d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:48968/0 (socket says 10.20.193.96:48968) 2026-02-13T03:34:26.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7ff8a1d746c0 1 -- 10.20.193.96:0/2404375156 learned_addr learned my addr 10.20.193.96:0/2404375156 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:26.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7ff8a25756c0 1 --2- 10.20.193.96:0/2404375156 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff8a410f230 0x7ff8a411d280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7f84b25756c0 1 -- 10.20.193.96:0/4145606229 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f84b410cfb0 msgr2=0x7f84b4060700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7f84b25756c0 1 --2- 10.20.193.96:0/4145606229 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f84b410cfb0 0x7f84b4060700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7f84b25756c0 1 -- 10.20.193.96:0/4145606229 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f84b4061180 msgr2=0x7f84b41632c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7f84b25756c0 1 --2- 10.20.193.96:0/4145606229 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f84b4061180 0x7f84b41632c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7f84b25756c0 1 -- 10.20.193.96:0/4145606229 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f849c009590 con 0x7f84b41131c0 2026-02-13T03:34:26.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7ff8a2d766c0 1 --2- 10.20.193.96:0/2404375156 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff8a4122b80 0x7ff8a4123020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7f84b35776c0 1 --2- 10.20.193.96:0/4145606229 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f84b4061180 0x7f84b41632c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T03:34:26.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7ff8a1d746c0 1 -- 10.20.193.96:0/2404375156 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff8a410f230 msgr2=0x7ff8a411d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7ff8a1d746c0 1 --2- 10.20.193.96:0/2404375156 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff8a410f230 0x7ff8a411d280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7ff8a1d746c0 1 -- 10.20.193.96:0/2404375156 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff8a4122b80 msgr2=0x7ff8a4123020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7ff8a1d746c0 1 --2- 10.20.193.96:0/2404375156 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff8a4122b80 0x7ff8a4123020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.126+0000 7ff8a1d746c0 1 -- 10.20.193.96:0/2404375156 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff898009590 con 0x7ff8a4115440 2026-02-13T03:34:26.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.127+0000 7ff8a25756c0 1 --2- 10.20.193.96:0/2404375156 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff8a410f230 0x7ff8a411d280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:34:26.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.127+0000 7ff8a1d746c0 1 --2- 10.20.193.96:0/2404375156 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8a4115440 0x7ff8a411d7c0 secure :-1 s=READY pgs=265 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff88c005dc0 tx=0x7ff88c00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.127+0000 7ff88b7fe6c0 1 -- 10.20.193.96:0/2404375156 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff88c004250 con 0x7ff8a4115440 2026-02-13T03:34:26.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.127+0000 7ff8a8f236c0 1 -- 10.20.193.96:0/2404375156 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8a4163d70 con 0x7ff8a4115440 2026-02-13T03:34:26.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.127+0000 7ff88b7fe6c0 1 -- 10.20.193.96:0/2404375156 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7ff88c009070 con 0x7ff8a4115440 2026-02-13T03:34:26.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.127+0000 7ff8a8f236c0 1 -- 10.20.193.96:0/2404375156 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8a4164250 con 0x7ff8a4115440 2026-02-13T03:34:26.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.127+0000 7f84b25756c0 1 --2- 10.20.193.96:0/4145606229 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f84b41131c0 0x7f84b4060c40 secure :-1 s=READY pgs=50 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f849c005b40 tx=0x7f849c02fc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.127+0000 7f8493fff6c0 1 -- 10.20.193.96:0/4145606229 <== mon.2 v2:10.20.193.132:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f849c002ae0 con 0x7f84b41131c0 2026-02-13T03:34:26.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.127+0000 7f8493fff6c0 1 -- 10.20.193.96:0/4145606229 <== mon.2 v2:10.20.193.132:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f849c002c40 con 0x7f84b41131c0 2026-02-13T03:34:26.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.127+0000 7f84b913c6c0 1 -- 10.20.193.96:0/4145606229 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b4163c40 con 0x7f84b41131c0 2026-02-13T03:34:26.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.128+0000 7f8493fff6c0 1 -- 10.20.193.96:0/4145606229 <== mon.2 v2:10.20.193.132:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f849c0312b0 con 0x7f84b41131c0 2026-02-13T03:34:26.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.127+0000 7ff88b7fe6c0 1 -- 10.20.193.96:0/2404375156 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff88c00cdb0 con 0x7ff8a4115440 2026-02-13T03:34:26.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.128+0000 7f84b913c6c0 1 -- 10.20.193.96:0/4145606229 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b4164000 con 0x7f84b41131c0 2026-02-13T03:34:26.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.128+0000 7ff8a8f236c0 1 -- 10.20.193.96:0/2404375156 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff8a4052a50 con 0x7ff8a4115440 2026-02-13T03:34:26.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.128+0000 7fb146ce56c0 1 -- 10.20.193.96:0/3251810964 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb140112050 msgr2=0x7fb1401729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.128+0000 7fb146ce56c0 1 --2- 10.20.193.96:0/3251810964 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb140112050 0x7fb1401729f0 secure :-1 s=READY pgs=266 gs=1 cs=0 l=1 c_cookie=10752704185140364313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb13c00aa70 tx=0x7fb13c02fde0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.132 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.128+0000 7f84b913c6c0 1 -- 10.20.193.96:0/4145606229 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f84b4052a50 con 0x7f84b41131c0 2026-02-13T03:34:26.132 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.128+0000 7f11bf9756c0 1 -- 10.20.193.96:0/3588106570 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f11b8115440 msgr2=0x7f11b8175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.132 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.128+0000 7f11bf9756c0 1 --2- 10.20.193.96:0/3588106570 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f11b8115440 0x7f11b8175de0 secure :-1 s=READY pgs=51 gs=3 cs=0 l=1 c_cookie=9836117314641728327 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11b400aa40 tx=0x7f11b402fe00 comp rx=0 tx=0).stop 2026-02-13T03:34:26.132 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.128+0000 7f11bf9756c0 1 -- 10.20.193.96:0/3588106570 shutdown_connections 2026-02-13T03:34:26.132 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.128+0000 7f11bf9756c0 1 --2- 10.20.193.96:0/3588106570 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f11b8115440 0x7f11b8175de0 unknown :-1 s=CLOSED pgs=51 gs=3 cs=0 l=1 c_cookie=9836117314641728327 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.132 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.128+0000 7f11bf9756c0 1 --2- 10.20.193.96:0/3588106570 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f11b810fc20 0x7f11b8114c60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.132 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.128+0000 7f11bf9756c0 1 --2- 10.20.193.96:0/3588106570 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f11b810f230 0x7f11b810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.132 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.128+0000 7f11bf9756c0 1 -- 10.20.193.96:0/3588106570 >> 10.20.193.96:0/3588106570 conn(0x7f11b80ecb30 msgr2=0x7f11b810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.132 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.128+0000 7f11bf9756c0 1 -- 10.20.193.96:0/3588106570 shutdown_connections 2026-02-13T03:34:26.132 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.128+0000 7f11bf9756c0 1 -- 10.20.193.96:0/3588106570 wait complete. 2026-02-13T03:34:26.132 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f11bf9756c0 1 Processor -- start 2026-02-13T03:34:26.132 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f11bf9756c0 1 -- start start 2026-02-13T03:34:26.132 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7fb146ce56c0 1 -- 10.20.193.96:0/3251810964 shutdown_connections 2026-02-13T03:34:26.132 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7fb146ce56c0 1 --2- 10.20.193.96:0/3251810964 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb140112050 0x7fb1401729f0 unknown :-1 s=CLOSED pgs=266 gs=1 cs=0 l=1 c_cookie=10752704185140364313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.132 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7fb146ce56c0 1 --2- 10.20.193.96:0/3251810964 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb14010c830 0x7fb140111870 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.132 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7fb146ce56c0 1 --2- 10.20.193.96:0/3251810964 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb14010be40 0x7fb14010c210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.132 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7fb146ce56c0 1 -- 10.20.193.96:0/3251810964 >> 10.20.193.96:0/3251810964 conn(0x7fb1400e9700 msgr2=0x7fb140109b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.132 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7fb146ce56c0 1 -- 10.20.193.96:0/3251810964 shutdown_connections 2026-02-13T03:34:26.132 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7fb146ce56c0 1 -- 10.20.193.96:0/3251810964 wait complete. 2026-02-13T03:34:26.132 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f11bf9756c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f11b810f230 0x7f11b80fe310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.133 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f11bf9756c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f11b8115440 0x7f11b8175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.133 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f11bf9756c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f11b80fe850 0x7f11b80fecf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.133 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f11bf9756c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f11b8103360 con 0x7f11b80fe850 2026-02-13T03:34:26.133 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f11bf9756c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f11b81034d0 con 0x7f11b8115440 2026-02-13T03:34:26.133 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7ff88b7fe6c0 1 -- 10.20.193.96:0/2404375156 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7ff88c0028c0 con 0x7ff8a4115440 2026-02-13T03:34:26.133 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f11bf9756c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f11b8103640 con 0x7f11b810f230 2026-02-13T03:34:26.133 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f11bd6e66c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f11b810f230 0x7f11b80fe310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.133 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f11bcee56c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f11b8115440 0x7f11b8175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.133 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f4db4ea56c0 1 -- 10.20.193.96:0/407634708 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4db010b430 msgr2=0x7f4db010b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.133 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f4db4ea56c0 1 --2- 10.20.193.96:0/407634708 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4db010b430 0x7f4db010b800 secure :-1 s=READY pgs=54 gs=2 cs=0 l=1 c_cookie=4744989452597537484 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da40098d0 tx=0x7f4da402ec40 comp rx=0 tx=0).stop 2026-02-13T03:34:26.133 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f11bdee76c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f11b80fe850 0x7f11b80fecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.133 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f4db4ea56c0 1 -- 10.20.193.96:0/407634708 shutdown_connections 2026-02-13T03:34:26.133 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f4db4ea56c0 1 --2- 10.20.193.96:0/407634708 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4db010e130 0x7f4db0171d10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.133 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f4db4ea56c0 1 --2- 10.20.193.96:0/407634708 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4db010be20 0x7f4db010d950 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.133 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f4db4ea56c0 1 --2- 10.20.193.96:0/407634708 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4db010b430 0x7f4db010b800 unknown :-1 s=CLOSED pgs=54 gs=2 cs=0 l=1 c_cookie=4744989452597537484 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.133 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f4db4ea56c0 1 -- 10.20.193.96:0/407634708 >> 10.20.193.96:0/407634708 conn(0x7f4db0063af0 msgr2=0x7f4db00642b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.133 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f4db4ea56c0 1 -- 10.20.193.96:0/407634708 shutdown_connections 2026-02-13T03:34:26.133 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f4db4ea56c0 1 -- 10.20.193.96:0/407634708 wait complete. 2026-02-13T03:34:26.133 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f11bd6e66c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f11b810f230 0x7f11b80fe310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.133:3300/0 says I am v2:10.20.193.96:41868/0 (socket says 10.20.193.96:41868) 2026-02-13T03:34:26.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f11bd6e66c0 1 -- 10.20.193.96:0/676625670 learned_addr learned my addr 10.20.193.96:0/676625670 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:26.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f11bcee56c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f11b8115440 0x7f11b8175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.132:3300/0 says I am v2:10.20.193.96:36284/0 (socket says 10.20.193.96:36284) 2026-02-13T03:34:26.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7fb146ce56c0 1 Processor -- start 2026-02-13T03:34:26.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f11bdee76c0 1 -- 10.20.193.96:0/676625670 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f11b810f230 msgr2=0x7f11b80fe310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f11bdee76c0 1 --2- 10.20.193.96:0/676625670 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f11b810f230 0x7f11b80fe310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7fb146ce56c0 1 -- start start 2026-02-13T03:34:26.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f11bdee76c0 1 -- 10.20.193.96:0/676625670 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f11b8115440 msgr2=0x7f11b8175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f11bdee76c0 1 --2- 10.20.193.96:0/676625670 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f11b8115440 0x7f11b8175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.129+0000 7f11bdee76c0 1 -- 10.20.193.96:0/676625670 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b400a660 con 0x7f11b80fe850 2026-02-13T03:34:26.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7f8493fff6c0 1 -- 10.20.193.96:0/4145606229 <== mon.2 v2:10.20.193.132:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f849c007980 con 0x7f84b41131c0 2026-02-13T03:34:26.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7fb146ce56c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb14010be40 0x7fb14011a790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7fb146ce56c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb140112050 0x7fb14011acd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7fb146ce56c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb140120090 0x7fb140120530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7fb146ce56c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb140120aa0 con 0x7fb14010be40 2026-02-13T03:34:26.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7fb146ce56c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb140120c10 con 0x7fb140120090 2026-02-13T03:34:26.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7fb146ce56c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb140120dd0 con 0x7fb140112050 2026-02-13T03:34:26.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7fb144a566c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb14010be40 0x7fb14011a790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7fb144a566c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb14010be40 0x7fb14011a790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49016/0 (socket says 10.20.193.96:49016) 2026-02-13T03:34:26.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7fb144a566c0 1 -- 10.20.193.96:0/757217897 learned_addr learned my addr 10.20.193.96:0/757217897 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:26.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7fb1452576c0 1 --2- 10.20.193.96:0/757217897 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb140120090 0x7fb140120530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7ff88b7fe6c0 1 --2- 10.20.193.96:0/2404375156 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff87c0b5710 0x7ff87c0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7ff88b7fe6c0 1 -- 10.20.193.96:0/2404375156 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7ff88c0e3ae0 con 0x7ff8a4115440 2026-02-13T03:34:26.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7ff8a25756c0 1 --2- 10.20.193.96:0/2404375156 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff87c0b5710 0x7ff87c0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7f8493fff6c0 1 --2- 10.20.193.96:0/4145606229 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f84880b5710 0x7f84880d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7ff88b7fe6c0 1 --2- 10.20.193.96:0/2404375156 >> [v2:10.20.193.132:6816/2832704836,v1:10.20.193.132:6817/2832704836] conn(0x7ff87c0dccf0 0x7ff87c0fd100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7fb144a566c0 1 -- 10.20.193.96:0/757217897 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb140112050 msgr2=0x7fb14011acd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:34:26.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7fb144a566c0 1 --2- 10.20.193.96:0/757217897 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb140112050 0x7fb14011acd0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7fb144a566c0 1 -- 10.20.193.96:0/757217897 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb140120090 msgr2=0x7fb140120530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7fb144a566c0 1 --2- 10.20.193.96:0/757217897 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb140120090 0x7fb140120530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7fb144a566c0 1 -- 10.20.193.96:0/757217897 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb13c00a660 con 0x7fb14010be40 2026-02-13T03:34:26.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7ff88b7fe6c0 1 -- 10.20.193.96:0/2404375156 --> [v2:10.20.193.132:6816/2832704836,v1:10.20.193.132:6817/2832704836] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff87c0fd7b0 con 0x7ff87c0dccf0 2026-02-13T03:34:26.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7ff88b7fe6c0 1 -- 10.20.193.96:0/2404375156 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7ff88c0e3f00 con 0x7ff8a4115440 2026-02-13T03:34:26.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f84b2d766c0 1 --2- 10.20.193.96:0/4145606229 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f84880b5710 0x7f84880d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.136 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7ff8a25756c0 1 --2- 10.20.193.96:0/2404375156 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff87c0b5710 0x7ff87c0d5bc0 secure :-1 s=READY pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8980023e0 tx=0x7ff898005c20 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.136 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7ff8a2d766c0 1 --2- 10.20.193.96:0/2404375156 >> [v2:10.20.193.132:6816/2832704836,v1:10.20.193.132:6817/2832704836] conn(0x7ff87c0dccf0 0x7ff87c0fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.136 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f8493fff6c0 1 -- 10.20.193.96:0/4145606229 <== mon.2 v2:10.20.193.132:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f849c107cd0 con 0x7f84b41131c0 2026-02-13T03:34:26.136 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f8493fff6c0 1 --2- 10.20.193.96:0/4145606229 >> [v2:10.20.193.96:6826/1024808447,v1:10.20.193.96:6827/1024808447] conn(0x7f84880dccf0 0x7f84880fd100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.136 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7f4db4ea56c0 1 Processor -- start 2026-02-13T03:34:26.136 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7f4db4ea56c0 1 -- start start 2026-02-13T03:34:26.136 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f84b2d766c0 1 --2- 10.20.193.96:0/4145606229 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f84880b5710 0x7f84880d5bc0 secure :-1 s=READY pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84a8005980 tx=0x7f84a8005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.136 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7f4db4ea56c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4db010b430 0x7f4db01159c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.136 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.130+0000 7f4db4ea56c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4db010e130 0x7f4db0115f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.136 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f4db4ea56c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4db011b2c0 0x7f4db011b760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.136 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f4db4ea56c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4db011bcd0 con 0x7f4db011b2c0 2026-02-13T03:34:26.136 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f4dadd746c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4db010e130 0x7f4db0115f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.136 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f4db4ea56c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4db011be40 con 0x7f4db010b430 2026-02-13T03:34:26.136 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f4daed766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4db011b2c0 0x7f4db011b760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.136 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f4dadd746c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4db010e130 0x7f4db0115f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.133:3300/0 says I am v2:10.20.193.96:41890/0 (socket says 10.20.193.96:41890) 2026-02-13T03:34:26.136 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f4dadd746c0 1 -- 10.20.193.96:0/735698610 learned_addr learned my addr 10.20.193.96:0/735698610 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:26.136 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f4dae5756c0 1 --2- 10.20.193.96:0/735698610 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4db010b430 0x7f4db01159c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.136 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f4db4ea56c0 1 -- 10.20.193.96:0/735698610 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4db011c000 con 0x7f4db010e130 2026-02-13T03:34:26.136 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7fb144a566c0 1 --2- 10.20.193.96:0/757217897 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb14010be40 0x7fb14011a790 secure :-1 s=READY pgs=267 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb130005dc0 tx=0x7fb13000ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.137 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f11bdee76c0 1 --2- 10.20.193.96:0/676625670 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f11b80fe850 0x7f11b80fecf0 secure :-1 s=READY pgs=268 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11b40054b0 tx=0x7f11b40054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.137 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f11a67fc6c0 1 -- 10.20.193.96:0/676625670 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f11b4030d30 con 0x7f11b80fe850 2026-02-13T03:34:26.137 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f84b35776c0 1 --2- 10.20.193.96:0/4145606229 >> [v2:10.20.193.96:6826/1024808447,v1:10.20.193.96:6827/1024808447] conn(0x7f84880dccf0 0x7f84880fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.137 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f8493fff6c0 1 -- 10.20.193.96:0/4145606229 --> [v2:10.20.193.96:6826/1024808447,v1:10.20.193.96:6827/1024808447] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f84880fd7b0 con 0x7f84880dccf0 2026-02-13T03:34:26.137 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f11a67fc6c0 1 -- 10.20.193.96:0/676625670 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f11b4030e90 con 0x7f11b80fe850 2026-02-13T03:34:26.137 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f11a67fc6c0 1 -- 10.20.193.96:0/676625670 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f11b40328f0 con 0x7f11b80fe850 2026-02-13T03:34:26.137 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f11bf9756c0 1 -- 10.20.193.96:0/676625670 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11b810c2d0 con 0x7f11b80fe850 2026-02-13T03:34:26.137 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f8493fff6c0 1 -- 10.20.193.96:0/4145606229 <== mon.2 v2:10.20.193.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f849c108000 con 0x7f84b41131c0 2026-02-13T03:34:26.137 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f11bf9756c0 1 -- 10.20.193.96:0/676625670 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11b810c700 con 0x7f11b80fe850 2026-02-13T03:34:26.137 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7ff8a2d766c0 1 --2- 10.20.193.96:0/2404375156 >> [v2:10.20.193.132:6816/2832704836,v1:10.20.193.132:6817/2832704836] conn(0x7ff87c0dccf0 0x7ff87c0fd100 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.137 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f84b35776c0 1 --2- 10.20.193.96:0/4145606229 >> [v2:10.20.193.96:6826/1024808447,v1:10.20.193.96:6827/1024808447] conn(0x7f84880dccf0 0x7f84880fd100 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.137 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.132+0000 7f1187fff6c0 1 -- 10.20.193.96:0/676625670 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f117c000fe0 con 0x7f11b80fe850 2026-02-13T03:34:26.137 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f4dadd746c0 1 -- 10.20.193.96:0/735698610 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4db010b430 msgr2=0x7f4db01159c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.137 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f4dadd746c0 1 --2- 10.20.193.96:0/735698610 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4db010b430 0x7f4db01159c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f4dadd746c0 1 -- 10.20.193.96:0/735698610 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4db011b2c0 msgr2=0x7f4db011b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f4dadd746c0 1 --2- 10.20.193.96:0/735698610 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4db011b2c0 0x7f4db011b760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f4dadd746c0 1 -- 10.20.193.96:0/735698610 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d980071c0 con 0x7f4db010e130 2026-02-13T03:34:26.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f4daed766c0 1 --2- 10.20.193.96:0/735698610 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4db011b2c0 0x7f4db011b760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T03:34:26.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.131+0000 7f4dadd746c0 1 --2- 10.20.193.96:0/735698610 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4db010e130 0x7f4db0115f00 secure :-1 s=READY pgs=55 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d9800af30 tx=0x7f4d98009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.132+0000 7f4d977fe6c0 1 -- 10.20.193.96:0/735698610 <== mon.1 v2:10.20.193.133:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d98009250 con 0x7f4db010e130 2026-02-13T03:34:26.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.132+0000 7f4d977fe6c0 1 -- 10.20.193.96:0/735698610 <== mon.1 v2:10.20.193.133:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f4d9800a780 con 0x7f4db010e130 2026-02-13T03:34:26.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.132+0000 7ff88b7fe6c0 1 -- 10.20.193.96:0/2404375156 <== osd.7 v2:10.20.193.132:6816/2832704836 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7ff87c0fd7b0 con 0x7ff87c0dccf0 2026-02-13T03:34:26.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.132+0000 7f8493fff6c0 1 -- 10.20.193.96:0/4145606229 <== osd.9 v2:10.20.193.96:6826/1024808447 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f84880fd7b0 con 0x7f84880dccf0 2026-02-13T03:34:26.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.132+0000 7fb135ffb6c0 1 -- 10.20.193.96:0/757217897 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb130004030 con 0x7fb14010be40 2026-02-13T03:34:26.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.132+0000 7fb135ffb6c0 1 -- 10.20.193.96:0/757217897 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fb13000e700 con 0x7fb14010be40 2026-02-13T03:34:26.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.132+0000 7fb135ffb6c0 1 -- 10.20.193.96:0/757217897 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb130002e10 con 0x7fb14010be40 2026-02-13T03:34:26.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.132+0000 7fb146ce56c0 1 -- 10.20.193.96:0/757217897 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb140161280 con 0x7fb14010be40 2026-02-13T03:34:26.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.132+0000 7fb146ce56c0 1 -- 10.20.193.96:0/757217897 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb140161710 con 0x7fb14010be40 2026-02-13T03:34:26.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.132+0000 7f4d977fe6c0 1 -- 10.20.193.96:0/735698610 <== mon.1 v2:10.20.193.133:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d98002d00 con 0x7f4db010e130 2026-02-13T03:34:26.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.132+0000 7f4db4ea56c0 1 -- 10.20.193.96:0/735698610 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4da40094c0 con 0x7f4db010e130 2026-02-13T03:34:26.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.132+0000 7f4db4ea56c0 1 -- 10.20.193.96:0/735698610 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4db015c780 con 0x7f4db010e130 2026-02-13T03:34:26.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.133+0000 7f4db4ea56c0 1 -- 10.20.193.96:0/735698610 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4db0052a50 con 0x7f4db010e130 2026-02-13T03:34:26.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.133+0000 7fb10f7fe6c0 1 -- 10.20.193.96:0/757217897 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb100000fe0 con 0x7fb14010be40 2026-02-13T03:34:26.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.134+0000 7fb135ffb6c0 1 -- 10.20.193.96:0/757217897 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fb130004190 con 0x7fb14010be40 2026-02-13T03:34:26.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.134+0000 7f4d977fe6c0 1 -- 10.20.193.96:0/735698610 <== mon.1 v2:10.20.193.133:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f4d9800a8f0 con 0x7f4db010e130 2026-02-13T03:34:26.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.134+0000 7f11a67fc6c0 1 -- 10.20.193.96:0/676625670 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f11b4032030 con 0x7f11b80fe850 2026-02-13T03:34:26.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.134+0000 7f11a67fc6c0 1 --2- 10.20.193.96:0/676625670 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f11940b5710 0x7f11940d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.134+0000 7f11a67fc6c0 1 -- 10.20.193.96:0/676625670 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f11b4108d40 con 0x7f11b80fe850 2026-02-13T03:34:26.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.134+0000 7fb135ffb6c0 1 --2- 10.20.193.96:0/757217897 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb11c0b5790 0x7fb11c0d5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7f11a67fc6c0 1 --2- 10.20.193.96:0/676625670 >> [v2:10.20.193.96:6810/2289717362,v1:10.20.193.96:6811/2289717362] conn(0x7f11940dccf0 0x7f11940fd100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7fb135ffb6c0 1 -- 10.20.193.96:0/757217897 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7fb1300e5e60 con 0x7fb14010be40 2026-02-13T03:34:26.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7f11a67fc6c0 1 -- 10.20.193.96:0/676625670 --> [v2:10.20.193.96:6810/2289717362,v1:10.20.193.96:6811/2289717362] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11940fd7b0 con 0x7f11940dccf0 2026-02-13T03:34:26.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7f11a67fc6c0 1 -- 10.20.193.96:0/676625670 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f11b41090f0 con 0x7f11b80fe850 2026-02-13T03:34:26.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7fb135ffb6c0 1 --2- 10.20.193.96:0/757217897 >> [v2:10.20.193.96:6818/4035362295,v1:10.20.193.96:6819/4035362295] conn(0x7fb11c0dcd70 0x7fb11c0fd180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7f11bcee56c0 1 --2- 10.20.193.96:0/676625670 >> [v2:10.20.193.96:6810/2289717362,v1:10.20.193.96:6811/2289717362] conn(0x7f11940dccf0 0x7f11940fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7fb135ffb6c0 1 -- 10.20.193.96:0/757217897 --> [v2:10.20.193.96:6818/4035362295,v1:10.20.193.96:6819/4035362295] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb11c0fd830 con 0x7fb11c0dcd70 2026-02-13T03:34:26.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7fb135ffb6c0 1 -- 10.20.193.96:0/757217897 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7fb1300e6190 con 0x7fb14010be40 2026-02-13T03:34:26.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7fb1452576c0 1 --2- 10.20.193.96:0/757217897 >> [v2:10.20.193.96:6818/4035362295,v1:10.20.193.96:6819/4035362295] conn(0x7fb11c0dcd70 0x7fb11c0fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7f11bcee56c0 1 --2- 10.20.193.96:0/676625670 >> [v2:10.20.193.96:6810/2289717362,v1:10.20.193.96:6811/2289717362] conn(0x7f11940dccf0 0x7f11940fd100 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7f4d977fe6c0 1 --2- 10.20.193.96:0/735698610 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4d880b5590 0x7f4d880d5a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7fb1452576c0 1 --2- 10.20.193.96:0/757217897 >> [v2:10.20.193.96:6818/4035362295,v1:10.20.193.96:6819/4035362295] conn(0x7fb11c0dcd70 0x7fb11c0fd180 crc :-1 s=READY pgs=10 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7f4d977fe6c0 1 -- 10.20.193.96:0/735698610 <== mon.1 v2:10.20.193.133:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f4d980e3d10 con 0x7f4db010e130 2026-02-13T03:34:26.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7f4d977fe6c0 1 --2- 10.20.193.96:0/735698610 >> [v2:10.20.193.133:6816/3678366387,v1:10.20.193.133:6817/3678366387] conn(0x7f4d880dca00 0x7f4d880fce10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7efdd1f106c0 1 -- 10.20.193.96:0/3435108866 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efdcc153420 msgr2=0x7efdcc173800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7efdd1f106c0 1 --2- 10.20.193.96:0/3435108866 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efdcc153420 0x7efdcc173800 secure :-1 s=READY pgs=56 gs=1 cs=0 l=1 c_cookie=13881319370456202154 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdc000aa40 tx=0x7efdc002fe30 comp rx=0 tx=0).stop 2026-02-13T03:34:26.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7efdd1f106c0 1 -- 10.20.193.96:0/3435108866 shutdown_connections 2026-02-13T03:34:26.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7efdd1f106c0 1 --2- 10.20.193.96:0/3435108866 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efdcc153420 0x7efdcc173800 unknown :-1 s=CLOSED pgs=56 gs=1 cs=0 l=1 c_cookie=13881319370456202154 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7efdd1f106c0 1 --2- 10.20.193.96:0/3435108866 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efdcc10bb00 0x7efdcc152ee0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7efdd1f106c0 1 --2- 10.20.193.96:0/3435108866 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efdcc10b1f0 0x7efdcc10b5c0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7efdd1f106c0 1 -- 10.20.193.96:0/3435108866 >> 10.20.193.96:0/3435108866 conn(0x7efdcc063af0 msgr2=0x7efdcc0642b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7efdd1f106c0 1 -- 10.20.193.96:0/3435108866 shutdown_connections 2026-02-13T03:34:26.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7efdd1f106c0 1 -- 10.20.193.96:0/3435108866 wait complete. 2026-02-13T03:34:26.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7efdd1f106c0 1 Processor -- start 2026-02-13T03:34:26.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7efdd1f106c0 1 -- start start 2026-02-13T03:34:26.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.135+0000 7f11a67fc6c0 1 -- 10.20.193.96:0/676625670 <== osd.3 v2:10.20.193.96:6810/2289717362 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f11940fd7b0 con 0x7f11940dccf0 2026-02-13T03:34:26.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.136+0000 7f4d977fe6c0 1 -- 10.20.193.96:0/735698610 --> [v2:10.20.193.133:6816/3678366387,v1:10.20.193.133:6817/3678366387] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4d880fd4c0 con 0x7f4d880dca00 2026-02-13T03:34:26.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.136+0000 7f4d977fe6c0 1 -- 10.20.193.96:0/735698610 <== mon.1 v2:10.20.193.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f4d980e40c0 con 0x7f4db010e130 2026-02-13T03:34:26.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.136+0000 7efdd1f106c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efdcc10b1f0 0x7efdcc15f130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.136+0000 7efdd1f106c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efdcc10bb00 0x7efdcc15f670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.136+0000 7fb135ffb6c0 1 -- 10.20.193.96:0/757217897 <== osd.6 v2:10.20.193.96:6818/4035362295 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fb11c0fd830 con 0x7fb11c0dcd70 2026-02-13T03:34:26.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.136+0000 7efdd1f106c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efdcc153420 0x7efdcc1649e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.136+0000 7efdcaffd6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efdcc10bb00 0x7efdcc15f670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.136+0000 7efdcaffd6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efdcc10bb00 0x7efdcc15f670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.132:3300/0 says I am v2:10.20.193.96:36314/0 (socket says 10.20.193.96:36314) 2026-02-13T03:34:26.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.136+0000 7efdcb7fe6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efdcc10b1f0 0x7efdcc15f130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.136+0000 7efdcb7fe6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efdcc10b1f0 0x7efdcc15f130 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.133:3300/0 says I am v2:10.20.193.96:41910/0 (socket says 10.20.193.96:41910) 2026-02-13T03:34:26.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.136+0000 7efdcbfff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efdcc153420 0x7efdcc1649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.136+0000 7efdcbfff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efdcc153420 0x7efdcc1649e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49032/0 (socket says 10.20.193.96:49032) 2026-02-13T03:34:26.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.136+0000 7efdd1f106c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc165030 con 0x7efdcc153420 2026-02-13T03:34:26.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.136+0000 7efdcaffd6c0 1 -- 10.20.193.96:0/2961938436 learned_addr learned my addr 10.20.193.96:0/2961938436 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:26.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.136+0000 7efdd1f106c0 1 -- 10.20.193.96:0/2961938436 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc1651a0 con 0x7efdcc10bb00 2026-02-13T03:34:26.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.136+0000 7efdd1f106c0 1 -- 10.20.193.96:0/2961938436 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc165360 con 0x7efdcc10b1f0 2026-02-13T03:34:26.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.136+0000 7efdcb7fe6c0 1 -- 10.20.193.96:0/2961938436 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efdcc10bb00 msgr2=0x7efdcc15f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.136+0000 7efdcb7fe6c0 1 --2- 10.20.193.96:0/2961938436 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efdcc10bb00 0x7efdcc15f670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.136+0000 7efdcb7fe6c0 1 -- 10.20.193.96:0/2961938436 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efdcc153420 msgr2=0x7efdcc1649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.136+0000 7efdcb7fe6c0 1 --2- 10.20.193.96:0/2961938436 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efdcc153420 0x7efdcc1649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.136+0000 7efdcb7fe6c0 1 -- 10.20.193.96:0/2961938436 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc000a660 con 0x7efdcc10b1f0 2026-02-13T03:34:26.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.136+0000 7efdcbfff6c0 1 --2- 10.20.193.96:0/2961938436 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efdcc153420 0x7efdcc1649e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T03:34:26.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.137+0000 7efdcb7fe6c0 1 --2- 10.20.193.96:0/2961938436 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efdcc10b1f0 0x7efdcc15f130 secure :-1 s=READY pgs=57 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdb800b420 tx=0x7efdb800b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.137+0000 7efdc8ff96c0 1 -- 10.20.193.96:0/2961938436 <== mon.1 v2:10.20.193.133:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efdb80044a0 con 0x7efdcc10b1f0 2026-02-13T03:34:26.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.137+0000 7efdd1f106c0 1 -- 10.20.193.96:0/2961938436 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdcc165640 con 0x7efdcc10b1f0 2026-02-13T03:34:26.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.137+0000 7efdc8ff96c0 1 -- 10.20.193.96:0/2961938436 <== mon.1 v2:10.20.193.133:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7efdb8004600 con 0x7efdcc10b1f0 2026-02-13T03:34:26.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.137+0000 7efdc8ff96c0 1 -- 10.20.193.96:0/2961938436 <== mon.1 v2:10.20.193.133:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efdb800cbb0 con 0x7efdcc10b1f0 2026-02-13T03:34:26.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.137+0000 7efdd1f106c0 1 -- 10.20.193.96:0/2961938436 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdcc10ce20 con 0x7efdcc10b1f0 2026-02-13T03:34:26.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.137+0000 7efdd1f106c0 1 -- 10.20.193.96:0/2961938436 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efdcc052a50 con 0x7efdcc10b1f0 2026-02-13T03:34:26.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.137+0000 7f4daed766c0 1 --2- 10.20.193.96:0/735698610 >> [v2:10.20.193.133:6816/3678366387,v1:10.20.193.133:6817/3678366387] conn(0x7f4d880dca00 0x7f4d880fce10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.139+0000 7efdc8ff96c0 1 -- 10.20.193.96:0/2961938436 <== mon.1 v2:10.20.193.133:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7efdb8002770 con 0x7efdcc10b1f0 2026-02-13T03:34:26.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.140+0000 7efdc8ff96c0 1 --2- 10.20.193.96:0/2961938436 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efda00b5710 0x7efda00d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.139+0000 7f4daed766c0 1 --2- 10.20.193.96:0/735698610 >> [v2:10.20.193.133:6816/3678366387,v1:10.20.193.133:6817/3678366387] conn(0x7f4d880dca00 0x7f4d880fce10 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.140+0000 7efdc8ff96c0 1 -- 10.20.193.96:0/2961938436 <== mon.1 v2:10.20.193.133:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7efdb80e3810 con 0x7efdcc10b1f0 2026-02-13T03:34:26.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.140+0000 7f4d977fe6c0 1 -- 10.20.193.96:0/735698610 <== osd.8 v2:10.20.193.133:6816/3678366387 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f4d880fd4c0 con 0x7f4d880dca00 2026-02-13T03:34:26.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.140+0000 7f84b913c6c0 1 -- 10.20.193.96:0/4145606229 --> [v2:10.20.193.96:6826/1024808447,v1:10.20.193.96:6827/1024808447] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f84b4052a50 con 0x7f84880dccf0 2026-02-13T03:34:26.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.140+0000 7efdc8ff96c0 1 --2- 10.20.193.96:0/2961938436 >> [v2:10.20.193.133:6800/4145071410,v1:10.20.193.133:6801/4145071410] conn(0x7efda00dccf0 0x7efda00fd100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.140+0000 7efdc8ff96c0 1 -- 10.20.193.96:0/2961938436 --> [v2:10.20.193.133:6800/4145071410,v1:10.20.193.133:6801/4145071410] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efda00fd7b0 con 0x7efda00dccf0 2026-02-13T03:34:26.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.140+0000 7efdc8ff96c0 1 -- 10.20.193.96:0/2961938436 <== mon.1 v2:10.20.193.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7efdb80e3b40 con 0x7efdcc10b1f0 2026-02-13T03:34:26.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.140+0000 7efdcbfff6c0 1 --2- 10.20.193.96:0/2961938436 >> [v2:10.20.193.133:6800/4145071410,v1:10.20.193.133:6801/4145071410] conn(0x7efda00dccf0 0x7efda00fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.140+0000 7f8493fff6c0 1 -- 10.20.193.96:0/4145606229 <== osd.9 v2:10.20.193.96:6826/1024808447 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f84b4052a50 con 0x7f84880dccf0 2026-02-13T03:34:26.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.140+0000 7f84b913c6c0 1 -- 10.20.193.96:0/4145606229 >> [v2:10.20.193.96:6826/1024808447,v1:10.20.193.96:6827/1024808447] conn(0x7f84880dccf0 msgr2=0x7f84880fd100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.140+0000 7f84b913c6c0 1 --2- 10.20.193.96:0/4145606229 >> [v2:10.20.193.96:6826/1024808447,v1:10.20.193.96:6827/1024808447] conn(0x7f84880dccf0 0x7f84880fd100 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.140+0000 7f84b913c6c0 1 -- 10.20.193.96:0/4145606229 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f84880b5710 msgr2=0x7f84880d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.140+0000 7f84b913c6c0 1 --2- 10.20.193.96:0/4145606229 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f84880b5710 0x7f84880d5bc0 secure :-1 s=READY pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84a8005980 tx=0x7f84a8005910 comp rx=0 tx=0).stop 2026-02-13T03:34:26.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.141+0000 7f84b913c6c0 1 -- 10.20.193.96:0/4145606229 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f84b41131c0 msgr2=0x7f84b4060c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.141+0000 7f84b913c6c0 1 --2- 10.20.193.96:0/4145606229 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f84b41131c0 0x7f84b4060c40 secure :-1 s=READY pgs=50 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f849c005b40 tx=0x7f849c02fc60 comp rx=0 tx=0).stop 2026-02-13T03:34:26.144 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.141+0000 7f84b35776c0 1 -- 10.20.193.96:0/4145606229 reap_dead start 2026-02-13T03:34:26.144 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.141+0000 7f84b913c6c0 1 -- 10.20.193.96:0/4145606229 shutdown_connections 2026-02-13T03:34:26.144 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.141+0000 7f84b913c6c0 1 -- 10.20.193.96:0/4145606229 >> 10.20.193.96:0/4145606229 conn(0x7f84b40ea8b0 msgr2=0x7f84b410ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.144 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.141+0000 7f84b913c6c0 1 -- 10.20.193.96:0/4145606229 shutdown_connections 2026-02-13T03:34:26.144 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.141+0000 7f84b913c6c0 1 -- 10.20.193.96:0/4145606229 wait complete. 2026-02-13T03:34:26.144 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.142+0000 7efdcbfff6c0 1 --2- 10.20.193.96:0/2961938436 >> [v2:10.20.193.133:6800/4145071410,v1:10.20.193.133:6801/4145071410] conn(0x7efda00dccf0 0x7efda00fd100 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.144 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.142+0000 7fb137fff6c0 1 --2- 10.20.193.96:0/757217897 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb11c0b5790 0x7fb11c0d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.144 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.142+0000 7f4dae5756c0 1 --2- 10.20.193.96:0/735698610 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4d880b5590 0x7f4d880d5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.142+0000 7faa12d4c6c0 1 -- 10.20.193.96:0/2863539915 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faa0c10fc20 msgr2=0x7faa0c114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.142+0000 7faa12d4c6c0 1 --2- 10.20.193.96:0/2863539915 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faa0c10fc20 0x7faa0c114c60 secure :-1 s=READY pgs=269 gs=1 cs=0 l=1 c_cookie=2761712527415336182 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9f40099a0 tx=0x7fa9f402ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:26.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.142+0000 7efdcaffd6c0 1 --2- 10.20.193.96:0/2961938436 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efda00b5710 0x7efda00d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.142+0000 7f11bd6e66c0 1 --2- 10.20.193.96:0/676625670 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f11940b5710 0x7f11940d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.142+0000 7fb137fff6c0 1 --2- 10.20.193.96:0/757217897 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb11c0b5790 0x7fb11c0d5c40 secure :-1 s=READY pgs=190 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb140121120 tx=0x7fb1280093b0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.142+0000 7fa602b746c0 1 -- 10.20.193.96:0/3057112915 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa5fc115440 msgr2=0x7fa5fc175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.142+0000 7fa602b746c0 1 --2- 10.20.193.96:0/3057112915 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa5fc115440 0x7fa5fc175de0 secure :-1 s=READY pgs=270 gs=1 cs=0 l=1 c_cookie=2719816601770133096 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5f800a9b0 tx=0x7fa5f802fd40 comp rx=0 tx=0).stop 2026-02-13T03:34:26.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.142+0000 7efdc8ff96c0 1 -- 10.20.193.96:0/2961938436 <== osd.2 v2:10.20.193.133:6800/4145071410 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7efda00fd7b0 con 0x7efda00dccf0 2026-02-13T03:34:26.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.142+0000 7efdcaffd6c0 1 --2- 10.20.193.96:0/2961938436 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efda00b5710 0x7efda00d5bc0 secure :-1 s=READY pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdcc165a70 tx=0x7efdbc00d720 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.142+0000 7f11bd6e66c0 1 --2- 10.20.193.96:0/676625670 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f11940b5710 0x7f11940d5bc0 secure :-1 s=READY pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11a8009240 tx=0x7f11a8009420 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.142+0000 7faa12d4c6c0 1 -- 10.20.193.96:0/2863539915 shutdown_connections 2026-02-13T03:34:26.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.142+0000 7faa12d4c6c0 1 --2- 10.20.193.96:0/2863539915 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7faa0c115440 0x7faa0c175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.142+0000 7faa12d4c6c0 1 --2- 10.20.193.96:0/2863539915 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faa0c10fc20 0x7faa0c114c60 unknown :-1 s=CLOSED pgs=269 gs=1 cs=0 l=1 c_cookie=2761712527415336182 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.142+0000 7faa12d4c6c0 1 --2- 10.20.193.96:0/2863539915 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7faa0c10f230 0x7faa0c10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.142+0000 7faa12d4c6c0 1 -- 10.20.193.96:0/2863539915 >> 10.20.193.96:0/2863539915 conn(0x7faa0c0ecb30 msgr2=0x7faa0c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.142+0000 7f4dae5756c0 1 --2- 10.20.193.96:0/735698610 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4d880b5590 0x7f4d880d5a40 secure :-1 s=READY pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da40098d0 tx=0x7f4da40023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.142+0000 7ff8a8f236c0 1 -- 10.20.193.96:0/2404375156 --> [v2:10.20.193.132:6816/2832704836,v1:10.20.193.132:6817/2832704836] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff8a41793a0 con 0x7ff87c0dccf0 2026-02-13T03:34:26.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.142+0000 7faa12d4c6c0 1 -- 10.20.193.96:0/2863539915 shutdown_connections 2026-02-13T03:34:26.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7ff88b7fe6c0 1 -- 10.20.193.96:0/2404375156 <== osd.7 v2:10.20.193.132:6816/2832704836 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff8a41793a0 con 0x7ff87c0dccf0 2026-02-13T03:34:26.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.142+0000 7faa12d4c6c0 1 -- 10.20.193.96:0/2863539915 wait complete. 2026-02-13T03:34:26.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7faa12d4c6c0 1 Processor -- start 2026-02-13T03:34:26.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7fa602b746c0 1 -- 10.20.193.96:0/3057112915 shutdown_connections 2026-02-13T03:34:26.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7fa602b746c0 1 --2- 10.20.193.96:0/3057112915 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa5fc115440 0x7fa5fc175de0 unknown :-1 s=CLOSED pgs=270 gs=1 cs=0 l=1 c_cookie=2719816601770133096 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7fa602b746c0 1 --2- 10.20.193.96:0/3057112915 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa5fc10fc20 0x7fa5fc114c60 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7fa602b746c0 1 --2- 10.20.193.96:0/3057112915 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa5fc10f230 0x7fa5fc10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7fa602b746c0 1 -- 10.20.193.96:0/3057112915 >> 10.20.193.96:0/3057112915 conn(0x7fa5fc0ecb30 msgr2=0x7fa5fc10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7fa602b746c0 1 -- 10.20.193.96:0/3057112915 shutdown_connections 2026-02-13T03:34:26.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7faa12d4c6c0 1 -- start start 2026-02-13T03:34:26.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7fa602b746c0 1 -- 10.20.193.96:0/3057112915 wait complete. 2026-02-13T03:34:26.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7faa12d4c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faa0c10f230 0x7faa0c05e450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7faa12d4c6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7faa0c115440 0x7faa0c175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7faa12d4c6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7faa0c05cb90 0x7faa0c05d030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7ff8a8f236c0 1 -- 10.20.193.96:0/2404375156 >> [v2:10.20.193.132:6816/2832704836,v1:10.20.193.132:6817/2832704836] conn(0x7ff87c0dccf0 msgr2=0x7ff87c0fd100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7ff8a8f236c0 1 --2- 10.20.193.96:0/2404375156 >> [v2:10.20.193.132:6816/2832704836,v1:10.20.193.132:6817/2832704836] conn(0x7ff87c0dccf0 0x7ff87c0fd100 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7faa12d4c6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c05d680 con 0x7faa0c10f230 2026-02-13T03:34:26.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7faa10abd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faa0c10f230 0x7faa0c05e450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7faa12d4c6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c05d7f0 con 0x7faa0c115440 2026-02-13T03:34:26.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7faa12d4c6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c05d9b0 con 0x7faa0c05cb90 2026-02-13T03:34:26.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7faa10abd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faa0c10f230 0x7faa0c05e450 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49062/0 (socket says 10.20.193.96:49062) 2026-02-13T03:34:26.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7ff8a8f236c0 1 -- 10.20.193.96:0/2404375156 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff87c0b5710 msgr2=0x7ff87c0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7ff8a8f236c0 1 --2- 10.20.193.96:0/2404375156 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff87c0b5710 0x7ff87c0d5bc0 secure :-1 s=READY pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8980023e0 tx=0x7ff898005c20 comp rx=0 tx=0).stop 2026-02-13T03:34:26.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7faa10abd6c0 1 -- 10.20.193.96:0/3346383246 learned_addr learned my addr 10.20.193.96:0/3346383246 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:26.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7faa03fff6c0 1 --2- 10.20.193.96:0/3346383246 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7faa0c115440 0x7faa0c175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7ff8a8f236c0 1 -- 10.20.193.96:0/2404375156 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8a4115440 msgr2=0x7ff8a411d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7ff8a8f236c0 1 --2- 10.20.193.96:0/2404375156 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8a4115440 0x7ff8a411d7c0 secure :-1 s=READY pgs=265 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff88c005dc0 tx=0x7ff88c00bbb0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7ff8a2d766c0 1 -- 10.20.193.96:0/2404375156 reap_dead start 2026-02-13T03:34:26.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7ff8a8f236c0 1 -- 10.20.193.96:0/2404375156 shutdown_connections 2026-02-13T03:34:26.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7ff8a8f236c0 1 -- 10.20.193.96:0/2404375156 >> 10.20.193.96:0/2404375156 conn(0x7ff8a40ecb30 msgr2=0x7ff8a410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7faa112be6c0 1 --2- 10.20.193.96:0/3346383246 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7faa0c05cb90 0x7faa0c05d030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7faa10abd6c0 1 -- 10.20.193.96:0/3346383246 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7faa0c05cb90 msgr2=0x7faa0c05d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7faa10abd6c0 1 --2- 10.20.193.96:0/3346383246 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7faa0c05cb90 0x7faa0c05d030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7faa10abd6c0 1 -- 10.20.193.96:0/3346383246 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7faa0c115440 msgr2=0x7faa0c175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7faa10abd6c0 1 --2- 10.20.193.96:0/3346383246 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7faa0c115440 0x7faa0c175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7faa10abd6c0 1 -- 10.20.193.96:0/3346383246 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f4009590 con 0x7faa0c10f230 2026-02-13T03:34:26.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7ff8a8f236c0 1 -- 10.20.193.96:0/2404375156 shutdown_connections 2026-02-13T03:34:26.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7ff8a8f236c0 1 -- 10.20.193.96:0/2404375156 wait complete. 2026-02-13T03:34:26.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7faa10abd6c0 1 --2- 10.20.193.96:0/3346383246 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faa0c10f230 0x7faa0c05e450 secure :-1 s=READY pgs=272 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9fc00b710 tx=0x7fa9fc00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7fa602b746c0 1 Processor -- start 2026-02-13T03:34:26.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7faa01ffb6c0 1 -- 10.20.193.96:0/3346383246 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9fc004250 con 0x7faa0c10f230 2026-02-13T03:34:26.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.143+0000 7fa602b746c0 1 -- start start 2026-02-13T03:34:26.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7faa12d4c6c0 1 -- 10.20.193.96:0/3346383246 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa0c107f30 con 0x7faa0c10f230 2026-02-13T03:34:26.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7faa12d4c6c0 1 -- 10.20.193.96:0/3346383246 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa0c108430 con 0x7faa0c10f230 2026-02-13T03:34:26.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fa602b746c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa5fc10f230 0x7fa5fc066730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fa602b746c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa5fc115440 0x7fa5fc175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fa602b746c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa5fc062990 0x7fa5fc062e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fb10f7fe6c0 1 -- 10.20.193.96:0/757217897 --> [v2:10.20.193.96:6818/4035362295,v1:10.20.193.96:6819/4035362295] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb100002d20 con 0x7fb11c0dcd70 2026-02-13T03:34:26.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fa602b746c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc0635a0 con 0x7fa5fc10f230 2026-02-13T03:34:26.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fa602b746c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc063710 con 0x7fa5fc115440 2026-02-13T03:34:26.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fa602b746c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc0ff290 con 0x7fa5fc062990 2026-02-13T03:34:26.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7f047f8286c0 1 -- 10.20.193.96:0/1684926750 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f047810fc20 msgr2=0x7f0478114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fa6010ea6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa5fc062990 0x7fa5fc062e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fa6010ea6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa5fc062990 0x7fa5fc062e10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.133:3300/0 says I am v2:10.20.193.96:41962/0 (socket says 10.20.193.96:41962) 2026-02-13T03:34:26.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fa6010ea6c0 1 -- 10.20.193.96:0/3894490995 learned_addr learned my addr 10.20.193.96:0/3894490995 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:26.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7f047f8286c0 1 --2- 10.20.193.96:0/1684926750 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f047810fc20 0x7f0478114c60 secure :-1 s=READY pgs=271 gs=1 cs=0 l=1 c_cookie=8614186095039127360 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f046c0099a0 tx=0x7f046c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:26.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fa5f3fff6c0 1 --2- 10.20.193.96:0/3894490995 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa5fc115440 0x7fa5fc175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fa6008e96c0 1 --2- 10.20.193.96:0/3894490995 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa5fc10f230 0x7fa5fc066730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fb135ffb6c0 1 -- 10.20.193.96:0/757217897 <== osd.6 v2:10.20.193.96:6818/4035362295 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb100002d20 con 0x7fb11c0dcd70 2026-02-13T03:34:26.150 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fa6010ea6c0 1 -- 10.20.193.96:0/3894490995 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa5fc115440 msgr2=0x7fa5fc175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.150 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fa6010ea6c0 1 --2- 10.20.193.96:0/3894490995 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa5fc115440 0x7fa5fc175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.150 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fa6010ea6c0 1 -- 10.20.193.96:0/3894490995 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa5fc10f230 msgr2=0x7fa5fc066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.150 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fa6010ea6c0 1 --2- 10.20.193.96:0/3894490995 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa5fc10f230 0x7fa5fc066730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.150 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fa6010ea6c0 1 -- 10.20.193.96:0/3894490995 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f800a5b0 con 0x7fa5fc062990 2026-02-13T03:34:26.150 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fa5f3fff6c0 1 --2- 10.20.193.96:0/3894490995 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa5fc115440 0x7fa5fc175ce0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:34:26.150 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fa6008e96c0 1 --2- 10.20.193.96:0/3894490995 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa5fc10f230 0x7fa5fc066730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T03:34:26.150 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7faa01ffb6c0 1 -- 10.20.193.96:0/3346383246 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fa9fc002da0 con 0x7faa0c10f230 2026-02-13T03:34:26.150 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7faa01ffb6c0 1 -- 10.20.193.96:0/3346383246 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9fc00ce30 con 0x7faa0c10f230 2026-02-13T03:34:26.150 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fb10f7fe6c0 1 -- 10.20.193.96:0/757217897 >> [v2:10.20.193.96:6818/4035362295,v1:10.20.193.96:6819/4035362295] conn(0x7fb11c0dcd70 msgr2=0x7fb11c0fd180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.150 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fb10f7fe6c0 1 --2- 10.20.193.96:0/757217897 >> [v2:10.20.193.96:6818/4035362295,v1:10.20.193.96:6819/4035362295] conn(0x7fb11c0dcd70 0x7fb11c0fd180 crc :-1 s=READY pgs=10 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.150 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fa9db7fe6c0 1 -- 10.20.193.96:0/3346383246 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa9cc000fe0 con 0x7faa0c10f230 2026-02-13T03:34:26.150 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fa6010ea6c0 1 --2- 10.20.193.96:0/3894490995 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa5fc062990 0x7fa5fc062e10 secure :-1 s=READY pgs=58 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5f800a2e0 tx=0x7fa5f8031c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.150 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fb10f7fe6c0 1 -- 10.20.193.96:0/757217897 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb11c0b5790 msgr2=0x7fb11c0d5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.150 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fb10f7fe6c0 1 --2- 10.20.193.96:0/757217897 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb11c0b5790 0x7fb11c0d5c40 secure :-1 s=READY pgs=190 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb140121120 tx=0x7fb1280093b0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.151 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fb10f7fe6c0 1 -- 10.20.193.96:0/757217897 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb14010be40 msgr2=0x7fb14011a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.151 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fb10f7fe6c0 1 --2- 10.20.193.96:0/757217897 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb14010be40 0x7fb14011a790 secure :-1 s=READY pgs=267 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb130005dc0 tx=0x7fb13000ded0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.151 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7fb1452576c0 1 -- 10.20.193.96:0/757217897 reap_dead start 2026-02-13T03:34:26.151 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7fb10f7fe6c0 1 -- 10.20.193.96:0/757217897 shutdown_connections 2026-02-13T03:34:26.151 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7fb10f7fe6c0 1 -- 10.20.193.96:0/757217897 >> 10.20.193.96:0/757217897 conn(0x7fb1400e9700 msgr2=0x7fb140109ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.151 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7f047f8286c0 1 -- 10.20.193.96:0/1684926750 shutdown_connections 2026-02-13T03:34:26.151 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7f047f8286c0 1 --2- 10.20.193.96:0/1684926750 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0478115440 0x7f0478175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.151 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7f047f8286c0 1 --2- 10.20.193.96:0/1684926750 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f047810fc20 0x7f0478114c60 unknown :-1 s=CLOSED pgs=271 gs=1 cs=0 l=1 c_cookie=8614186095039127360 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.151 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.144+0000 7f047f8286c0 1 --2- 10.20.193.96:0/1684926750 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f047810f230 0x7f047810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.151 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7f047f8286c0 1 -- 10.20.193.96:0/1684926750 >> 10.20.193.96:0/1684926750 conn(0x7f04780ecb30 msgr2=0x7f047810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.151 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7f047f8286c0 1 -- 10.20.193.96:0/1684926750 shutdown_connections 2026-02-13T03:34:26.151 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7f047f8286c0 1 -- 10.20.193.96:0/1684926750 wait complete. 2026-02-13T03:34:26.151 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7fa5f1ffb6c0 1 -- 10.20.193.96:0/3894490995 <== mon.1 v2:10.20.193.133:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5f8003ce0 con 0x7fa5fc062990 2026-02-13T03:34:26.151 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7fb10f7fe6c0 1 -- 10.20.193.96:0/757217897 shutdown_connections 2026-02-13T03:34:26.151 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7fa5f1ffb6c0 1 -- 10.20.193.96:0/3894490995 <== mon.1 v2:10.20.193.133:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fa5f8031e80 con 0x7fa5fc062990 2026-02-13T03:34:26.151 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7fa5f1ffb6c0 1 -- 10.20.193.96:0/3894490995 <== mon.1 v2:10.20.193.133:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5f8039360 con 0x7fa5fc062990 2026-02-13T03:34:26.151 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7fa602b746c0 1 -- 10.20.193.96:0/3894490995 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5fc0ff510 con 0x7fa5fc062990 2026-02-13T03:34:26.151 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7fb10f7fe6c0 1 -- 10.20.193.96:0/757217897 wait complete. 2026-02-13T03:34:26.151 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7fa602b746c0 1 -- 10.20.193.96:0/3894490995 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5fc0ff990 con 0x7fa5fc062990 2026-02-13T03:34:26.151 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7f047f8286c0 1 Processor -- start 2026-02-13T03:34:26.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7f047f8286c0 1 -- start start 2026-02-13T03:34:26.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7f047f8286c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f047810f230 0x7f047817d500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7f047f8286c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0478115440 0x7f047817da40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7f047f8286c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0478059200 0x7f04780596a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7f047f8286c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0478059c10 con 0x7f0478115440 2026-02-13T03:34:26.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7f047f8286c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0478059d80 con 0x7f047810f230 2026-02-13T03:34:26.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7f047f8286c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0478059f40 con 0x7f0478059200 2026-02-13T03:34:26.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7f047cd986c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0478115440 0x7f047817da40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7f047cd986c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0478115440 0x7f047817da40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49094/0 (socket says 10.20.193.96:49094) 2026-02-13T03:34:26.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7f047cd986c0 1 -- 10.20.193.96:0/639025768 learned_addr learned my addr 10.20.193.96:0/639025768 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:26.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7f047dd9a6c0 1 --2- 10.20.193.96:0/639025768 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0478059200 0x7f04780596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7fa5cb7fe6c0 1 -- 10.20.193.96:0/3894490995 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa5bc000fe0 con 0x7fa5fc062990 2026-02-13T03:34:26.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7f047cd986c0 1 -- 10.20.193.96:0/639025768 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0478059200 msgr2=0x7f04780596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7f047cd986c0 1 --2- 10.20.193.96:0/639025768 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0478059200 0x7f04780596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7f047cd986c0 1 -- 10.20.193.96:0/639025768 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f047810f230 msgr2=0x7f047817d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7f047cd986c0 1 --2- 10.20.193.96:0/639025768 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f047810f230 0x7f047817d500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7f047cd986c0 1 -- 10.20.193.96:0/639025768 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046c009590 con 0x7f0478115440 2026-02-13T03:34:26.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7f047cd986c0 1 --2- 10.20.193.96:0/639025768 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0478115440 0x7f047817da40 secure :-1 s=READY pgs=273 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f046c02fb20 tx=0x7f046c002980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7f04667fc6c0 1 -- 10.20.193.96:0/639025768 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f046c02fdd0 con 0x7f0478115440 2026-02-13T03:34:26.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7fa2d5f776c0 1 -- 10.20.193.96:0/68146751 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa2d01137a0 msgr2=0x7fa2d0113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7fa2d5f776c0 1 --2- 10.20.193.96:0/68146751 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa2d01137a0 0x7fa2d0113b70 secure :-1 s=READY pgs=52 gs=2 cs=0 l=1 c_cookie=15404709930452950540 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2bc0098a0 tx=0x7fa2bc02ec40 comp rx=0 tx=0).stop 2026-02-13T03:34:26.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7f047f8286c0 1 -- 10.20.193.96:0/639025768 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f047805a350 con 0x7f0478115440 2026-02-13T03:34:26.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7f047f8286c0 1 -- 10.20.193.96:0/639025768 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f047805a780 con 0x7f0478115440 2026-02-13T03:34:26.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7f04667fc6c0 1 -- 10.20.193.96:0/639025768 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f046c0046b0 con 0x7f0478115440 2026-02-13T03:34:26.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7f04667fc6c0 1 -- 10.20.193.96:0/639025768 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f046c0312b0 con 0x7f0478115440 2026-02-13T03:34:26.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7fa2d5f776c0 1 -- 10.20.193.96:0/68146751 shutdown_connections 2026-02-13T03:34:26.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7fa2d5f776c0 1 --2- 10.20.193.96:0/68146751 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa2d01198f0 0x7fa2d017a2c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7fa2d5f776c0 1 --2- 10.20.193.96:0/68146751 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa2d0114190 0x7fa2d0119140 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7fa2d5f776c0 1 --2- 10.20.193.96:0/68146751 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa2d01137a0 0x7fa2d0113b70 unknown :-1 s=CLOSED pgs=52 gs=2 cs=0 l=1 c_cookie=15404709930452950540 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7fa2d5f776c0 1 -- 10.20.193.96:0/68146751 >> 10.20.193.96:0/68146751 conn(0x7fa2d0060760 msgr2=0x7fa2d0060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7fa2d5f776c0 1 -- 10.20.193.96:0/68146751 shutdown_connections 2026-02-13T03:34:26.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7fa2d5f776c0 1 -- 10.20.193.96:0/68146751 wait complete. 2026-02-13T03:34:26.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7f047f8286c0 1 -- 10.20.193.96:0/639025768 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0478052a50 con 0x7f0478115440 2026-02-13T03:34:26.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7fa2d5f776c0 1 Processor -- start 2026-02-13T03:34:26.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7fa2d5f776c0 1 -- start start 2026-02-13T03:34:26.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7faa01ffb6c0 1 -- 10.20.193.96:0/3346383246 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fa9fc00c410 con 0x7faa0c10f230 2026-02-13T03:34:26.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7faa01ffb6c0 1 --2- 10.20.193.96:0/3346383246 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa9e80b5590 0x7fa9e80d5a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7faa01ffb6c0 1 -- 10.20.193.96:0/3346383246 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7fa9fc0e3c30 con 0x7faa0c10f230 2026-02-13T03:34:26.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7faa03fff6c0 1 --2- 10.20.193.96:0/3346383246 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa9e80b5590 0x7fa9e80d5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7faa01ffb6c0 1 --2- 10.20.193.96:0/3346383246 >> [v2:10.20.193.133:6824/4255173938,v1:10.20.193.133:6825/4255173938] conn(0x7fa9e80dca00 0x7fa9e80fce10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7fa2d5f776c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa2d01137a0 0x7fa2d0121650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7fa2d5f776c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa2d01198f0 0x7fa2d0121b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.145+0000 7f1187fff6c0 1 -- 10.20.193.96:0/676625670 --> [v2:10.20.193.96:6810/2289717362,v1:10.20.193.96:6811/2289717362] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f117c002d20 con 0x7f11940dccf0 2026-02-13T03:34:26.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.146+0000 7fa2d5f776c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa2d0126f50 0x7fa2d01273f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7f11a67fc6c0 1 -- 10.20.193.96:0/676625670 <== osd.3 v2:10.20.193.96:6810/2289717362 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f117c002d20 con 0x7f11940dccf0 2026-02-13T03:34:26.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7faa01ffb6c0 1 -- 10.20.193.96:0/3346383246 --> [v2:10.20.193.133:6824/4255173938,v1:10.20.193.133:6825/4255173938] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa9e80fd4c0 con 0x7fa9e80dca00 2026-02-13T03:34:26.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7faa01ffb6c0 1 -- 10.20.193.96:0/3346383246 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7fa9fc0e3fe0 con 0x7faa0c10f230 2026-02-13T03:34:26.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7fa2d5f776c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d0127960 con 0x7fa2d0126f50 2026-02-13T03:34:26.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7fa2d5f776c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d0127ad0 con 0x7fa2d01137a0 2026-02-13T03:34:26.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7fa2d5f776c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d0127c90 con 0x7fa2d01198f0 2026-02-13T03:34:26.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7fa2cffff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa2d0126f50 0x7fa2d01273f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7faa03fff6c0 1 --2- 10.20.193.96:0/3346383246 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa9e80b5590 0x7fa9e80d5a40 secure :-1 s=READY pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9f4005b40 tx=0x7fa9f4005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7fa2cffff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa2d0126f50 0x7fa2d01273f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49106/0 (socket says 10.20.193.96:49106) 2026-02-13T03:34:26.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7fa2cffff6c0 1 -- 10.20.193.96:0/503990928 learned_addr learned my addr 10.20.193.96:0/503990928 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:26.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7fa2ceffd6c0 1 --2- 10.20.193.96:0/503990928 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa2d01198f0 0x7fa2d0121b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7fa2cf7fe6c0 1 --2- 10.20.193.96:0/503990928 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa2d01137a0 0x7fa2d0121650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7fa2cffff6c0 1 -- 10.20.193.96:0/503990928 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa2d01198f0 msgr2=0x7fa2d0121b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7fa2cffff6c0 1 --2- 10.20.193.96:0/503990928 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa2d01198f0 0x7fa2d0121b90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7fa2cffff6c0 1 -- 10.20.193.96:0/503990928 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa2d01137a0 msgr2=0x7fa2d0121650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7fa2cffff6c0 1 --2- 10.20.193.96:0/503990928 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa2d01137a0 0x7fa2d0121650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7fa2cffff6c0 1 -- 10.20.193.96:0/503990928 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c400a660 con 0x7fa2d0126f50 2026-02-13T03:34:26.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7fa2cf7fe6c0 1 --2- 10.20.193.96:0/503990928 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fa2d01137a0 0x7fa2d0121650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:34:26.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7fa2cffff6c0 1 --2- 10.20.193.96:0/503990928 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa2d0126f50 0x7fa2d01273f0 secure :-1 s=READY pgs=274 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2c400c9d0 tx=0x7fa2c400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7f04667fc6c0 1 -- 10.20.193.96:0/639025768 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f046c0071c0 con 0x7f0478115440 2026-02-13T03:34:26.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7fa2ccff96c0 1 -- 10.20.193.96:0/503990928 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa2c4003c40 con 0x7fa2d0126f50 2026-02-13T03:34:26.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7fa2ccff96c0 1 -- 10.20.193.96:0/503990928 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fa2c400a070 con 0x7fa2d0126f50 2026-02-13T03:34:26.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7fa2ccff96c0 1 -- 10.20.193.96:0/503990928 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa2c4008440 con 0x7fa2d0126f50 2026-02-13T03:34:26.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7fa2d5f776c0 1 -- 10.20.193.96:0/503990928 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2bc0094c0 con 0x7fa2d0126f50 2026-02-13T03:34:26.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7fa2d5f776c0 1 -- 10.20.193.96:0/503990928 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d01683e0 con 0x7fa2d0126f50 2026-02-13T03:34:26.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.148+0000 7f04667fc6c0 1 --2- 10.20.193.96:0/639025768 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f04540b5790 0x7f04540d5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.148+0000 7fa2d5f776c0 1 -- 10.20.193.96:0/503990928 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa2d0052a50 con 0x7fa2d0126f50 2026-02-13T03:34:26.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7faa112be6c0 1 --2- 10.20.193.96:0/3346383246 >> [v2:10.20.193.133:6824/4255173938,v1:10.20.193.133:6825/4255173938] conn(0x7fa9e80dca00 0x7fa9e80fce10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7faa112be6c0 1 --2- 10.20.193.96:0/3346383246 >> [v2:10.20.193.133:6824/4255173938,v1:10.20.193.133:6825/4255173938] conn(0x7fa9e80dca00 0x7fa9e80fce10 crc :-1 s=READY pgs=6 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.148+0000 7faa01ffb6c0 1 -- 10.20.193.96:0/3346383246 <== osd.11 v2:10.20.193.133:6824/4255173938 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fa9e80fd4c0 con 0x7fa9e80dca00 2026-02-13T03:34:26.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.148+0000 7fa5f1ffb6c0 1 -- 10.20.193.96:0/3894490995 <== mon.1 v2:10.20.193.133:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fa5f80081c0 con 0x7fa5fc062990 2026-02-13T03:34:26.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.148+0000 7fa5f1ffb6c0 1 --2- 10.20.193.96:0/3894490995 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa5d80b57e0 0x7fa5d80d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.149+0000 7fa6008e96c0 1 --2- 10.20.193.96:0/3894490995 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa5d80b57e0 0x7fa5d80d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.149+0000 7fa5f1ffb6c0 1 -- 10.20.193.96:0/3894490995 <== mon.1 v2:10.20.193.133:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7fa5f8108d50 con 0x7fa5fc062990 2026-02-13T03:34:26.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.149+0000 7fa5f1ffb6c0 1 --2- 10.20.193.96:0/3894490995 >> [v2:10.20.193.133:6808/3625077127,v1:10.20.193.133:6809/3625077127] conn(0x7fa5d80dcdc0 0x7fa5d80fd1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.149+0000 7fa6008e96c0 1 --2- 10.20.193.96:0/3894490995 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa5d80b57e0 0x7fa5d80d5c90 secure :-1 s=READY pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5ec005b40 tx=0x7fa5ec009490 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.149+0000 7fa5f1ffb6c0 1 -- 10.20.193.96:0/3894490995 --> [v2:10.20.193.133:6808/3625077127,v1:10.20.193.133:6809/3625077127] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa5d80fd880 con 0x7fa5d80dcdc0 2026-02-13T03:34:26.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.149+0000 7fa5f1ffb6c0 1 -- 10.20.193.96:0/3894490995 <== mon.1 v2:10.20.193.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7fa5f8109100 con 0x7fa5fc062990 2026-02-13T03:34:26.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.148+0000 7f04667fc6c0 1 -- 10.20.193.96:0/639025768 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f046c107e10 con 0x7f0478115440 2026-02-13T03:34:26.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.148+0000 7f047d5996c0 1 --2- 10.20.193.96:0/639025768 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f04540b5790 0x7f04540d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.148+0000 7f04667fc6c0 1 --2- 10.20.193.96:0/639025768 >> [v2:10.20.193.132:6808/421645986,v1:10.20.193.132:6809/421645986] conn(0x7f04540dcd70 0x7f04540fd180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.148+0000 7f04667fc6c0 1 -- 10.20.193.96:0/639025768 --> [v2:10.20.193.132:6808/421645986,v1:10.20.193.132:6809/421645986] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f04540fd830 con 0x7f04540dcd70 2026-02-13T03:34:26.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.148+0000 7f04667fc6c0 1 -- 10.20.193.96:0/639025768 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f046c108140 con 0x7f0478115440 2026-02-13T03:34:26.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.148+0000 7f047d5996c0 1 --2- 10.20.193.96:0/639025768 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f04540b5790 0x7f04540d5c40 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0468005980 tx=0x7f0468005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.148+0000 7f047dd9a6c0 1 --2- 10.20.193.96:0/639025768 >> [v2:10.20.193.132:6808/421645986,v1:10.20.193.132:6809/421645986] conn(0x7f04540dcd70 0x7f04540fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.148+0000 7f047dd9a6c0 1 --2- 10.20.193.96:0/639025768 >> [v2:10.20.193.132:6808/421645986,v1:10.20.193.132:6809/421645986] conn(0x7f04540dcd70 0x7f04540fd180 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.149+0000 7f04667fc6c0 1 -- 10.20.193.96:0/639025768 <== osd.4 v2:10.20.193.132:6808/421645986 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f04540fd830 con 0x7f04540dcd70 2026-02-13T03:34:26.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.149+0000 7fa2ccff96c0 1 -- 10.20.193.96:0/503990928 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fa2c4005860 con 0x7fa2d0126f50 2026-02-13T03:34:26.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.149+0000 7fa5f3fff6c0 1 --2- 10.20.193.96:0/3894490995 >> [v2:10.20.193.133:6808/3625077127,v1:10.20.193.133:6809/3625077127] conn(0x7fa5d80dcdc0 0x7fa5d80fd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.149+0000 7fa2ccff96c0 1 --2- 10.20.193.96:0/503990928 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa2a40b57e0 0x7fa2a40d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.150+0000 7fa5f3fff6c0 1 --2- 10.20.193.96:0/3894490995 >> [v2:10.20.193.133:6808/3625077127,v1:10.20.193.133:6809/3625077127] conn(0x7fa5d80dcdc0 0x7fa5d80fd1d0 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.150+0000 7fa2ccff96c0 1 -- 10.20.193.96:0/503990928 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7fa2c40e4d70 con 0x7fa2d0126f50 2026-02-13T03:34:26.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.150+0000 7fa2ccff96c0 1 --2- 10.20.193.96:0/503990928 >> [v2:10.20.193.132:6800/3550689941,v1:10.20.193.132:6801/3550689941] conn(0x7fa2a40dcdc0 0x7fa2a40fd1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.150+0000 7fa2ccff96c0 1 -- 10.20.193.96:0/503990928 --> [v2:10.20.193.132:6800/3550689941,v1:10.20.193.132:6801/3550689941] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2a40fd880 con 0x7fa2a40dcdc0 2026-02-13T03:34:26.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.150+0000 7fa2ccff96c0 1 -- 10.20.193.96:0/503990928 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7fa2c40e5190 con 0x7fa2d0126f50 2026-02-13T03:34:26.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.150+0000 7fa2cf7fe6c0 1 --2- 10.20.193.96:0/503990928 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa2a40b57e0 0x7fa2a40d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.150+0000 7fa2ceffd6c0 1 --2- 10.20.193.96:0/503990928 >> [v2:10.20.193.132:6800/3550689941,v1:10.20.193.132:6801/3550689941] conn(0x7fa2a40dcdc0 0x7fa2a40fd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.150+0000 7fa5f1ffb6c0 1 -- 10.20.193.96:0/3894490995 <== osd.5 v2:10.20.193.133:6808/3625077127 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fa5d80fd880 con 0x7fa5d80dcdc0 2026-02-13T03:34:26.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.150+0000 7fa2cf7fe6c0 1 --2- 10.20.193.96:0/503990928 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa2a40b57e0 0x7fa2a40d5c90 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2bc0098a0 tx=0x7fa2bc0023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.150+0000 7f4db4ea56c0 1 -- 10.20.193.96:0/735698610 --> [v2:10.20.193.133:6816/3678366387,v1:10.20.193.133:6817/3678366387] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4db0174630 con 0x7f4d880dca00 2026-02-13T03:34:26.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7f1187fff6c0 1 -- 10.20.193.96:0/676625670 >> [v2:10.20.193.96:6810/2289717362,v1:10.20.193.96:6811/2289717362] conn(0x7f11940dccf0 msgr2=0x7f11940fd100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7f1187fff6c0 1 --2- 10.20.193.96:0/676625670 >> [v2:10.20.193.96:6810/2289717362,v1:10.20.193.96:6811/2289717362] conn(0x7f11940dccf0 0x7f11940fd100 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7f1187fff6c0 1 -- 10.20.193.96:0/676625670 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f11940b5710 msgr2=0x7f11940d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7f1187fff6c0 1 --2- 10.20.193.96:0/676625670 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f11940b5710 0x7f11940d5bc0 secure :-1 s=READY pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11a8009240 tx=0x7f11a8009420 comp rx=0 tx=0).stop 2026-02-13T03:34:26.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7f1187fff6c0 1 -- 10.20.193.96:0/676625670 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f11b80fe850 msgr2=0x7f11b80fecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7f1187fff6c0 1 --2- 10.20.193.96:0/676625670 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f11b80fe850 0x7f11b80fecf0 secure :-1 s=READY pgs=268 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11b40054b0 tx=0x7f11b40054e0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.147+0000 7f11bdee76c0 1 -- 10.20.193.96:0/676625670 reap_dead start 2026-02-13T03:34:26.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.151+0000 7fa2ceffd6c0 1 --2- 10.20.193.96:0/503990928 >> [v2:10.20.193.132:6800/3550689941,v1:10.20.193.132:6801/3550689941] conn(0x7fa2a40dcdc0 0x7fa2a40fd1d0 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.151+0000 7f4d977fe6c0 1 -- 10.20.193.96:0/735698610 <== osd.8 v2:10.20.193.133:6816/3678366387 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4db0174630 con 0x7f4d880dca00 2026-02-13T03:34:26.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.152+0000 7efdd1f106c0 1 -- 10.20.193.96:0/2961938436 --> [v2:10.20.193.133:6800/4145071410,v1:10.20.193.133:6801/4145071410] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efdcc15b380 con 0x7efda00dccf0 2026-02-13T03:34:26.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.151+0000 7f1187fff6c0 1 -- 10.20.193.96:0/676625670 shutdown_connections 2026-02-13T03:34:26.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.151+0000 7f1187fff6c0 1 -- 10.20.193.96:0/676625670 >> 10.20.193.96:0/676625670 conn(0x7f11b80ecb30 msgr2=0x7f11b8113ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.152+0000 7f1187fff6c0 1 -- 10.20.193.96:0/676625670 shutdown_connections 2026-02-13T03:34:26.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.152+0000 7f1187fff6c0 1 -- 10.20.193.96:0/676625670 wait complete. 2026-02-13T03:34:26.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.151+0000 7f4db4ea56c0 1 -- 10.20.193.96:0/735698610 >> [v2:10.20.193.133:6816/3678366387,v1:10.20.193.133:6817/3678366387] conn(0x7f4d880dca00 msgr2=0x7f4d880fce10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.151+0000 7f4db4ea56c0 1 --2- 10.20.193.96:0/735698610 >> [v2:10.20.193.133:6816/3678366387,v1:10.20.193.133:6817/3678366387] conn(0x7f4d880dca00 0x7f4d880fce10 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.151+0000 7f4db4ea56c0 1 -- 10.20.193.96:0/735698610 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4d880b5590 msgr2=0x7f4d880d5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.151+0000 7f4db4ea56c0 1 --2- 10.20.193.96:0/735698610 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4d880b5590 0x7f4d880d5a40 secure :-1 s=READY pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da40098d0 tx=0x7f4da40023a0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.151+0000 7f4db4ea56c0 1 -- 10.20.193.96:0/735698610 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4db010e130 msgr2=0x7f4db0115f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.151+0000 7f4db4ea56c0 1 --2- 10.20.193.96:0/735698610 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4db010e130 0x7f4db0115f00 secure :-1 s=READY pgs=55 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d9800af30 tx=0x7f4d98009bb0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.152+0000 7f4daed766c0 1 -- 10.20.193.96:0/735698610 reap_dead start 2026-02-13T03:34:26.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.152+0000 7f4db4ea56c0 1 -- 10.20.193.96:0/735698610 shutdown_connections 2026-02-13T03:34:26.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.152+0000 7f4db4ea56c0 1 -- 10.20.193.96:0/735698610 >> 10.20.193.96:0/735698610 conn(0x7f4db0063af0 msgr2=0x7f4db010a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.152+0000 7f483a5146c0 1 -- 10.20.193.96:0/1071140600 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4834112060 msgr2=0x7f4834172a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.152+0000 7f483a5146c0 1 --2- 10.20.193.96:0/1071140600 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4834112060 0x7f4834172a00 secure :-1 s=READY pgs=59 gs=2 cs=0 l=1 c_cookie=6014397431827915030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f482800aa70 tx=0x7f482802fe10 comp rx=0 tx=0).stop 2026-02-13T03:34:26.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.152+0000 7f483a5146c0 1 -- 10.20.193.96:0/1071140600 shutdown_connections 2026-02-13T03:34:26.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.152+0000 7f483a5146c0 1 --2- 10.20.193.96:0/1071140600 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4834112060 0x7f4834172a00 unknown :-1 s=CLOSED pgs=59 gs=2 cs=0 l=1 c_cookie=6014397431827915030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.152+0000 7f483a5146c0 1 --2- 10.20.193.96:0/1071140600 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f483410c840 0x7f4834111880 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.152+0000 7f483a5146c0 1 --2- 10.20.193.96:0/1071140600 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f483410be50 0x7f483410c220 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.152+0000 7f483a5146c0 1 -- 10.20.193.96:0/1071140600 >> 10.20.193.96:0/1071140600 conn(0x7f4834063780 msgr2=0x7f4834109ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.152+0000 7fa2ccff96c0 1 -- 10.20.193.96:0/503990928 <== osd.1 v2:10.20.193.132:6800/3550689941 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fa2a40fd880 con 0x7fa2a40dcdc0 2026-02-13T03:34:26.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.152+0000 7efdc8ff96c0 1 -- 10.20.193.96:0/2961938436 <== osd.2 v2:10.20.193.133:6800/4145071410 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efdcc15b380 con 0x7efda00dccf0 2026-02-13T03:34:26.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.152+0000 7f4db4ea56c0 1 -- 10.20.193.96:0/735698610 shutdown_connections 2026-02-13T03:34:26.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.152+0000 7f4db4ea56c0 1 -- 10.20.193.96:0/735698610 wait complete. 2026-02-13T03:34:26.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.152+0000 7f483a5146c0 1 -- 10.20.193.96:0/1071140600 shutdown_connections 2026-02-13T03:34:26.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.152+0000 7f483a5146c0 1 -- 10.20.193.96:0/1071140600 wait complete. 2026-02-13T03:34:26.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.153+0000 7f483a5146c0 1 Processor -- start 2026-02-13T03:34:26.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.153+0000 7f483a5146c0 1 -- start start 2026-02-13T03:34:26.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.153+0000 7f483a5146c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f483410be50 0x7f48340f92a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.153+0000 7f483a5146c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4834112060 0x7f4834172900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.153+0000 7f483a5146c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f48340f98d0 0x7f48340feb00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.153+0000 7f483a5146c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f48340f9f30 con 0x7f48340f98d0 2026-02-13T03:34:26.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.153+0000 7f4838a8a6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f48340f98d0 0x7f48340feb00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.153+0000 7f4838a8a6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f48340f98d0 0x7f48340feb00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49124/0 (socket says 10.20.193.96:49124) 2026-02-13T03:34:26.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.153+0000 7f4838a8a6c0 1 -- 10.20.193.96:0/1290007822 learned_addr learned my addr 10.20.193.96:0/1290007822 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:26.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.153+0000 7f483a5146c0 1 -- 10.20.193.96:0/1290007822 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f48340ff040 con 0x7f483410be50 2026-02-13T03:34:26.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.153+0000 7f483a5146c0 1 -- 10.20.193.96:0/1290007822 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f48340ff200 con 0x7f4834112060 2026-02-13T03:34:26.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.153+0000 7f48337fe6c0 1 --2- 10.20.193.96:0/1290007822 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4834112060 0x7f4834172900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.153+0000 7f4833fff6c0 1 --2- 10.20.193.96:0/1290007822 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f483410be50 0x7f48340f92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.154+0000 7f4838a8a6c0 1 -- 10.20.193.96:0/1290007822 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4834112060 msgr2=0x7f4834172900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.154+0000 7f4838a8a6c0 1 --2- 10.20.193.96:0/1290007822 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4834112060 0x7f4834172900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.154+0000 7f4838a8a6c0 1 -- 10.20.193.96:0/1290007822 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f483410be50 msgr2=0x7f48340f92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.154+0000 7f4838a8a6c0 1 --2- 10.20.193.96:0/1290007822 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f483410be50 0x7f48340f92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.154+0000 7f4838a8a6c0 1 -- 10.20.193.96:0/1290007822 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f482800a660 con 0x7f48340f98d0 2026-02-13T03:34:26.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.154+0000 7f4833fff6c0 1 --2- 10.20.193.96:0/1290007822 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f483410be50 0x7f48340f92a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:34:26.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.154+0000 7f4838a8a6c0 1 --2- 10.20.193.96:0/1290007822 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f48340f98d0 0x7f48340feb00 secure :-1 s=READY pgs=275 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f482800a990 tx=0x7f48280054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.154+0000 7f48317fa6c0 1 -- 10.20.193.96:0/1290007822 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4828003810 con 0x7f48340f98d0 2026-02-13T03:34:26.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.154+0000 7f48317fa6c0 1 -- 10.20.193.96:0/1290007822 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f4828006050 con 0x7f48340f98d0 2026-02-13T03:34:26.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.154+0000 7f483a5146c0 1 -- 10.20.193.96:0/1290007822 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48340ff420 con 0x7f48340f98d0 2026-02-13T03:34:26.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.155+0000 7f48317fa6c0 1 -- 10.20.193.96:0/1290007822 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4828005b50 con 0x7f48340f98d0 2026-02-13T03:34:26.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.155+0000 7f483a5146c0 1 -- 10.20.193.96:0/1290007822 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48340ff850 con 0x7f48340f98d0 2026-02-13T03:34:26.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.155+0000 7f483a5146c0 1 -- 10.20.193.96:0/1290007822 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4834052a50 con 0x7f48340f98d0 2026-02-13T03:34:26.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.155+0000 7efdd1f106c0 1 -- 10.20.193.96:0/2961938436 >> [v2:10.20.193.133:6800/4145071410,v1:10.20.193.133:6801/4145071410] conn(0x7efda00dccf0 msgr2=0x7efda00fd100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.155+0000 7efdd1f106c0 1 --2- 10.20.193.96:0/2961938436 >> [v2:10.20.193.133:6800/4145071410,v1:10.20.193.133:6801/4145071410] conn(0x7efda00dccf0 0x7efda00fd100 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.155+0000 7efdd1f106c0 1 -- 10.20.193.96:0/2961938436 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efda00b5710 msgr2=0x7efda00d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.155+0000 7efdd1f106c0 1 --2- 10.20.193.96:0/2961938436 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efda00b5710 0x7efda00d5bc0 secure :-1 s=READY pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdcc165a70 tx=0x7efdbc00d720 comp rx=0 tx=0).stop 2026-02-13T03:34:26.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.155+0000 7fa9db7fe6c0 1 -- 10.20.193.96:0/3346383246 --> [v2:10.20.193.133:6824/4255173938,v1:10.20.193.133:6825/4255173938] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa9cc002cf0 con 0x7fa9e80dca00 2026-02-13T03:34:26.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.156+0000 7efdd1f106c0 1 -- 10.20.193.96:0/2961938436 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efdcc10b1f0 msgr2=0x7efdcc15f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.156+0000 7efdd1f106c0 1 --2- 10.20.193.96:0/2961938436 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efdcc10b1f0 0x7efdcc15f130 secure :-1 s=READY pgs=57 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdb800b420 tx=0x7efdb800b8f0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.156+0000 7efdcbfff6c0 1 -- 10.20.193.96:0/2961938436 reap_dead start 2026-02-13T03:34:26.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.156+0000 7efdd1f106c0 1 -- 10.20.193.96:0/2961938436 shutdown_connections 2026-02-13T03:34:26.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.156+0000 7efdd1f106c0 1 -- 10.20.193.96:0/2961938436 >> 10.20.193.96:0/2961938436 conn(0x7efdcc063af0 msgr2=0x7efdcc15a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.156+0000 7f48317fa6c0 1 -- 10.20.193.96:0/1290007822 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f4828005cb0 con 0x7f48340f98d0 2026-02-13T03:34:26.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.156+0000 7f48317fa6c0 1 --2- 10.20.193.96:0/1290007822 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f48080b5590 0x7f48080d5a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.157+0000 7efdd1f106c0 1 -- 10.20.193.96:0/2961938436 shutdown_connections 2026-02-13T03:34:26.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.157+0000 7efdd1f106c0 1 -- 10.20.193.96:0/2961938436 wait complete. 2026-02-13T03:34:26.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.157+0000 7f48317fa6c0 1 -- 10.20.193.96:0/1290007822 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f4828108f50 con 0x7f48340f98d0 2026-02-13T03:34:26.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.157+0000 7f4833fff6c0 1 --2- 10.20.193.96:0/1290007822 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f48080b5590 0x7f48080d5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.157+0000 7f48317fa6c0 1 --2- 10.20.193.96:0/1290007822 >> [v2:10.20.193.132:6824/921326908,v1:10.20.193.132:6825/921326908] conn(0x7f48080dca00 0x7f48080fce10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.157+0000 7f48317fa6c0 1 -- 10.20.193.96:0/1290007822 --> [v2:10.20.193.132:6824/921326908,v1:10.20.193.132:6825/921326908] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48080fd4c0 con 0x7f48080dca00 2026-02-13T03:34:26.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.157+0000 7f48317fa6c0 1 -- 10.20.193.96:0/1290007822 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f482810b5e0 con 0x7f48340f98d0 2026-02-13T03:34:26.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.157+0000 7f48337fe6c0 1 --2- 10.20.193.96:0/1290007822 >> [v2:10.20.193.132:6824/921326908,v1:10.20.193.132:6825/921326908] conn(0x7f48080dca00 0x7f48080fce10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.156+0000 7faa01ffb6c0 1 -- 10.20.193.96:0/3346383246 <== osd.11 v2:10.20.193.133:6824/4255173938 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa9cc002cf0 con 0x7fa9e80dca00 2026-02-13T03:34:26.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.156+0000 7fa9db7fe6c0 1 -- 10.20.193.96:0/3346383246 >> [v2:10.20.193.133:6824/4255173938,v1:10.20.193.133:6825/4255173938] conn(0x7fa9e80dca00 msgr2=0x7fa9e80fce10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.156+0000 7fa9db7fe6c0 1 --2- 10.20.193.96:0/3346383246 >> [v2:10.20.193.133:6824/4255173938,v1:10.20.193.133:6825/4255173938] conn(0x7fa9e80dca00 0x7fa9e80fce10 crc :-1 s=READY pgs=6 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.156+0000 7fa9db7fe6c0 1 -- 10.20.193.96:0/3346383246 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa9e80b5590 msgr2=0x7fa9e80d5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.156+0000 7fa9db7fe6c0 1 --2- 10.20.193.96:0/3346383246 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa9e80b5590 0x7fa9e80d5a40 secure :-1 s=READY pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9f4005b40 tx=0x7fa9f4005c00 comp rx=0 tx=0).stop 2026-02-13T03:34:26.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.156+0000 7fa9db7fe6c0 1 -- 10.20.193.96:0/3346383246 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faa0c10f230 msgr2=0x7faa0c05e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.156+0000 7fa9db7fe6c0 1 --2- 10.20.193.96:0/3346383246 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faa0c10f230 0x7faa0c05e450 secure :-1 s=READY pgs=272 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9fc00b710 tx=0x7fa9fc00bbe0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.156+0000 7faa112be6c0 1 -- 10.20.193.96:0/3346383246 reap_dead start 2026-02-13T03:34:26.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.156+0000 7fa9db7fe6c0 1 -- 10.20.193.96:0/3346383246 shutdown_connections 2026-02-13T03:34:26.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.156+0000 7fa9db7fe6c0 1 -- 10.20.193.96:0/3346383246 >> 10.20.193.96:0/3346383246 conn(0x7faa0c0ecb30 msgr2=0x7faa0c10d890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.156+0000 7fa9db7fe6c0 1 -- 10.20.193.96:0/3346383246 shutdown_connections 2026-02-13T03:34:26.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.156+0000 7fa9db7fe6c0 1 -- 10.20.193.96:0/3346383246 wait complete. 2026-02-13T03:34:26.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.157+0000 7f4833fff6c0 1 --2- 10.20.193.96:0/1290007822 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f48080b5590 0x7f48080d5a40 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4820004770 tx=0x7f4820009060 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.157+0000 7f047f8286c0 1 -- 10.20.193.96:0/639025768 --> [v2:10.20.193.132:6808/421645986,v1:10.20.193.132:6809/421645986] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f04780648b0 con 0x7f04540dcd70 2026-02-13T03:34:26.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.157+0000 7f48337fe6c0 1 --2- 10.20.193.96:0/1290007822 >> [v2:10.20.193.132:6824/921326908,v1:10.20.193.132:6825/921326908] conn(0x7f48080dca00 0x7f48080fce10 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.157+0000 7f04667fc6c0 1 -- 10.20.193.96:0/639025768 <== osd.4 v2:10.20.193.132:6808/421645986 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f04780648b0 con 0x7f04540dcd70 2026-02-13T03:34:26.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.158+0000 7f48317fa6c0 1 -- 10.20.193.96:0/1290007822 <== osd.10 v2:10.20.193.132:6824/921326908 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f48080fd4c0 con 0x7f48080dca00 2026-02-13T03:34:26.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.159+0000 7f047f8286c0 1 -- 10.20.193.96:0/639025768 >> [v2:10.20.193.132:6808/421645986,v1:10.20.193.132:6809/421645986] conn(0x7f04540dcd70 msgr2=0x7f04540fd180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.159+0000 7f047f8286c0 1 --2- 10.20.193.96:0/639025768 >> [v2:10.20.193.132:6808/421645986,v1:10.20.193.132:6809/421645986] conn(0x7f04540dcd70 0x7f04540fd180 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.159+0000 7f047f8286c0 1 -- 10.20.193.96:0/639025768 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f04540b5790 msgr2=0x7f04540d5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.159+0000 7f047f8286c0 1 --2- 10.20.193.96:0/639025768 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f04540b5790 0x7f04540d5c40 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0468005980 tx=0x7f0468005910 comp rx=0 tx=0).stop 2026-02-13T03:34:26.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.159+0000 7f047f8286c0 1 -- 10.20.193.96:0/639025768 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0478115440 msgr2=0x7f047817da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.159+0000 7f047f8286c0 1 --2- 10.20.193.96:0/639025768 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0478115440 0x7f047817da40 secure :-1 s=READY pgs=273 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f046c02fb20 tx=0x7f046c002980 comp rx=0 tx=0).stop 2026-02-13T03:34:26.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.159+0000 7f047dd9a6c0 1 -- 10.20.193.96:0/639025768 reap_dead start 2026-02-13T03:34:26.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.159+0000 7f047f8286c0 1 -- 10.20.193.96:0/639025768 shutdown_connections 2026-02-13T03:34:26.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.159+0000 7f047f8286c0 1 -- 10.20.193.96:0/639025768 >> 10.20.193.96:0/639025768 conn(0x7f04780ecb30 msgr2=0x7f047810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.159+0000 7f047f8286c0 1 -- 10.20.193.96:0/639025768 shutdown_connections 2026-02-13T03:34:26.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.159+0000 7f047f8286c0 1 -- 10.20.193.96:0/639025768 wait complete. 2026-02-13T03:34:26.163 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.159+0000 7fa5cb7fe6c0 1 -- 10.20.193.96:0/3894490995 --> [v2:10.20.193.133:6808/3625077127,v1:10.20.193.133:6809/3625077127] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa5bc002d20 con 0x7fa5d80dcdc0 2026-02-13T03:34:26.164 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.161+0000 7fa5f1ffb6c0 1 -- 10.20.193.96:0/3894490995 <== osd.5 v2:10.20.193.133:6808/3625077127 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa5bc002d20 con 0x7fa5d80dcdc0 2026-02-13T03:34:26.164 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.161+0000 7fa5cb7fe6c0 1 -- 10.20.193.96:0/3894490995 >> [v2:10.20.193.133:6808/3625077127,v1:10.20.193.133:6809/3625077127] conn(0x7fa5d80dcdc0 msgr2=0x7fa5d80fd1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.164 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.161+0000 7fa5cb7fe6c0 1 --2- 10.20.193.96:0/3894490995 >> [v2:10.20.193.133:6808/3625077127,v1:10.20.193.133:6809/3625077127] conn(0x7fa5d80dcdc0 0x7fa5d80fd1d0 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.164 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.161+0000 7fa5cb7fe6c0 1 -- 10.20.193.96:0/3894490995 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa5d80b57e0 msgr2=0x7fa5d80d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.164 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.161+0000 7fa5cb7fe6c0 1 --2- 10.20.193.96:0/3894490995 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa5d80b57e0 0x7fa5d80d5c90 secure :-1 s=READY pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5ec005b40 tx=0x7fa5ec009490 comp rx=0 tx=0).stop 2026-02-13T03:34:26.164 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.161+0000 7fa5cb7fe6c0 1 -- 10.20.193.96:0/3894490995 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa5fc062990 msgr2=0x7fa5fc062e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.164 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.161+0000 7fa5cb7fe6c0 1 --2- 10.20.193.96:0/3894490995 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fa5fc062990 0x7fa5fc062e10 secure :-1 s=READY pgs=58 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5f800a2e0 tx=0x7fa5f8031c90 comp rx=0 tx=0).stop 2026-02-13T03:34:26.164 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.162+0000 7fa6010ea6c0 1 -- 10.20.193.96:0/3894490995 reap_dead start 2026-02-13T03:34:26.164 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.162+0000 7fa5cb7fe6c0 1 -- 10.20.193.96:0/3894490995 shutdown_connections 2026-02-13T03:34:26.165 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.162+0000 7fa5cb7fe6c0 1 -- 10.20.193.96:0/3894490995 >> 10.20.193.96:0/3894490995 conn(0x7fa5fc0ecb30 msgr2=0x7fa5fc111a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.165 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.162+0000 7fa5cb7fe6c0 1 -- 10.20.193.96:0/3894490995 shutdown_connections 2026-02-13T03:34:26.165 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.162+0000 7fa5cb7fe6c0 1 -- 10.20.193.96:0/3894490995 wait complete. 2026-02-13T03:34:26.165 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.162+0000 7fa2d5f776c0 1 -- 10.20.193.96:0/503990928 --> [v2:10.20.193.132:6800/3550689941,v1:10.20.193.132:6801/3550689941] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa2d0052a50 con 0x7fa2a40dcdc0 2026-02-13T03:34:26.165 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.162+0000 7fa2ccff96c0 1 -- 10.20.193.96:0/503990928 <== osd.1 v2:10.20.193.132:6800/3550689941 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa2d0052a50 con 0x7fa2a40dcdc0 2026-02-13T03:34:26.167 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.165+0000 7fa2d5f776c0 1 -- 10.20.193.96:0/503990928 >> [v2:10.20.193.132:6800/3550689941,v1:10.20.193.132:6801/3550689941] conn(0x7fa2a40dcdc0 msgr2=0x7fa2a40fd1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.167 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.165+0000 7fa2d5f776c0 1 --2- 10.20.193.96:0/503990928 >> [v2:10.20.193.132:6800/3550689941,v1:10.20.193.132:6801/3550689941] conn(0x7fa2a40dcdc0 0x7fa2a40fd1d0 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.167 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.165+0000 7fa2d5f776c0 1 -- 10.20.193.96:0/503990928 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa2a40b57e0 msgr2=0x7fa2a40d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.167 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.165+0000 7fa2d5f776c0 1 --2- 10.20.193.96:0/503990928 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fa2a40b57e0 0x7fa2a40d5c90 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2bc0098a0 tx=0x7fa2bc0023a0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.165+0000 7fa2d5f776c0 1 -- 10.20.193.96:0/503990928 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa2d0126f50 msgr2=0x7fa2d01273f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.165+0000 7fa2d5f776c0 1 --2- 10.20.193.96:0/503990928 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fa2d0126f50 0x7fa2d01273f0 secure :-1 s=READY pgs=274 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2c400c9d0 tx=0x7fa2c400cea0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.165+0000 7fa2cffff6c0 1 -- 10.20.193.96:0/503990928 reap_dead start 2026-02-13T03:34:26.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.165+0000 7fa2d5f776c0 1 -- 10.20.193.96:0/503990928 shutdown_connections 2026-02-13T03:34:26.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.165+0000 7fa2d5f776c0 1 -- 10.20.193.96:0/503990928 >> 10.20.193.96:0/503990928 conn(0x7fa2d0060760 msgr2=0x7fa2d0114ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.165+0000 7fa2d5f776c0 1 -- 10.20.193.96:0/503990928 shutdown_connections 2026-02-13T03:34:26.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.165+0000 7fa2d5f776c0 1 -- 10.20.193.96:0/503990928 wait complete. 2026-02-13T03:34:26.169 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.166+0000 7f483a5146c0 1 -- 10.20.193.96:0/1290007822 --> [v2:10.20.193.132:6824/921326908,v1:10.20.193.132:6825/921326908] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4834110800 con 0x7f48080dca00 2026-02-13T03:34:26.169 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.166+0000 7f48317fa6c0 1 -- 10.20.193.96:0/1290007822 <== osd.10 v2:10.20.193.132:6824/921326908 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4834110800 con 0x7f48080dca00 2026-02-13T03:34:26.170 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.167+0000 7f483a5146c0 1 -- 10.20.193.96:0/1290007822 >> [v2:10.20.193.132:6824/921326908,v1:10.20.193.132:6825/921326908] conn(0x7f48080dca00 msgr2=0x7f48080fce10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.170 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.167+0000 7f483a5146c0 1 --2- 10.20.193.96:0/1290007822 >> [v2:10.20.193.132:6824/921326908,v1:10.20.193.132:6825/921326908] conn(0x7f48080dca00 0x7f48080fce10 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.171 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.168+0000 7f483a5146c0 1 -- 10.20.193.96:0/1290007822 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f48080b5590 msgr2=0x7f48080d5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.171 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.168+0000 7f483a5146c0 1 --2- 10.20.193.96:0/1290007822 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f48080b5590 0x7f48080d5a40 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4820004770 tx=0x7f4820009060 comp rx=0 tx=0).stop 2026-02-13T03:34:26.171 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.168+0000 7f483a5146c0 1 -- 10.20.193.96:0/1290007822 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f48340f98d0 msgr2=0x7f48340feb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.171 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.168+0000 7f483a5146c0 1 --2- 10.20.193.96:0/1290007822 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f48340f98d0 0x7f48340feb00 secure :-1 s=READY pgs=275 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f482800a990 tx=0x7f48280054b0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.173 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.171+0000 7f4838a8a6c0 1 -- 10.20.193.96:0/1290007822 reap_dead start 2026-02-13T03:34:26.174 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.171+0000 7f483a5146c0 1 -- 10.20.193.96:0/1290007822 shutdown_connections 2026-02-13T03:34:26.174 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.171+0000 7f483a5146c0 1 -- 10.20.193.96:0/1290007822 >> 10.20.193.96:0/1290007822 conn(0x7f4834063780 msgr2=0x7f483410f730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.174 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.171+0000 7f483a5146c0 1 -- 10.20.193.96:0/1290007822 shutdown_connections 2026-02-13T03:34:26.174 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.171+0000 7f483a5146c0 1 -- 10.20.193.96:0/1290007822 wait complete. 2026-02-13T03:34:26.212 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.209+0000 7f4f2b65b6c0 1 -- 10.20.193.96:0/1115543869 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4f241131c0 msgr2=0x7f4f24173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.212 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.209+0000 7f4f2b65b6c0 1 --2- 10.20.193.96:0/1115543869 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4f241131c0 0x7f4f24173b60 secure :-1 s=READY pgs=276 gs=1 cs=0 l=1 c_cookie=3264003260453278075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f2000aa70 tx=0x7f4f2002fde0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.212 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.209+0000 7f4f2b65b6c0 1 -- 10.20.193.96:0/1115543869 shutdown_connections 2026-02-13T03:34:26.212 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.209+0000 7f4f2b65b6c0 1 --2- 10.20.193.96:0/1115543869 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4f241131c0 0x7f4f24173b60 unknown :-1 s=CLOSED pgs=276 gs=1 cs=0 l=1 c_cookie=3264003260453278075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.213 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.209+0000 7f4f2b65b6c0 1 --2- 10.20.193.96:0/1115543869 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4f2410d9a0 0x7f4f241129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.213 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.209+0000 7f4f2b65b6c0 1 --2- 10.20.193.96:0/1115543869 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4f2410cfb0 0x7f4f2410d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.213 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.209+0000 7f4f2b65b6c0 1 -- 10.20.193.96:0/1115543869 >> 10.20.193.96:0/1115543869 conn(0x7f4f240ea8b0 msgr2=0x7f4f2410acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.213 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.209+0000 7f4f2b65b6c0 1 -- 10.20.193.96:0/1115543869 shutdown_connections 2026-02-13T03:34:26.213 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.209+0000 7f4f2b65b6c0 1 -- 10.20.193.96:0/1115543869 wait complete. 2026-02-13T03:34:26.213 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.211+0000 7f4f2b65b6c0 1 Processor -- start 2026-02-13T03:34:26.213 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.211+0000 7f4f2b65b6c0 1 -- start start 2026-02-13T03:34:26.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.211+0000 7f4f2b65b6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4f2410cfb0 0x7f4f2411b8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.211+0000 7f4f2b65b6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4f241131c0 0x7f4f2411be20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.211+0000 7f4f2b65b6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4f241211e0 0x7f4f24121680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.211+0000 7f4f2b65b6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4f24121bf0 con 0x7f4f2410cfb0 2026-02-13T03:34:26.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.211+0000 7f4f2b65b6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4f24121d60 con 0x7f4f241211e0 2026-02-13T03:34:26.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.211+0000 7f4f2b65b6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4f24121f20 con 0x7f4f241131c0 2026-02-13T03:34:26.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.211+0000 7f4f293cc6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4f2410cfb0 0x7f4f2411b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.211+0000 7f4f293cc6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4f2410cfb0 0x7f4f2411b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49150/0 (socket says 10.20.193.96:49150) 2026-02-13T03:34:26.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.211+0000 7f4f293cc6c0 1 -- 10.20.193.96:0/101422003 learned_addr learned my addr 10.20.193.96:0/101422003 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:26.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.211+0000 7f4f28bcb6c0 1 --2- 10.20.193.96:0/101422003 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4f241131c0 0x7f4f2411be20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.211+0000 7f4f29bcd6c0 1 --2- 10.20.193.96:0/101422003 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4f241211e0 0x7f4f24121680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.211+0000 7f4f293cc6c0 1 -- 10.20.193.96:0/101422003 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4f241131c0 msgr2=0x7f4f2411be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.211+0000 7f4f293cc6c0 1 --2- 10.20.193.96:0/101422003 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4f241131c0 0x7f4f2411be20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.211+0000 7f4f293cc6c0 1 -- 10.20.193.96:0/101422003 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4f241211e0 msgr2=0x7f4f24121680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.211+0000 7f4f293cc6c0 1 --2- 10.20.193.96:0/101422003 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4f241211e0 0x7f4f24121680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.211+0000 7f4f293cc6c0 1 -- 10.20.193.96:0/101422003 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2000a660 con 0x7f4f2410cfb0 2026-02-13T03:34:26.215 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.211+0000 7f4f28bcb6c0 1 --2- 10.20.193.96:0/101422003 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4f241131c0 0x7f4f2411be20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T03:34:26.215 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.211+0000 7f4f29bcd6c0 1 --2- 10.20.193.96:0/101422003 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4f241211e0 0x7f4f24121680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:34:26.215 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.212+0000 7f4f293cc6c0 1 --2- 10.20.193.96:0/101422003 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4f2410cfb0 0x7f4f2411b8e0 secure :-1 s=READY pgs=277 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f14009de0 tx=0x7f4f1400fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.215 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.212+0000 7f4f127fc6c0 1 -- 10.20.193.96:0/101422003 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4f14010e30 con 0x7f4f2410cfb0 2026-02-13T03:34:26.215 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.212+0000 7f4f127fc6c0 1 -- 10.20.193.96:0/101422003 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f4f14009030 con 0x7f4f2410cfb0 2026-02-13T03:34:26.215 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.212+0000 7f4f2b65b6c0 1 -- 10.20.193.96:0/101422003 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f241623d0 con 0x7f4f2410cfb0 2026-02-13T03:34:26.215 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.212+0000 7f4f127fc6c0 1 -- 10.20.193.96:0/101422003 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4f140074b0 con 0x7f4f2410cfb0 2026-02-13T03:34:26.215 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.212+0000 7f4f2b65b6c0 1 -- 10.20.193.96:0/101422003 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f241628b0 con 0x7f4f2410cfb0 2026-02-13T03:34:26.215 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.212+0000 7f4f2b65b6c0 1 -- 10.20.193.96:0/101422003 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4f24052a50 con 0x7f4f2410cfb0 2026-02-13T03:34:26.216 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.213+0000 7f4f127fc6c0 1 -- 10.20.193.96:0/101422003 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f4f14007640 con 0x7f4f2410cfb0 2026-02-13T03:34:26.217 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.214+0000 7f4f127fc6c0 1 --2- 10.20.193.96:0/101422003 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4f000b5710 0x7f4f000d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.217 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.214+0000 7f4f28bcb6c0 1 --2- 10.20.193.96:0/101422003 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4f000b5710 0x7f4f000d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.217 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.214+0000 7f4f127fc6c0 1 -- 10.20.193.96:0/101422003 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f4f140e8010 con 0x7f4f2410cfb0 2026-02-13T03:34:26.217 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.214+0000 7f4f28bcb6c0 1 --2- 10.20.193.96:0/101422003 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4f000b5710 0x7f4f000d5bc0 secure :-1 s=READY pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f24122270 tx=0x7f4f18009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.217 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.214+0000 7f4f127fc6c0 1 --2- 10.20.193.96:0/101422003 >> [v2:10.20.193.96:6802/1861813169,v1:10.20.193.96:6803/1861813169] conn(0x7f4f000dccf0 0x7f4f000fd100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.217 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.214+0000 7f4f127fc6c0 1 -- 10.20.193.96:0/101422003 --> [v2:10.20.193.96:6802/1861813169,v1:10.20.193.96:6803/1861813169] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4f000fd7b0 con 0x7f4f000dccf0 2026-02-13T03:34:26.217 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.214+0000 7f4f127fc6c0 1 -- 10.20.193.96:0/101422003 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f4f140e8430 con 0x7f4f2410cfb0 2026-02-13T03:34:26.217 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.214+0000 7f4f29bcd6c0 1 --2- 10.20.193.96:0/101422003 >> [v2:10.20.193.96:6802/1861813169,v1:10.20.193.96:6803/1861813169] conn(0x7f4f000dccf0 0x7f4f000fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.217 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.215+0000 7f4f29bcd6c0 1 --2- 10.20.193.96:0/101422003 >> [v2:10.20.193.96:6802/1861813169,v1:10.20.193.96:6803/1861813169] conn(0x7f4f000dccf0 0x7f4f000fd100 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.218 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.215+0000 7f4f127fc6c0 1 -- 10.20.193.96:0/101422003 <== osd.0 v2:10.20.193.96:6802/1861813169 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f4f000fd7b0 con 0x7f4f000dccf0 2026-02-13T03:34:26.221 INFO:teuthology.orchestra.run.trial096.stdout:227633266698 2026-02-13T03:34:26.221 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd last-stat-seq osd.9 2026-02-13T03:34:26.222 INFO:teuthology.orchestra.run.trial096.stdout:81604378644 2026-02-13T03:34:26.222 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-13T03:34:26.225 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.222+0000 7f4f2b65b6c0 1 -- 10.20.193.96:0/101422003 --> [v2:10.20.193.96:6802/1861813169,v1:10.20.193.96:6803/1861813169] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4f24174f40 con 0x7f4f000dccf0 2026-02-13T03:34:26.225 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.223+0000 7f4f127fc6c0 1 -- 10.20.193.96:0/101422003 <== osd.0 v2:10.20.193.96:6802/1861813169 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4f24174f40 con 0x7f4f000dccf0 2026-02-13T03:34:26.227 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.223+0000 7f4f2b65b6c0 1 -- 10.20.193.96:0/101422003 >> [v2:10.20.193.96:6802/1861813169,v1:10.20.193.96:6803/1861813169] conn(0x7f4f000dccf0 msgr2=0x7f4f000fd100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.227 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.223+0000 7f4f2b65b6c0 1 --2- 10.20.193.96:0/101422003 >> [v2:10.20.193.96:6802/1861813169,v1:10.20.193.96:6803/1861813169] conn(0x7f4f000dccf0 0x7f4f000fd100 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.227 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.223+0000 7f4f2b65b6c0 1 -- 10.20.193.96:0/101422003 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4f000b5710 msgr2=0x7f4f000d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.227 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.223+0000 7f4f2b65b6c0 1 --2- 10.20.193.96:0/101422003 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4f000b5710 0x7f4f000d5bc0 secure :-1 s=READY pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f24122270 tx=0x7f4f18009390 comp rx=0 tx=0).stop 2026-02-13T03:34:26.227 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.223+0000 7f4f2b65b6c0 1 -- 10.20.193.96:0/101422003 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4f2410cfb0 msgr2=0x7f4f2411b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.227 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.223+0000 7f4f2b65b6c0 1 --2- 10.20.193.96:0/101422003 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4f2410cfb0 0x7f4f2411b8e0 secure :-1 s=READY pgs=277 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f14009de0 tx=0x7f4f1400fee0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.227 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.223+0000 7f4f29bcd6c0 1 -- 10.20.193.96:0/101422003 reap_dead start 2026-02-13T03:34:26.227 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.223+0000 7f4f2b65b6c0 1 -- 10.20.193.96:0/101422003 shutdown_connections 2026-02-13T03:34:26.227 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.223+0000 7f4f2b65b6c0 1 -- 10.20.193.96:0/101422003 >> 10.20.193.96:0/101422003 conn(0x7f4f240ea8b0 msgr2=0x7f4f2410ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.227 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.223+0000 7f4f2b65b6c0 1 -- 10.20.193.96:0/101422003 shutdown_connections 2026-02-13T03:34:26.227 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.223+0000 7f4f2b65b6c0 1 -- 10.20.193.96:0/101422003 wait complete. 2026-02-13T03:34:26.243 INFO:teuthology.orchestra.run.trial096.stdout:167503724557 2026-02-13T03:34:26.243 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-13T03:34:26.245 INFO:teuthology.orchestra.run.trial096.stdout:270582939655 2026-02-13T03:34:26.245 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd last-stat-seq osd.11 2026-02-13T03:34:26.249 INFO:teuthology.orchestra.run.trial096.stdout:197568495628 2026-02-13T03:34:26.249 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd last-stat-seq osd.8 2026-02-13T03:34:26.255 INFO:teuthology.orchestra.run.trial096.stdout:240518168585 2026-02-13T03:34:26.255 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd last-stat-seq osd.10 2026-02-13T03:34:26.264 INFO:teuthology.orchestra.run.trial096.stdout:42949672982 2026-02-13T03:34:26.264 INFO:teuthology.orchestra.run.trial096.stdout:55834574869 2026-02-13T03:34:26.264 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-13T03:34:26.264 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-13T03:34:26.270 INFO:teuthology.orchestra.run.trial096.stdout:111669149714 2026-02-13T03:34:26.270 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-13T03:34:26.273 INFO:teuthology.orchestra.run.trial096.stdout:124554051600 2026-02-13T03:34:26.273 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-13T03:34:26.284 INFO:teuthology.orchestra.run.trial096.stdout:154618822671 2026-02-13T03:34:26.284 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-13T03:34:26.288 INFO:teuthology.orchestra.run.trial096.stdout:30064771097 2026-02-13T03:34:26.288 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-13T03:34:26.358 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:26.359 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:26.380 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:26.387 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:26 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2610852866' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:34:26.387 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:26 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3421782545' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:34:26.388 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:26.392 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:26.398 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:26.420 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:26.425 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:26.426 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:26.430 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:26.434 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:26.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:26 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2610852866' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:34:26.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:26 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3421782545' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:34:26.489 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:26.505 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.501+0000 7f904167c6c0 1 -- 10.20.193.96:0/3962100792 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f903c1532e0 msgr2=0x7f903c173720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.505 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.501+0000 7f904167c6c0 1 --2- 10.20.193.96:0/3962100792 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f903c1532e0 0x7f903c173720 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=5270538158860512496 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f902c006fd0 tx=0x7f902c02fd20 comp rx=0 tx=0).stop 2026-02-13T03:34:26.505 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.501+0000 7f904167c6c0 1 -- 10.20.193.96:0/3962100792 shutdown_connections 2026-02-13T03:34:26.505 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.501+0000 7f904167c6c0 1 --2- 10.20.193.96:0/3962100792 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f903c1532e0 0x7f903c173720 unknown :-1 s=CLOSED pgs=278 gs=1 cs=0 l=1 c_cookie=5270538158860512496 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.505 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.501+0000 7f904167c6c0 1 --2- 10.20.193.96:0/3962100792 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f903c10e720 0x7f903c152d10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.505 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.501+0000 7f904167c6c0 1 --2- 10.20.193.96:0/3962100792 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f903c10dd30 0x7f903c10e100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.505 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.501+0000 7f904167c6c0 1 -- 10.20.193.96:0/3962100792 >> 10.20.193.96:0/3962100792 conn(0x7f903c063780 msgr2=0x7f903c109ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.505 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.501+0000 7f904167c6c0 1 -- 10.20.193.96:0/3962100792 shutdown_connections 2026-02-13T03:34:26.505 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.501+0000 7f904167c6c0 1 -- 10.20.193.96:0/3962100792 wait complete. 2026-02-13T03:34:26.506 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.502+0000 7f904167c6c0 1 Processor -- start 2026-02-13T03:34:26.506 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.502+0000 7f904167c6c0 1 -- start start 2026-02-13T03:34:26.507 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.502+0000 7f904167c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f903c10dd30 0x7f903c15f080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.507 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.502+0000 7f904167c6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f903c10e720 0x7f903c15f5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.508 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.502+0000 7f904167c6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f903c1532e0 0x7f903c164980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.508 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.502+0000 7f904167c6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f903c164fd0 con 0x7f903c10dd30 2026-02-13T03:34:26.508 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.502+0000 7f904167c6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f903c165140 con 0x7f903c10e720 2026-02-13T03:34:26.508 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.502+0000 7f904167c6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f903c165300 con 0x7f903c1532e0 2026-02-13T03:34:26.508 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.502+0000 7f903affd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f903c10dd30 0x7f903c15f080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.508 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.502+0000 7f903affd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f903c10dd30 0x7f903c15f080 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49162/0 (socket says 10.20.193.96:49162) 2026-02-13T03:34:26.508 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.502+0000 7f903affd6c0 1 -- 10.20.193.96:0/3046573155 learned_addr learned my addr 10.20.193.96:0/3046573155 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:26.508 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.502+0000 7f903a7fc6c0 1 --2- 10.20.193.96:0/3046573155 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f903c10e720 0x7f903c15f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.508 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.502+0000 7f903b7fe6c0 1 --2- 10.20.193.96:0/3046573155 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f903c1532e0 0x7f903c164980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.508 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.502+0000 7f903affd6c0 1 -- 10.20.193.96:0/3046573155 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f903c1532e0 msgr2=0x7f903c164980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.508 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.502+0000 7f903affd6c0 1 --2- 10.20.193.96:0/3046573155 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f903c1532e0 0x7f903c164980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.509 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.502+0000 7f903affd6c0 1 -- 10.20.193.96:0/3046573155 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f903c10e720 msgr2=0x7f903c15f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.509 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.502+0000 7f903affd6c0 1 --2- 10.20.193.96:0/3046573155 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f903c10e720 0x7f903c15f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.509 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.502+0000 7f903affd6c0 1 -- 10.20.193.96:0/3046573155 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902c00a5b0 con 0x7f903c10dd30 2026-02-13T03:34:26.509 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.503+0000 7f903affd6c0 1 --2- 10.20.193.96:0/3046573155 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f903c10dd30 0x7f903c15f080 secure :-1 s=READY pgs=279 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9030009490 tx=0x7f903000bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.509 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.503+0000 7f901bfff6c0 1 -- 10.20.193.96:0/3046573155 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9030004a80 con 0x7f903c10dd30 2026-02-13T03:34:26.509 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.503+0000 7f901bfff6c0 1 -- 10.20.193.96:0/3046573155 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f9030009030 con 0x7f903c10dd30 2026-02-13T03:34:26.509 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.503+0000 7f904167c6c0 1 -- 10.20.193.96:0/3046573155 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f903c1655e0 con 0x7f903c10dd30 2026-02-13T03:34:26.509 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.503+0000 7f904167c6c0 1 -- 10.20.193.96:0/3046573155 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f903c14edc0 con 0x7f903c10dd30 2026-02-13T03:34:26.509 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.503+0000 7f901bfff6c0 1 -- 10.20.193.96:0/3046573155 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f903000cea0 con 0x7f903c10dd30 2026-02-13T03:34:26.509 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.503+0000 7f9019ffb6c0 1 -- 10.20.193.96:0/3046573155 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9004005310 con 0x7f903c10dd30 2026-02-13T03:34:26.510 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.505+0000 7f901bfff6c0 1 -- 10.20.193.96:0/3046573155 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f9030004060 con 0x7f903c10dd30 2026-02-13T03:34:26.510 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.506+0000 7f901bfff6c0 1 --2- 10.20.193.96:0/3046573155 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f90100b5860 0x7f90100d5d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.510 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.506+0000 7f903a7fc6c0 1 --2- 10.20.193.96:0/3046573155 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f90100b5860 0x7f90100d5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.511 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.506+0000 7f901bfff6c0 1 -- 10.20.193.96:0/3046573155 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f90300e3920 con 0x7f903c10dd30 2026-02-13T03:34:26.511 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.506+0000 7f903a7fc6c0 1 --2- 10.20.193.96:0/3046573155 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f90100b5860 0x7f90100d5d10 secure :-1 s=READY pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f903c165a10 tx=0x7f9024009310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.511 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.506+0000 7f901bfff6c0 1 -- 10.20.193.96:0/3046573155 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f90300a6340 con 0x7f903c10dd30 2026-02-13T03:34:26.512 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.507+0000 7f7dc7cd36c0 1 -- 10.20.193.96:0/2652783591 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7dc01131c0 msgr2=0x7f7dc0173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.513 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.507+0000 7f7dc7cd36c0 1 --2- 10.20.193.96:0/2652783591 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7dc01131c0 0x7f7dc0173b60 secure :-1 s=READY pgs=280 gs=1 cs=0 l=1 c_cookie=17575991142172318894 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dbc00aa70 tx=0x7f7dbc02fe00 comp rx=0 tx=0).stop 2026-02-13T03:34:26.513 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.507+0000 7f7dc7cd36c0 1 -- 10.20.193.96:0/2652783591 shutdown_connections 2026-02-13T03:34:26.513 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.507+0000 7f7dc7cd36c0 1 --2- 10.20.193.96:0/2652783591 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7dc01131c0 0x7f7dc0173b60 unknown :-1 s=CLOSED pgs=280 gs=1 cs=0 l=1 c_cookie=17575991142172318894 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.513 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.507+0000 7f7dc7cd36c0 1 --2- 10.20.193.96:0/2652783591 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7dc010d9a0 0x7f7dc01129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.513 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.507+0000 7f7dc7cd36c0 1 --2- 10.20.193.96:0/2652783591 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7dc010cfb0 0x7f7dc010d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.513 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.507+0000 7f7dc7cd36c0 1 -- 10.20.193.96:0/2652783591 >> 10.20.193.96:0/2652783591 conn(0x7f7dc00ea8b0 msgr2=0x7f7dc010acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.513 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.507+0000 7f7dc7cd36c0 1 -- 10.20.193.96:0/2652783591 shutdown_connections 2026-02-13T03:34:26.513 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.507+0000 7f7dc7cd36c0 1 -- 10.20.193.96:0/2652783591 wait complete. 2026-02-13T03:34:26.513 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.508+0000 7f7dc7cd36c0 1 Processor -- start 2026-02-13T03:34:26.513 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.508+0000 7f7dc7cd36c0 1 -- start start 2026-02-13T03:34:26.513 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.508+0000 7f7dc7cd36c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7dc010cfb0 0x7f7dc011ad00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.514 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.508+0000 7f7dc7cd36c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7dc01131c0 0x7f7dc011b240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.514 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.508+0000 7f7dc7cd36c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7dc0120600 0x7f7dc0120aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.514 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.508+0000 7f7dc5a446c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7dc010cfb0 0x7f7dc011ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.514 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.508+0000 7f7dc62456c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7dc0120600 0x7f7dc0120aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.514 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.508+0000 7f7dc5a446c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7dc010cfb0 0x7f7dc011ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.133:3300/0 says I am v2:10.20.193.96:42058/0 (socket says 10.20.193.96:42058) 2026-02-13T03:34:26.514 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.508+0000 7f7dc52436c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7dc01131c0 0x7f7dc011b240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.514 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.508+0000 7f7dc62456c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7dc0120600 0x7f7dc0120aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49172/0 (socket says 10.20.193.96:49172) 2026-02-13T03:34:26.514 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.508+0000 7f7dc5a446c0 1 -- 10.20.193.96:0/3178365145 learned_addr learned my addr 10.20.193.96:0/3178365145 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:26.514 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.508+0000 7f7dc7cd36c0 1 -- 10.20.193.96:0/3178365145 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc0121010 con 0x7f7dc0120600 2026-02-13T03:34:26.514 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.508+0000 7f7dc7cd36c0 1 -- 10.20.193.96:0/3178365145 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc0121180 con 0x7f7dc01131c0 2026-02-13T03:34:26.514 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.508+0000 7f7dc7cd36c0 1 -- 10.20.193.96:0/3178365145 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc0121340 con 0x7f7dc010cfb0 2026-02-13T03:34:26.514 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.509+0000 7f7dc62456c0 1 -- 10.20.193.96:0/3178365145 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7dc010cfb0 msgr2=0x7f7dc011ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.515 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.509+0000 7f7dc62456c0 1 --2- 10.20.193.96:0/3178365145 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7dc010cfb0 0x7f7dc011ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.515 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.509+0000 7f7dc62456c0 1 -- 10.20.193.96:0/3178365145 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7dc01131c0 msgr2=0x7f7dc011b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.515 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.509+0000 7f7dc62456c0 1 --2- 10.20.193.96:0/3178365145 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7dc01131c0 0x7f7dc011b240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.515 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.509+0000 7f7dc62456c0 1 -- 10.20.193.96:0/3178365145 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dbc00a660 con 0x7f7dc0120600 2026-02-13T03:34:26.515 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.509+0000 7f7dc5a446c0 1 --2- 10.20.193.96:0/3178365145 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7dc010cfb0 0x7f7dc011ad00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T03:34:26.515 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.509+0000 7f7dc62456c0 1 --2- 10.20.193.96:0/3178365145 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7dc0120600 0x7f7dc0120aa0 secure :-1 s=READY pgs=281 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dbc030a30 tx=0x7f7dbc005820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.515 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.509+0000 7f7daeffd6c0 1 -- 10.20.193.96:0/3178365145 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7dbc032e20 con 0x7f7dc0120600 2026-02-13T03:34:26.515 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.509+0000 7f7daeffd6c0 1 -- 10.20.193.96:0/3178365145 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f7dbc003cf0 con 0x7f7dc0120600 2026-02-13T03:34:26.515 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.509+0000 7f7dc7cd36c0 1 -- 10.20.193.96:0/3178365145 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc0161790 con 0x7f7dc0120600 2026-02-13T03:34:26.516 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:26 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2610852866' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:34:26.516 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:26 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3421782545' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:34:26.516 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.511+0000 7f7daeffd6c0 1 -- 10.20.193.96:0/3178365145 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7dbc008550 con 0x7f7dc0120600 2026-02-13T03:34:26.516 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.511+0000 7f7dc7cd36c0 1 -- 10.20.193.96:0/3178365145 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc0161bc0 con 0x7f7dc0120600 2026-02-13T03:34:26.517 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.511+0000 7f7dc7cd36c0 1 -- 10.20.193.96:0/3178365145 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dc010e280 con 0x7f7dc0120600 2026-02-13T03:34:26.517 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.512+0000 7fcfcd9806c0 1 -- 10.20.193.96:0/36622967 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fcfc810fc20 msgr2=0x7fcfc8114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.517 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.512+0000 7fcfcd9806c0 1 --2- 10.20.193.96:0/36622967 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fcfc810fc20 0x7fcfc8114c60 secure :-1 s=READY pgs=60 gs=2 cs=0 l=1 c_cookie=10250064062368704326 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfb00098d0 tx=0x7fcfb002ec40 comp rx=0 tx=0).stop 2026-02-13T03:34:26.517 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.512+0000 7fcfcd9806c0 1 -- 10.20.193.96:0/36622967 shutdown_connections 2026-02-13T03:34:26.518 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.512+0000 7fcfcd9806c0 1 --2- 10.20.193.96:0/36622967 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcfc8115440 0x7fcfc8175de0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.518 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.512+0000 7fcfcd9806c0 1 --2- 10.20.193.96:0/36622967 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fcfc810fc20 0x7fcfc8114c60 unknown :-1 s=CLOSED pgs=60 gs=2 cs=0 l=1 c_cookie=10250064062368704326 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.518 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.512+0000 7fcfcd9806c0 1 --2- 10.20.193.96:0/36622967 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fcfc810f230 0x7fcfc810f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.518 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.512+0000 7fcfcd9806c0 1 -- 10.20.193.96:0/36622967 >> 10.20.193.96:0/36622967 conn(0x7fcfc80ecb30 msgr2=0x7fcfc810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.518 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.512+0000 7fcfcd9806c0 1 -- 10.20.193.96:0/36622967 shutdown_connections 2026-02-13T03:34:26.518 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.512+0000 7fcfcd9806c0 1 -- 10.20.193.96:0/36622967 wait complete. 2026-02-13T03:34:26.518 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.512+0000 7fcfcd9806c0 1 Processor -- start 2026-02-13T03:34:26.518 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.512+0000 7fcfcd9806c0 1 -- start start 2026-02-13T03:34:26.519 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.512+0000 7f7daeffd6c0 1 -- 10.20.193.96:0/3178365145 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f7dbc008720 con 0x7f7dc0120600 2026-02-13T03:34:26.519 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.513+0000 7f7daeffd6c0 1 --2- 10.20.193.96:0/3178365145 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7d9c0b5790 0x7f7d9c0d5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.519 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.513+0000 7f7dc5a446c0 1 --2- 10.20.193.96:0/3178365145 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7d9c0b5790 0x7f7d9c0d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.519 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.513+0000 7f7daeffd6c0 1 -- 10.20.193.96:0/3178365145 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f7dbc108d60 con 0x7f7dc0120600 2026-02-13T03:34:26.519 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.513+0000 7f7dc5a446c0 1 --2- 10.20.193.96:0/3178365145 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7d9c0b5790 0x7f7d9c0d5c40 secure :-1 s=READY pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7db00095e0 tx=0x7f7db0009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.521 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.513+0000 7fcfcd9806c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcfc810f230 0x7fcfc80f4b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.521 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.513+0000 7fcfcd9806c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fcfc8115440 0x7fcfc8175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.521 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.514+0000 7fcfc6ffd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcfc810f230 0x7fcfc80f4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.521 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.514+0000 7fcfc6ffd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcfc810f230 0x7fcfc80f4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49180/0 (socket says 10.20.193.96:49180) 2026-02-13T03:34:26.522 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.514+0000 7fcfc6ffd6c0 1 -- 10.20.193.96:0/528584071 learned_addr learned my addr 10.20.193.96:0/528584071 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:26.522 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.514+0000 7fcfcd9806c0 1 --2- 10.20.193.96:0/528584071 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fcfc80f5160 0x7fcfc80fa430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.522 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.514+0000 7fcfcd9806c0 1 -- 10.20.193.96:0/528584071 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc80f5850 con 0x7fcfc810f230 2026-02-13T03:34:26.522 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.514+0000 7fcfcd9806c0 1 -- 10.20.193.96:0/528584071 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc80fa970 con 0x7fcfc80f5160 2026-02-13T03:34:26.522 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.514+0000 7fcfcd9806c0 1 -- 10.20.193.96:0/528584071 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc80fab30 con 0x7fcfc8115440 2026-02-13T03:34:26.522 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.514+0000 7fcfc67fc6c0 1 --2- 10.20.193.96:0/528584071 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fcfc8115440 0x7fcfc8175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.522 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.514+0000 7fcfc77fe6c0 1 --2- 10.20.193.96:0/528584071 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fcfc80f5160 0x7fcfc80fa430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.522 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.514+0000 7fcfc67fc6c0 1 -- 10.20.193.96:0/528584071 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fcfc80f5160 msgr2=0x7fcfc80fa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.522 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.514+0000 7fcfc67fc6c0 1 --2- 10.20.193.96:0/528584071 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fcfc80f5160 0x7fcfc80fa430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.522 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.514+0000 7fcfc67fc6c0 1 -- 10.20.193.96:0/528584071 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcfc810f230 msgr2=0x7fcfc80f4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.522 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.514+0000 7fcfc67fc6c0 1 --2- 10.20.193.96:0/528584071 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcfc810f230 0x7fcfc80f4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.523 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.514+0000 7fcfc67fc6c0 1 -- 10.20.193.96:0/528584071 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb00094c0 con 0x7fcfc8115440 2026-02-13T03:34:26.523 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.514+0000 7fcfc6ffd6c0 1 --2- 10.20.193.96:0/528584071 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcfc810f230 0x7fcfc80f4b30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T03:34:26.523 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.514+0000 7fcfc67fc6c0 1 --2- 10.20.193.96:0/528584071 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fcfc8115440 0x7fcfc8175ce0 secure :-1 s=READY pgs=61 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfc8055800 tx=0x7fcfb002fb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.523 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.514+0000 7fcfcc97e6c0 1 -- 10.20.193.96:0/528584071 <== mon.1 v2:10.20.193.133:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcfb0002ae0 con 0x7fcfc8115440 2026-02-13T03:34:26.523 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.514+0000 7fcfcc97e6c0 1 -- 10.20.193.96:0/528584071 <== mon.1 v2:10.20.193.133:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fcfb0002c40 con 0x7fcfc8115440 2026-02-13T03:34:26.523 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.514+0000 7fcfcd9806c0 1 -- 10.20.193.96:0/528584071 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc80fadb0 con 0x7fcfc8115440 2026-02-13T03:34:26.523 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.515+0000 7fcfcc97e6c0 1 -- 10.20.193.96:0/528584071 <== mon.1 v2:10.20.193.133:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcfb00372f0 con 0x7fcfc8115440 2026-02-13T03:34:26.523 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.515+0000 7fcfcd9806c0 1 -- 10.20.193.96:0/528584071 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc80fb5a0 con 0x7fcfc8115440 2026-02-13T03:34:26.523 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.515+0000 7fcfcd9806c0 1 -- 10.20.193.96:0/528584071 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfc8110500 con 0x7fcfc8115440 2026-02-13T03:34:26.523 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.516+0000 7f7daeffd6c0 1 -- 10.20.193.96:0/3178365145 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7dbc0cb780 con 0x7f7dc0120600 2026-02-13T03:34:26.524 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.516+0000 7fcfcc97e6c0 1 -- 10.20.193.96:0/528584071 <== mon.1 v2:10.20.193.133:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fcfb00071c0 con 0x7fcfc8115440 2026-02-13T03:34:26.524 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.517+0000 7fcfcc97e6c0 1 --2- 10.20.193.96:0/528584071 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcf9c0b5590 0x7fcf9c0d5a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.525 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.517+0000 7fcfcc97e6c0 1 -- 10.20.193.96:0/528584071 <== mon.1 v2:10.20.193.133:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7fcfb0107b10 con 0x7fcfc8115440 2026-02-13T03:34:26.525 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.517+0000 7fcfc6ffd6c0 1 --2- 10.20.193.96:0/528584071 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcf9c0b5590 0x7fcf9c0d5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.525 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.517+0000 7fcfc6ffd6c0 1 --2- 10.20.193.96:0/528584071 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcf9c0b5590 0x7fcf9c0d5a40 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfbc005b40 tx=0x7fcfbc009310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.525 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.518+0000 7fcfcc97e6c0 1 -- 10.20.193.96:0/528584071 <== mon.1 v2:10.20.193.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fcfb00ca530 con 0x7fcfc8115440 2026-02-13T03:34:26.527 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.522+0000 7f9871bc96c0 1 -- 10.20.193.96:0/2234219119 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f986c10fc20 msgr2=0x7f986c114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.528 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.522+0000 7f9871bc96c0 1 --2- 10.20.193.96:0/2234219119 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f986c10fc20 0x7f986c114c60 secure :-1 s=READY pgs=282 gs=1 cs=0 l=1 c_cookie=14297006660857950936 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f985c0099a0 tx=0x7f985c02ed70 comp rx=0 tx=0).stop 2026-02-13T03:34:26.528 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.522+0000 7f9871bc96c0 1 -- 10.20.193.96:0/2234219119 shutdown_connections 2026-02-13T03:34:26.528 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.522+0000 7f9871bc96c0 1 --2- 10.20.193.96:0/2234219119 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f986c115440 0x7f986c175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.528 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.522+0000 7f9871bc96c0 1 --2- 10.20.193.96:0/2234219119 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f986c10fc20 0x7f986c114c60 unknown :-1 s=CLOSED pgs=282 gs=1 cs=0 l=1 c_cookie=14297006660857950936 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.528 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.522+0000 7f9871bc96c0 1 --2- 10.20.193.96:0/2234219119 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f986c10f230 0x7f986c10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.528 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.522+0000 7f9871bc96c0 1 -- 10.20.193.96:0/2234219119 >> 10.20.193.96:0/2234219119 conn(0x7f986c0ecb30 msgr2=0x7f986c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.528 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.522+0000 7f9871bc96c0 1 -- 10.20.193.96:0/2234219119 shutdown_connections 2026-02-13T03:34:26.528 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.522+0000 7f9871bc96c0 1 -- 10.20.193.96:0/2234219119 wait complete. 2026-02-13T03:34:26.528 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.523+0000 7f9871bc96c0 1 Processor -- start 2026-02-13T03:34:26.528 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.523+0000 7f9871bc96c0 1 -- start start 2026-02-13T03:34:26.528 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.523+0000 7f9871bc96c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f986c10f230 0x7f986c0f4cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.523+0000 7f9871bc96c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f986c115440 0x7f986c175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.523+0000 7f9871bc96c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f986c0f52e0 0x7f986c0fa560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.523+0000 7f9871bc96c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f986c0f59d0 con 0x7f986c0f52e0 2026-02-13T03:34:26.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.523+0000 7f986bfff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f986c0f52e0 0x7f986c0fa560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.523+0000 7f986b7fe6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f986c10f230 0x7f986c0f4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.523+0000 7f986b7fe6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f986c10f230 0x7f986c0f4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.132:3300/0 says I am v2:10.20.193.96:36504/0 (socket says 10.20.193.96:36504) 2026-02-13T03:34:26.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.523+0000 7f986b7fe6c0 1 -- 10.20.193.96:0/4293855581 learned_addr learned my addr 10.20.193.96:0/4293855581 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:26.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.523+0000 7f986affd6c0 1 --2- 10.20.193.96:0/4293855581 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f986c115440 0x7f986c175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.524+0000 7f9871bc96c0 1 -- 10.20.193.96:0/4293855581 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f986c0faaa0 con 0x7f986c10f230 2026-02-13T03:34:26.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.524+0000 7f9871bc96c0 1 -- 10.20.193.96:0/4293855581 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f986c0fac60 con 0x7f986c115440 2026-02-13T03:34:26.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.524+0000 7f986bfff6c0 1 -- 10.20.193.96:0/4293855581 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f986c115440 msgr2=0x7f986c175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.524+0000 7f986bfff6c0 1 --2- 10.20.193.96:0/4293855581 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f986c115440 0x7f986c175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.529 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.524+0000 7f986bfff6c0 1 -- 10.20.193.96:0/4293855581 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f986c10f230 msgr2=0x7f986c0f4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.530 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.524+0000 7f986bfff6c0 1 --2- 10.20.193.96:0/4293855581 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f986c10f230 0x7f986c0f4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.530 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.524+0000 7f986bfff6c0 1 -- 10.20.193.96:0/4293855581 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985c009590 con 0x7f986c0f52e0 2026-02-13T03:34:26.530 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.524+0000 7f986bfff6c0 1 --2- 10.20.193.96:0/4293855581 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f986c0f52e0 0x7f986c0fa560 secure :-1 s=READY pgs=283 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f986000c6c0 tx=0x7f986000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.530 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.524+0000 7f9868ff96c0 1 -- 10.20.193.96:0/4293855581 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9860005340 con 0x7f986c0f52e0 2026-02-13T03:34:26.530 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.524+0000 7f9868ff96c0 1 -- 10.20.193.96:0/4293855581 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f9860003cf0 con 0x7f986c0f52e0 2026-02-13T03:34:26.530 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.524+0000 7f9871bc96c0 1 -- 10.20.193.96:0/4293855581 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f986c0faf40 con 0x7f986c0f52e0 2026-02-13T03:34:26.530 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.524+0000 7f9868ff96c0 1 -- 10.20.193.96:0/4293855581 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f986000dd00 con 0x7f986c0f52e0 2026-02-13T03:34:26.530 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.524+0000 7f9871bc96c0 1 -- 10.20.193.96:0/4293855581 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f986c0fb6d0 con 0x7f986c0f52e0 2026-02-13T03:34:26.531 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.525+0000 7f9871bc96c0 1 -- 10.20.193.96:0/4293855581 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f986c0fb420 con 0x7f986c0f52e0 2026-02-13T03:34:26.531 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.527+0000 7f9868ff96c0 1 -- 10.20.193.96:0/4293855581 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f98600054a0 con 0x7f986c0f52e0 2026-02-13T03:34:26.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.526+0000 7f496bbf56c0 1 -- 10.20.193.96:0/3023557813 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4964115410 msgr2=0x7f4964175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.526+0000 7f496bbf56c0 1 --2- 10.20.193.96:0/3023557813 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4964115410 0x7f4964175db0 secure :-1 s=READY pgs=53 gs=3 cs=0 l=1 c_cookie=17019925638420193082 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4960006fd0 tx=0x7f496002fd20 comp rx=0 tx=0).stop 2026-02-13T03:34:26.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.527+0000 7f496bbf56c0 1 -- 10.20.193.96:0/3023557813 shutdown_connections 2026-02-13T03:34:26.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.527+0000 7f496bbf56c0 1 --2- 10.20.193.96:0/3023557813 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4964115410 0x7f4964175db0 unknown :-1 s=CLOSED pgs=53 gs=3 cs=0 l=1 c_cookie=17019925638420193082 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.527+0000 7f496bbf56c0 1 --2- 10.20.193.96:0/3023557813 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f496410fbf0 0x7f4964114c30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.527+0000 7f496bbf56c0 1 --2- 10.20.193.96:0/3023557813 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f496410f200 0x7f496410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.527+0000 7f496bbf56c0 1 -- 10.20.193.96:0/3023557813 >> 10.20.193.96:0/3023557813 conn(0x7f49640ecb00 msgr2=0x7f496410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.527+0000 7f496bbf56c0 1 -- 10.20.193.96:0/3023557813 shutdown_connections 2026-02-13T03:34:26.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.527+0000 7f496bbf56c0 1 -- 10.20.193.96:0/3023557813 wait complete. 2026-02-13T03:34:26.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.527+0000 7f496bbf56c0 1 Processor -- start 2026-02-13T03:34:26.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.527+0000 7f496bbf56c0 1 -- start start 2026-02-13T03:34:26.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.527+0000 7f496bbf56c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f496410f200 0x7f496411d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.527+0000 7f496bbf56c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4964115410 0x7f496411d740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.527+0000 7f496bbf56c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4964122b00 0x7f4964122fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.527+0000 7f496bbf56c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4964123510 con 0x7f496410f200 2026-02-13T03:34:26.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.527+0000 7f496bbf56c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4964123680 con 0x7f4964115410 2026-02-13T03:34:26.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.527+0000 7f496bbf56c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4964123840 con 0x7f4964122b00 2026-02-13T03:34:26.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.527+0000 7f49691656c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4964115410 0x7f496411d740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.527+0000 7f49691656c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4964115410 0x7f496411d740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.132:3300/0 says I am v2:10.20.193.96:36520/0 (socket says 10.20.193.96:36520) 2026-02-13T03:34:26.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.527+0000 7f49691656c0 1 -- 10.20.193.96:0/4200401531 learned_addr learned my addr 10.20.193.96:0/4200401531 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:26.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.528+0000 7f496a1676c0 1 --2- 10.20.193.96:0/4200401531 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4964122b00 0x7f4964122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.534 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.527+0000 7f9868ff96c0 1 --2- 10.20.193.96:0/4293855581 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f98400b5790 0x7f98400d5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.534 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.527+0000 7f9868ff96c0 1 -- 10.20.193.96:0/4293855581 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f98600e4850 con 0x7f986c0f52e0 2026-02-13T03:34:26.534 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.527+0000 7f986b7fe6c0 1 --2- 10.20.193.96:0/4293855581 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f98400b5790 0x7f98400d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.534 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.528+0000 7f49699666c0 1 --2- 10.20.193.96:0/4200401531 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f496410f200 0x7f496411d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.535 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.528+0000 7f49691656c0 1 -- 10.20.193.96:0/4200401531 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4964122b00 msgr2=0x7f4964122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.535 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.528+0000 7f49691656c0 1 --2- 10.20.193.96:0/4200401531 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4964122b00 0x7f4964122fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.535 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.528+0000 7f49691656c0 1 -- 10.20.193.96:0/4200401531 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f496410f200 msgr2=0x7f496411d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.535 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.528+0000 7f986b7fe6c0 1 --2- 10.20.193.96:0/4293855581 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f98400b5790 0x7f98400d5c40 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9858005980 tx=0x7f9858009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.536 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.528+0000 7f49691656c0 1 --2- 10.20.193.96:0/4200401531 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f496410f200 0x7f496411d200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.536 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.528+0000 7f49691656c0 1 -- 10.20.193.96:0/4200401531 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4954009590 con 0x7f4964115410 2026-02-13T03:34:26.536 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.528+0000 7f49699666c0 1 --2- 10.20.193.96:0/4200401531 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f496410f200 0x7f496411d200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:34:26.537 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.528+0000 7f49691656c0 1 --2- 10.20.193.96:0/4200401531 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4964115410 0x7f496411d740 secure :-1 s=READY pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f495800b800 tx=0x7f495800bcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.537 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.528+0000 7f4952ffd6c0 1 -- 10.20.193.96:0/4200401531 <== mon.2 v2:10.20.193.132:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4958004a80 con 0x7f4964115410 2026-02-13T03:34:26.537 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.528+0000 7f4952ffd6c0 1 -- 10.20.193.96:0/4200401531 <== mon.2 v2:10.20.193.132:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f4958009070 con 0x7f4964115410 2026-02-13T03:34:26.537 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.528+0000 7f496bbf56c0 1 -- 10.20.193.96:0/4200401531 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f496000a5b0 con 0x7f4964115410 2026-02-13T03:34:26.537 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.528+0000 7f496bbf56c0 1 -- 10.20.193.96:0/4200401531 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4964163ff0 con 0x7f4964115410 2026-02-13T03:34:26.537 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.528+0000 7f4952ffd6c0 1 -- 10.20.193.96:0/4200401531 <== mon.2 v2:10.20.193.132:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f495800ce40 con 0x7f4964115410 2026-02-13T03:34:26.537 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.529+0000 7f496bbf56c0 1 -- 10.20.193.96:0/4200401531 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49641104d0 con 0x7f4964115410 2026-02-13T03:34:26.537 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.529+0000 7f9868ff96c0 1 -- 10.20.193.96:0/4293855581 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f98600a7270 con 0x7f986c0f52e0 2026-02-13T03:34:26.538 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.530+0000 7f4952ffd6c0 1 -- 10.20.193.96:0/4200401531 <== mon.2 v2:10.20.193.132:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f4958005000 con 0x7f4964115410 2026-02-13T03:34:26.538 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.531+0000 7f4952ffd6c0 1 --2- 10.20.193.96:0/4200401531 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f49400b5690 0x7f49400d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.538 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.531+0000 7f4952ffd6c0 1 -- 10.20.193.96:0/4200401531 <== mon.2 v2:10.20.193.132:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f49580e3a00 con 0x7f4964115410 2026-02-13T03:34:26.539 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.531+0000 7f49699666c0 1 --2- 10.20.193.96:0/4200401531 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f49400b5690 0x7f49400d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.539 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.531+0000 7f4952ffd6c0 1 -- 10.20.193.96:0/4200401531 <== mon.2 v2:10.20.193.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f49580a6460 con 0x7f4964115410 2026-02-13T03:34:26.539 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.531+0000 7f49699666c0 1 --2- 10.20.193.96:0/4200401531 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f49400b5690 0x7f49400d5b40 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4954005b40 tx=0x7f4954009310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.541 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.532+0000 7f555a71c6c0 1 -- 10.20.193.96:0/2540387795 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f555410fc20 msgr2=0x7f5554114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.542 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.532+0000 7f555a71c6c0 1 --2- 10.20.193.96:0/2540387795 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f555410fc20 0x7f5554114c60 secure :-1 s=READY pgs=284 gs=1 cs=0 l=1 c_cookie=17315395771850606816 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55440099a0 tx=0x7f554402ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:26.542 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.534+0000 7f555a71c6c0 1 -- 10.20.193.96:0/2540387795 shutdown_connections 2026-02-13T03:34:26.542 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.534+0000 7f555a71c6c0 1 --2- 10.20.193.96:0/2540387795 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5554115440 0x7f5554175de0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.542 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.534+0000 7f555a71c6c0 1 --2- 10.20.193.96:0/2540387795 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f555410fc20 0x7f5554114c60 unknown :-1 s=CLOSED pgs=284 gs=1 cs=0 l=1 c_cookie=17315395771850606816 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.542 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.534+0000 7f555a71c6c0 1 --2- 10.20.193.96:0/2540387795 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f555410f230 0x7f555410f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.542 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.534+0000 7f555a71c6c0 1 -- 10.20.193.96:0/2540387795 >> 10.20.193.96:0/2540387795 conn(0x7f55540ecb30 msgr2=0x7f555410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.542 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.534+0000 7f555a71c6c0 1 -- 10.20.193.96:0/2540387795 shutdown_connections 2026-02-13T03:34:26.542 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.534+0000 7f555a71c6c0 1 -- 10.20.193.96:0/2540387795 wait complete. 2026-02-13T03:34:26.542 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.534+0000 7f555a71c6c0 1 Processor -- start 2026-02-13T03:34:26.542 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.534+0000 7f555a71c6c0 1 -- start start 2026-02-13T03:34:26.543 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.534+0000 7f555a71c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f555410f230 0x7f5554066730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.543 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.534+0000 7f555a71c6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5554115440 0x7f5554175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.543 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.534+0000 7f555a71c6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5554062990 0x7f5554062e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.543 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.534+0000 7f555a71c6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5554063510 con 0x7f555410f230 2026-02-13T03:34:26.543 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.534+0000 7f555a71c6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5554063680 con 0x7f5554115440 2026-02-13T03:34:26.543 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.534+0000 7f555a71c6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5554063840 con 0x7f5554062990 2026-02-13T03:34:26.543 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.535+0000 7f5553fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f555410f230 0x7f5554066730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.543 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.535+0000 7f5553fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f555410f230 0x7f5554066730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49238/0 (socket says 10.20.193.96:49238) 2026-02-13T03:34:26.543 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.535+0000 7f5553fff6c0 1 -- 10.20.193.96:0/2211148984 learned_addr learned my addr 10.20.193.96:0/2211148984 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:26.543 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.535+0000 7f5558c926c0 1 --2- 10.20.193.96:0/2211148984 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5554062990 0x7f5554062e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.543 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.535+0000 7f55537fe6c0 1 --2- 10.20.193.96:0/2211148984 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5554115440 0x7f5554175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.543 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.535+0000 7f5553fff6c0 1 -- 10.20.193.96:0/2211148984 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5554062990 msgr2=0x7f5554062e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.535+0000 7f5553fff6c0 1 --2- 10.20.193.96:0/2211148984 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5554062990 0x7f5554062e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.535+0000 7f5553fff6c0 1 -- 10.20.193.96:0/2211148984 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5554115440 msgr2=0x7f5554175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.535+0000 7f5553fff6c0 1 --2- 10.20.193.96:0/2211148984 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5554115440 0x7f5554175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.535+0000 7f5553fff6c0 1 -- 10.20.193.96:0/2211148984 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5544009590 con 0x7f555410f230 2026-02-13T03:34:26.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.535+0000 7f5553fff6c0 1 --2- 10.20.193.96:0/2211148984 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f555410f230 0x7f5554066730 secure :-1 s=READY pgs=285 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f554000b6c0 tx=0x7f554000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.535+0000 7f55517fa6c0 1 -- 10.20.193.96:0/2211148984 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5540004560 con 0x7f555410f230 2026-02-13T03:34:26.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.535+0000 7f555a71c6c0 1 -- 10.20.193.96:0/2211148984 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55540ff480 con 0x7f555410f230 2026-02-13T03:34:26.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.535+0000 7f55517fa6c0 1 -- 10.20.193.96:0/2211148984 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f5540009030 con 0x7f555410f230 2026-02-13T03:34:26.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.535+0000 7f55517fa6c0 1 -- 10.20.193.96:0/2211148984 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f554000ce20 con 0x7f555410f230 2026-02-13T03:34:26.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.535+0000 7f555a71c6c0 1 -- 10.20.193.96:0/2211148984 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55540ff9b0 con 0x7f555410f230 2026-02-13T03:34:26.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.536+0000 7f555a71c6c0 1 -- 10.20.193.96:0/2211148984 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5554110500 con 0x7f555410f230 2026-02-13T03:34:26.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.538+0000 7f55517fa6c0 1 -- 10.20.193.96:0/2211148984 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f55400026b0 con 0x7f555410f230 2026-02-13T03:34:26.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.539+0000 7f55517fa6c0 1 --2- 10.20.193.96:0/2211148984 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f55280b5710 0x7f55280d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.539+0000 7f55517fa6c0 1 -- 10.20.193.96:0/2211148984 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f55400e38b0 con 0x7f555410f230 2026-02-13T03:34:26.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.540+0000 7f55537fe6c0 1 --2- 10.20.193.96:0/2211148984 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f55280b5710 0x7f55280d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.540+0000 7f55537fe6c0 1 --2- 10.20.193.96:0/2211148984 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f55280b5710 0x7f55280d5bc0 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5544005b40 tx=0x7f5544005da0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.546 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.540+0000 7f55517fa6c0 1 -- 10.20.193.96:0/2211148984 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f55400a6310 con 0x7f555410f230 2026-02-13T03:34:26.560 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.557+0000 7f380b2f56c0 1 -- 10.20.193.96:0/1196355633 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f380410ba70 msgr2=0x7f380410be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.560 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.557+0000 7f380b2f56c0 1 --2- 10.20.193.96:0/1196355633 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f380410ba70 0x7f380410be40 secure :-1 s=READY pgs=286 gs=1 cs=0 l=1 c_cookie=12802689032863196128 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37f4009970 tx=0x7f37f402ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:26.561 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.558+0000 7f380b2f56c0 1 -- 10.20.193.96:0/1196355633 shutdown_connections 2026-02-13T03:34:26.561 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.558+0000 7f380b2f56c0 1 --2- 10.20.193.96:0/1196355633 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f38041557a0 0x7f3804175b80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.561 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.558+0000 7f380b2f56c0 1 --2- 10.20.193.96:0/1196355633 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f380410c380 0x7f3804155260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.561 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.558+0000 7f380b2f56c0 1 --2- 10.20.193.96:0/1196355633 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f380410ba70 0x7f380410be40 unknown :-1 s=CLOSED pgs=286 gs=1 cs=0 l=1 c_cookie=12802689032863196128 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.561 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.558+0000 7f380b2f56c0 1 -- 10.20.193.96:0/1196355633 >> 10.20.193.96:0/1196355633 conn(0x7f38040e9770 msgr2=0x7f3804109b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.561 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.558+0000 7f380b2f56c0 1 -- 10.20.193.96:0/1196355633 shutdown_connections 2026-02-13T03:34:26.561 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.558+0000 7f380b2f56c0 1 -- 10.20.193.96:0/1196355633 wait complete. 2026-02-13T03:34:26.562 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.558+0000 7f380b2f56c0 1 Processor -- start 2026-02-13T03:34:26.562 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.558+0000 7f380b2f56c0 1 -- start start 2026-02-13T03:34:26.562 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.559+0000 7f380b2f56c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f380410ba70 0x7f3804160540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.563 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.559+0000 7f380b2f56c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f380410c380 0x7f3804160a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.563 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.559+0000 7f380b2f56c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f38041557a0 0x7f3804165e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.563 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.559+0000 7f380b2f56c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3804166490 con 0x7f380410ba70 2026-02-13T03:34:26.563 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.559+0000 7f380b2f56c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3804166600 con 0x7f38041557a0 2026-02-13T03:34:26.563 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.559+0000 7f380b2f56c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f38041667c0 con 0x7f380410c380 2026-02-13T03:34:26.563 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.559+0000 7f38090666c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f380410ba70 0x7f3804160540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.563 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.559+0000 7f38090666c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f380410ba70 0x7f3804160540 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49250/0 (socket says 10.20.193.96:49250) 2026-02-13T03:34:26.563 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.559+0000 7f38090666c0 1 -- 10.20.193.96:0/2097564760 learned_addr learned my addr 10.20.193.96:0/2097564760 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:26.563 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.559+0000 7f38088656c0 1 --2- 10.20.193.96:0/2097564760 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f380410c380 0x7f3804160a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.563 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.559+0000 7f38098676c0 1 --2- 10.20.193.96:0/2097564760 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f38041557a0 0x7f3804165e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.563 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.559+0000 7f38090666c0 1 -- 10.20.193.96:0/2097564760 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f380410c380 msgr2=0x7f3804160a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.563 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.559+0000 7f38090666c0 1 --2- 10.20.193.96:0/2097564760 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f380410c380 0x7f3804160a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.563 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.559+0000 7f38090666c0 1 -- 10.20.193.96:0/2097564760 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f38041557a0 msgr2=0x7f3804165e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.564 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.559+0000 7f38090666c0 1 --2- 10.20.193.96:0/2097564760 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f38041557a0 0x7f3804165e40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.564 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.559+0000 7f38090666c0 1 -- 10.20.193.96:0/2097564760 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f4009590 con 0x7f380410ba70 2026-02-13T03:34:26.564 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.559+0000 7f38090666c0 1 --2- 10.20.193.96:0/2097564760 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f380410ba70 0x7f3804160540 secure :-1 s=READY pgs=287 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37f4031fd0 tx=0x7f37f402fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.564 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.559+0000 7f37f27fc6c0 1 -- 10.20.193.96:0/2097564760 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37f4002ae0 con 0x7f380410ba70 2026-02-13T03:34:26.564 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.559+0000 7f380b2f56c0 1 -- 10.20.193.96:0/2097564760 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3804166a40 con 0x7f380410ba70 2026-02-13T03:34:26.564 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.559+0000 7f380b2f56c0 1 -- 10.20.193.96:0/2097564760 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38041523e0 con 0x7f380410ba70 2026-02-13T03:34:26.564 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.559+0000 7f37f27fc6c0 1 -- 10.20.193.96:0/2097564760 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f37f4007740 con 0x7f380410ba70 2026-02-13T03:34:26.564 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.559+0000 7f37f27fc6c0 1 -- 10.20.193.96:0/2097564760 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37f4031340 con 0x7f380410ba70 2026-02-13T03:34:26.565 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.560+0000 7f380b2f56c0 1 -- 10.20.193.96:0/2097564760 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f380405fb30 con 0x7f380410ba70 2026-02-13T03:34:26.565 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.562+0000 7f37f27fc6c0 1 -- 10.20.193.96:0/2097564760 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f37f4002c40 con 0x7f380410ba70 2026-02-13T03:34:26.565 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.562+0000 7f37f27fc6c0 1 --2- 10.20.193.96:0/2097564760 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f37e00b5690 0x7f37e00d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.566 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.563+0000 7f38088656c0 1 --2- 10.20.193.96:0/2097564760 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f37e00b5690 0x7f37e00d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.566 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.563+0000 7f37f27fc6c0 1 -- 10.20.193.96:0/2097564760 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f37f4107c40 con 0x7f380410ba70 2026-02-13T03:34:26.566 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.563+0000 7f38088656c0 1 --2- 10.20.193.96:0/2097564760 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f37e00b5690 0x7f37e00d5b40 secure :-1 s=READY pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3804166ed0 tx=0x7f37f8009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.567 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.564+0000 7f76e32fc6c0 1 -- 10.20.193.96:0/796189286 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f76dc1131c0 msgr2=0x7f76dc173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.567 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.564+0000 7f76e32fc6c0 1 --2- 10.20.193.96:0/796189286 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f76dc1131c0 0x7f76dc173b60 secure :-1 s=READY pgs=55 gs=3 cs=0 l=1 c_cookie=677406353220563053 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76d800aa40 tx=0x7f76d802fde0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.567 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.564+0000 7f76e32fc6c0 1 -- 10.20.193.96:0/796189286 shutdown_connections 2026-02-13T03:34:26.567 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.564+0000 7f76e32fc6c0 1 --2- 10.20.193.96:0/796189286 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f76dc1131c0 0x7f76dc173b60 unknown :-1 s=CLOSED pgs=55 gs=3 cs=0 l=1 c_cookie=677406353220563053 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.567 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.564+0000 7f76e32fc6c0 1 --2- 10.20.193.96:0/796189286 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f76dc10d9a0 0x7f76dc1129e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.568 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.564+0000 7f76e32fc6c0 1 --2- 10.20.193.96:0/796189286 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f76dc10cfb0 0x7f76dc10d380 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.568 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.564+0000 7f76e32fc6c0 1 -- 10.20.193.96:0/796189286 >> 10.20.193.96:0/796189286 conn(0x7f76dc0ea8b0 msgr2=0x7f76dc10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.568 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.564+0000 7f76e32fc6c0 1 -- 10.20.193.96:0/796189286 shutdown_connections 2026-02-13T03:34:26.568 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.564+0000 7f76e32fc6c0 1 -- 10.20.193.96:0/796189286 wait complete. 2026-02-13T03:34:26.568 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.564+0000 7f37f27fc6c0 1 -- 10.20.193.96:0/2097564760 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f37f40ca660 con 0x7f380410ba70 2026-02-13T03:34:26.569 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.564+0000 7f76e32fc6c0 1 Processor -- start 2026-02-13T03:34:26.570 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.564+0000 7f76e32fc6c0 1 -- start start 2026-02-13T03:34:26.570 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.565+0000 7f76e32fc6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f76dc10cfb0 0x7f76dc0f4a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.570 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.565+0000 7f76e32fc6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f76dc1131c0 0x7f76dc173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.570 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.565+0000 7f76e32fc6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f76dc0f50b0 0x7f76dc0fa380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.570 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.565+0000 7f76e32fc6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f76dc0f57a0 con 0x7f76dc1131c0 2026-02-13T03:34:26.570 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.565+0000 7f76e32fc6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f76dc0fa8c0 con 0x7f76dc0f50b0 2026-02-13T03:34:26.570 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.565+0000 7f76e32fc6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f76dc0faa80 con 0x7f76dc10cfb0 2026-02-13T03:34:26.570 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.565+0000 7f76e086c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f76dc1131c0 0x7f76dc173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.570 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.565+0000 7f76e086c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f76dc1131c0 0x7f76dc173a60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49280/0 (socket says 10.20.193.96:49280) 2026-02-13T03:34:26.570 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.565+0000 7f76e086c6c0 1 -- 10.20.193.96:0/998693319 learned_addr learned my addr 10.20.193.96:0/998693319 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:26.570 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.565+0000 7f76e186e6c0 1 --2- 10.20.193.96:0/998693319 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f76dc0f50b0 0x7f76dc0fa380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.571 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.565+0000 7f76e086c6c0 1 -- 10.20.193.96:0/998693319 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f76dc10cfb0 msgr2=0x7f76dc0f4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.571 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.565+0000 7f76e086c6c0 1 --2- 10.20.193.96:0/998693319 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f76dc10cfb0 0x7f76dc0f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.571 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.565+0000 7f76e086c6c0 1 -- 10.20.193.96:0/998693319 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f76dc0f50b0 msgr2=0x7f76dc0fa380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.571 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.565+0000 7f76e086c6c0 1 --2- 10.20.193.96:0/998693319 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f76dc0f50b0 0x7f76dc0fa380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.571 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.565+0000 7f76e086c6c0 1 -- 10.20.193.96:0/998693319 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d800a660 con 0x7f76dc1131c0 2026-02-13T03:34:26.571 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.565+0000 7f76e086c6c0 1 --2- 10.20.193.96:0/998693319 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f76dc1131c0 0x7f76dc173a60 secure :-1 s=READY pgs=289 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76d000b6c0 tx=0x7f76d000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.571 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.565+0000 7f76ca7fc6c0 1 -- 10.20.193.96:0/998693319 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f76d00044a0 con 0x7f76dc1131c0 2026-02-13T03:34:26.571 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.565+0000 7f76ca7fc6c0 1 -- 10.20.193.96:0/998693319 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f76d0009030 con 0x7f76dc1131c0 2026-02-13T03:34:26.571 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.566+0000 7f76ca7fc6c0 1 -- 10.20.193.96:0/998693319 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f76d000cc90 con 0x7f76dc1131c0 2026-02-13T03:34:26.571 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.566+0000 7f76e32fc6c0 1 -- 10.20.193.96:0/998693319 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76dc0fad60 con 0x7f76dc1131c0 2026-02-13T03:34:26.571 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.566+0000 7f76e32fc6c0 1 -- 10.20.193.96:0/998693319 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76dc0fb1f0 con 0x7f76dc1131c0 2026-02-13T03:34:26.572 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.566+0000 7f34830806c0 1 -- 10.20.193.96:0/276102211 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f347c10fc20 msgr2=0x7f347c114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.572 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.566+0000 7f34830806c0 1 --2- 10.20.193.96:0/276102211 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f347c10fc20 0x7f347c114c60 secure :-1 s=READY pgs=288 gs=1 cs=0 l=1 c_cookie=6991670328651552278 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f34640099a0 tx=0x7f346402ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:26.572 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.566+0000 7f34830806c0 1 -- 10.20.193.96:0/276102211 shutdown_connections 2026-02-13T03:34:26.572 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.566+0000 7f34830806c0 1 --2- 10.20.193.96:0/276102211 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f347c115440 0x7f347c175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.572 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.566+0000 7f34830806c0 1 --2- 10.20.193.96:0/276102211 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f347c10fc20 0x7f347c114c60 unknown :-1 s=CLOSED pgs=288 gs=1 cs=0 l=1 c_cookie=6991670328651552278 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.572 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.566+0000 7f34830806c0 1 --2- 10.20.193.96:0/276102211 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f347c10f230 0x7f347c10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.573 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.566+0000 7f34830806c0 1 -- 10.20.193.96:0/276102211 >> 10.20.193.96:0/276102211 conn(0x7f347c0ecb30 msgr2=0x7f347c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.573 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.566+0000 7f34830806c0 1 -- 10.20.193.96:0/276102211 shutdown_connections 2026-02-13T03:34:26.573 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.566+0000 7f34830806c0 1 -- 10.20.193.96:0/276102211 wait complete. 2026-02-13T03:34:26.573 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.566+0000 7f76e32fc6c0 1 -- 10.20.193.96:0/998693319 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76dc10e280 con 0x7f76dc1131c0 2026-02-13T03:34:26.574 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.566+0000 7f34830806c0 1 Processor -- start 2026-02-13T03:34:26.574 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.567+0000 7f34830806c0 1 -- start start 2026-02-13T03:34:26.574 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.567+0000 7f34830806c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f347c10f230 0x7f347c11d240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.574 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.567+0000 7f34830806c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f347c115440 0x7f347c11d780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.574 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.567+0000 7f34830806c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f347c122b40 0x7f347c122fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.575 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.567+0000 7f34830806c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f347c123550 con 0x7f347c115440 2026-02-13T03:34:26.575 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.567+0000 7f34830806c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f347c1236c0 con 0x7f347c10f230 2026-02-13T03:34:26.575 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.567+0000 7f34830806c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f347c123880 con 0x7f347c122b40 2026-02-13T03:34:26.575 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.567+0000 7f3473fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f347c115440 0x7f347c11d780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.575 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.567+0000 7f3473fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f347c115440 0x7f347c11d780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49292/0 (socket says 10.20.193.96:49292) 2026-02-13T03:34:26.575 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.567+0000 7f3473fff6c0 1 -- 10.20.193.96:0/3270492048 learned_addr learned my addr 10.20.193.96:0/3270492048 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:26.575 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.567+0000 7f34815f66c0 1 --2- 10.20.193.96:0/3270492048 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f347c122b40 0x7f347c122fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.575 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.567+0000 7f3473fff6c0 1 -- 10.20.193.96:0/3270492048 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f347c122b40 msgr2=0x7f347c122fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.575 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.567+0000 7f3473fff6c0 1 --2- 10.20.193.96:0/3270492048 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f347c122b40 0x7f347c122fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.575 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.567+0000 7f3473fff6c0 1 -- 10.20.193.96:0/3270492048 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f347c10f230 msgr2=0x7f347c11d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.575 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.567+0000 7f3473fff6c0 1 --2- 10.20.193.96:0/3270492048 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f347c10f230 0x7f347c11d240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.575 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.567+0000 7f3473fff6c0 1 -- 10.20.193.96:0/3270492048 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3464009590 con 0x7f347c115440 2026-02-13T03:34:26.576 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.567+0000 7f3473fff6c0 1 --2- 10.20.193.96:0/3270492048 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f347c115440 0x7f347c11d780 secure :-1 s=READY pgs=290 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3464005b40 tx=0x7f346402fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.576 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.567+0000 7f76ca7fc6c0 1 -- 10.20.193.96:0/998693319 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f76d00026b0 con 0x7f76dc1131c0 2026-02-13T03:34:26.577 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.568+0000 7f76ca7fc6c0 1 --2- 10.20.193.96:0/998693319 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f76ac0b5710 0x7f76ac0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.577 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.568+0000 7f76e106d6c0 1 --2- 10.20.193.96:0/998693319 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f76ac0b5710 0x7f76ac0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.577 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.568+0000 7f76ca7fc6c0 1 -- 10.20.193.96:0/998693319 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f76d00e3720 con 0x7f76dc1131c0 2026-02-13T03:34:26.577 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.569+0000 7f76ca7fc6c0 1 -- 10.20.193.96:0/998693319 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f76d00a6140 con 0x7f76dc1131c0 2026-02-13T03:34:26.577 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.569+0000 7f76e106d6c0 1 --2- 10.20.193.96:0/998693319 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f76ac0b5710 0x7f76ac0d5bc0 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76cc005980 tx=0x7f76cc005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.578 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.569+0000 7f3471ffb6c0 1 -- 10.20.193.96:0/3270492048 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3464002ae0 con 0x7f347c115440 2026-02-13T03:34:26.578 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.569+0000 7f3471ffb6c0 1 -- 10.20.193.96:0/3270492048 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f3464002c40 con 0x7f347c115440 2026-02-13T03:34:26.578 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.569+0000 7f3471ffb6c0 1 -- 10.20.193.96:0/3270492048 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f34640312b0 con 0x7f347c115440 2026-02-13T03:34:26.578 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.569+0000 7f34830806c0 1 -- 10.20.193.96:0/3270492048 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f347c163cd0 con 0x7f347c115440 2026-02-13T03:34:26.579 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.569+0000 7f34830806c0 1 -- 10.20.193.96:0/3270492048 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f347c164100 con 0x7f347c115440 2026-02-13T03:34:26.579 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.569+0000 7f34830806c0 1 -- 10.20.193.96:0/3270492048 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f347c110500 con 0x7f347c115440 2026-02-13T03:34:26.579 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.571+0000 7f3471ffb6c0 1 -- 10.20.193.96:0/3270492048 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f3464007980 con 0x7f347c115440 2026-02-13T03:34:26.579 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.572+0000 7f3471ffb6c0 1 --2- 10.20.193.96:0/3270492048 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f34580b5710 0x7f34580d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.579 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.572+0000 7f3480df56c0 1 --2- 10.20.193.96:0/3270492048 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f34580b5710 0x7f34580d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.579 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.572+0000 7f3471ffb6c0 1 -- 10.20.193.96:0/3270492048 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f3464107d40 con 0x7f347c115440 2026-02-13T03:34:26.579 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.572+0000 7f3471ffb6c0 1 -- 10.20.193.96:0/3270492048 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f34640cd770 con 0x7f347c115440 2026-02-13T03:34:26.579 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.572+0000 7f3480df56c0 1 --2- 10.20.193.96:0/3270492048 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f34580b5710 0x7f34580d5bc0 secure :-1 s=READY pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f346c005980 tx=0x7f346c005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.581 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.575+0000 7f8aeaf206c0 1 -- 10.20.193.96:0/3235512509 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8ae410c3a0 msgr2=0x7f8ae4155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.581 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.575+0000 7f8aeaf206c0 1 --2- 10.20.193.96:0/3235512509 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8ae410c3a0 0x7f8ae4155280 secure :-1 s=READY pgs=291 gs=1 cs=0 l=1 c_cookie=4950772167383547166 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8acc009970 tx=0x7f8acc02ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:26.581 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.575+0000 7f8aeaf206c0 1 -- 10.20.193.96:0/3235512509 shutdown_connections 2026-02-13T03:34:26.581 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.575+0000 7f8aeaf206c0 1 --2- 10.20.193.96:0/3235512509 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8ae41557c0 0x7f8ae4175ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.581 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.575+0000 7f8aeaf206c0 1 --2- 10.20.193.96:0/3235512509 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8ae410c3a0 0x7f8ae4155280 unknown :-1 s=CLOSED pgs=291 gs=1 cs=0 l=1 c_cookie=4950772167383547166 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.581 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.575+0000 7f8aeaf206c0 1 --2- 10.20.193.96:0/3235512509 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8ae410ba90 0x7f8ae410be60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.581 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.575+0000 7f8aeaf206c0 1 -- 10.20.193.96:0/3235512509 >> 10.20.193.96:0/3235512509 conn(0x7f8ae40e9770 msgr2=0x7f8ae4109b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.581 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.575+0000 7f8aeaf206c0 1 -- 10.20.193.96:0/3235512509 shutdown_connections 2026-02-13T03:34:26.582 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.575+0000 7f8aeaf206c0 1 -- 10.20.193.96:0/3235512509 wait complete. 2026-02-13T03:34:26.582 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.575+0000 7f8aeaf206c0 1 Processor -- start 2026-02-13T03:34:26.582 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.575+0000 7f8aeaf206c0 1 -- start start 2026-02-13T03:34:26.582 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.575+0000 7f8aeaf206c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8ae410ba90 0x7f8ae41605a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.582 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.575+0000 7f8aeaf206c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8ae410c3a0 0x7f8ae4160ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.582 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.575+0000 7f8aeaf206c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8ae41557c0 0x7f8ae4165ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.582 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.576+0000 7f8aeaf206c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae41664f0 con 0x7f8ae41557c0 2026-02-13T03:34:26.582 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.576+0000 7f8aeaf206c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae4166660 con 0x7f8ae410ba90 2026-02-13T03:34:26.582 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.576+0000 7f8aeaf206c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae4166820 con 0x7f8ae410c3a0 2026-02-13T03:34:26.582 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.576+0000 7f8ae94966c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8ae41557c0 0x7f8ae4165ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.582 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.576+0000 7f8ae94966c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8ae41557c0 0x7f8ae4165ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49302/0 (socket says 10.20.193.96:49302) 2026-02-13T03:34:26.582 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.576+0000 7f8ae94966c0 1 -- 10.20.193.96:0/1683976725 learned_addr learned my addr 10.20.193.96:0/1683976725 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:26.582 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.576+0000 7f8ae8c956c0 1 --2- 10.20.193.96:0/1683976725 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8ae410ba90 0x7f8ae41605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.576+0000 7f8adbfff6c0 1 --2- 10.20.193.96:0/1683976725 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8ae410c3a0 0x7f8ae4160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.576+0000 7f8ae94966c0 1 -- 10.20.193.96:0/1683976725 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8ae410c3a0 msgr2=0x7f8ae4160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.576+0000 7f8ae94966c0 1 --2- 10.20.193.96:0/1683976725 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8ae410c3a0 0x7f8ae4160ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.576+0000 7f8ae94966c0 1 -- 10.20.193.96:0/1683976725 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8ae410ba90 msgr2=0x7f8ae41605a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.576+0000 7f8ae94966c0 1 --2- 10.20.193.96:0/1683976725 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8ae410ba90 0x7f8ae41605a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.576+0000 7f8ae94966c0 1 -- 10.20.193.96:0/1683976725 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8acc009590 con 0x7f8ae41557c0 2026-02-13T03:34:26.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.576+0000 7f8ae94966c0 1 --2- 10.20.193.96:0/1683976725 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8ae41557c0 0x7f8ae4165ea0 secure :-1 s=READY pgs=292 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ae0006ea0 tx=0x7f8ae000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.576+0000 7f8ad9ffb6c0 1 -- 10.20.193.96:0/1683976725 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8ae0003a30 con 0x7f8ae41557c0 2026-02-13T03:34:26.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.576+0000 7f8ad9ffb6c0 1 -- 10.20.193.96:0/1683976725 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f8ae0005510 con 0x7f8ae41557c0 2026-02-13T03:34:26.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.576+0000 7f8aeaf206c0 1 -- 10.20.193.96:0/1683976725 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ae4166b00 con 0x7f8ae41557c0 2026-02-13T03:34:26.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.576+0000 7f8ad9ffb6c0 1 -- 10.20.193.96:0/1683976725 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8ae000dd70 con 0x7f8ae41557c0 2026-02-13T03:34:26.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.576+0000 7f8aeaf206c0 1 -- 10.20.193.96:0/1683976725 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ae4152400 con 0x7f8ae41557c0 2026-02-13T03:34:26.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.577+0000 7f8aeaf206c0 1 -- 10.20.193.96:0/1683976725 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ae405fb30 con 0x7f8ae41557c0 2026-02-13T03:34:26.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.578+0000 7f8ad9ffb6c0 1 -- 10.20.193.96:0/1683976725 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f8ae0003b90 con 0x7f8ae41557c0 2026-02-13T03:34:26.584 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.578+0000 7f8ad9ffb6c0 1 --2- 10.20.193.96:0/1683976725 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f8ac00b5610 0x7f8ac00d5ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.584 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.579+0000 7f8ad9ffb6c0 1 -- 10.20.193.96:0/1683976725 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f8ae00e4aa0 con 0x7f8ae41557c0 2026-02-13T03:34:26.584 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.579+0000 7f8ae8c956c0 1 --2- 10.20.193.96:0/1683976725 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f8ac00b5610 0x7f8ac00d5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.585 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.579+0000 7f8ae8c956c0 1 --2- 10.20.193.96:0/1683976725 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f8ac00b5610 0x7f8ac00d5ac0 secure :-1 s=READY pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ad4004750 tx=0x7f8ad4009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.585 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.580+0000 7f8ad9ffb6c0 1 -- 10.20.193.96:0/1683976725 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8ae00a74c0 con 0x7f8ae41557c0 2026-02-13T03:34:26.593 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.590+0000 7f42a047d6c0 1 -- 10.20.193.96:0/3341017772 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f429810d9a0 msgr2=0x7f42981129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.593 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.590+0000 7f42a047d6c0 1 --2- 10.20.193.96:0/3341017772 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f429810d9a0 0x7f42981129e0 secure :-1 s=READY pgs=293 gs=1 cs=0 l=1 c_cookie=11085240406174392134 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4280009970 tx=0x7f428002ed70 comp rx=0 tx=0).stop 2026-02-13T03:34:26.593 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.590+0000 7f42a047d6c0 1 -- 10.20.193.96:0/3341017772 shutdown_connections 2026-02-13T03:34:26.594 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.590+0000 7f42a047d6c0 1 --2- 10.20.193.96:0/3341017772 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f42981131c0 0x7f42980605e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.594 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.590+0000 7f42a047d6c0 1 --2- 10.20.193.96:0/3341017772 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f429810d9a0 0x7f42981129e0 unknown :-1 s=CLOSED pgs=293 gs=1 cs=0 l=1 c_cookie=11085240406174392134 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.594 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.590+0000 7f42a047d6c0 1 --2- 10.20.193.96:0/3341017772 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f429810cfb0 0x7f429810d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.594 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.590+0000 7f42a047d6c0 1 -- 10.20.193.96:0/3341017772 >> 10.20.193.96:0/3341017772 conn(0x7f42980ea8b0 msgr2=0x7f429810acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.594 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.590+0000 7f42a047d6c0 1 -- 10.20.193.96:0/3341017772 shutdown_connections 2026-02-13T03:34:26.594 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.590+0000 7f42a047d6c0 1 -- 10.20.193.96:0/3341017772 wait complete. 2026-02-13T03:34:26.594 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.592+0000 7f42a047d6c0 1 Processor -- start 2026-02-13T03:34:26.595 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.592+0000 7f42a047d6c0 1 -- start start 2026-02-13T03:34:26.595 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.592+0000 7f42a047d6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f429810cfb0 0x7f42980f2390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.595 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.592+0000 7f42a047d6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f42981131c0 0x7f42980f28d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.596 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.592+0000 7f429e1ee6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f429810cfb0 0x7f42980f2390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.596 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.592+0000 7f429e1ee6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f429810cfb0 0x7f42980f2390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49320/0 (socket says 10.20.193.96:49320) 2026-02-13T03:34:26.596 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.592+0000 7f42a047d6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f42980f7c90 0x7f42980f8130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.596 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.592+0000 7f429d9ed6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f42981131c0 0x7f42980f28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.596 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.592+0000 7f429d9ed6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f42981131c0 0x7f42980f28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.132:3300/0 says I am v2:10.20.193.96:36616/0 (socket says 10.20.193.96:36616) 2026-02-13T03:34:26.597 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.593+0000 7f429e1ee6c0 1 -- 10.20.193.96:0/8865235 learned_addr learned my addr 10.20.193.96:0/8865235 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:26.597 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.593+0000 7f42a047d6c0 1 -- 10.20.193.96:0/8865235 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f42980f8670 con 0x7f429810cfb0 2026-02-13T03:34:26.597 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.593+0000 7f42a047d6c0 1 -- 10.20.193.96:0/8865235 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f42980f87b0 con 0x7f42981131c0 2026-02-13T03:34:26.597 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.593+0000 7f42a047d6c0 1 -- 10.20.193.96:0/8865235 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f42980f8970 con 0x7f42980f7c90 2026-02-13T03:34:26.597 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.593+0000 7f429e9ef6c0 1 --2- 10.20.193.96:0/8865235 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f42980f7c90 0x7f42980f8130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.597 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.593+0000 7f429e9ef6c0 1 -- 10.20.193.96:0/8865235 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f42981131c0 msgr2=0x7f42980f28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.597 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.593+0000 7f429e9ef6c0 1 --2- 10.20.193.96:0/8865235 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f42981131c0 0x7f42980f28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.598 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.593+0000 7f429e9ef6c0 1 -- 10.20.193.96:0/8865235 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f429810cfb0 msgr2=0x7f42980f2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.598 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.593+0000 7f429e9ef6c0 1 --2- 10.20.193.96:0/8865235 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f429810cfb0 0x7f42980f2390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.598 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.593+0000 7f429e9ef6c0 1 -- 10.20.193.96:0/8865235 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4280009590 con 0x7f42980f7c90 2026-02-13T03:34:26.598 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.593+0000 7f429e1ee6c0 1 --2- 10.20.193.96:0/8865235 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f429810cfb0 0x7f42980f2390 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T03:34:26.598 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.593+0000 7f429e9ef6c0 1 --2- 10.20.193.96:0/8865235 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f42980f7c90 0x7f42980f8130 secure :-1 s=READY pgs=62 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f429400c6c0 tx=0x7f429400cb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.598 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.594+0000 7f428f7fe6c0 1 -- 10.20.193.96:0/8865235 <== mon.1 v2:10.20.193.133:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4294005340 con 0x7f42980f7c90 2026-02-13T03:34:26.598 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.594+0000 7f428f7fe6c0 1 -- 10.20.193.96:0/8865235 <== mon.1 v2:10.20.193.133:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f4294003cf0 con 0x7f42980f7c90 2026-02-13T03:34:26.598 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.594+0000 7f428f7fe6c0 1 -- 10.20.193.96:0/8865235 <== mon.1 v2:10.20.193.133:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f429400dcf0 con 0x7f42980f7c90 2026-02-13T03:34:26.598 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.594+0000 7f42a047d6c0 1 -- 10.20.193.96:0/8865235 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42980f8e00 con 0x7f42980f7c90 2026-02-13T03:34:26.598 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.594+0000 7f42a047d6c0 1 -- 10.20.193.96:0/8865235 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42980f9230 con 0x7f42980f7c90 2026-02-13T03:34:26.599 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.594+0000 7f42a047d6c0 1 -- 10.20.193.96:0/8865235 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f429810e280 con 0x7f42980f7c90 2026-02-13T03:34:26.599 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.596+0000 7f428f7fe6c0 1 -- 10.20.193.96:0/8865235 <== mon.1 v2:10.20.193.133:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f42940054a0 con 0x7f42980f7c90 2026-02-13T03:34:26.599 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.596+0000 7f428f7fe6c0 1 --2- 10.20.193.96:0/8865235 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f42740b5790 0x7f42740d5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.596+0000 7f428f7fe6c0 1 -- 10.20.193.96:0/8865235 <== mon.1 v2:10.20.193.133:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f42940e48c0 con 0x7f42980f7c90 2026-02-13T03:34:26.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.596+0000 7f429e1ee6c0 1 --2- 10.20.193.96:0/8865235 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f42740b5790 0x7f42740d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.597+0000 7f429e1ee6c0 1 --2- 10.20.193.96:0/8865235 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f42740b5790 0x7f42740d5c40 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4288006f90 tx=0x7f4288009290 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.600 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.597+0000 7f428f7fe6c0 1 -- 10.20.193.96:0/8865235 <== mon.1 v2:10.20.193.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f42940a72e0 con 0x7f42980f7c90 2026-02-13T03:34:26.625 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.622+0000 7f7d465b06c0 1 -- 10.20.193.96:0/1563626007 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7d4010cfb0 msgr2=0x7f7d4010d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.626 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.622+0000 7f7d465b06c0 1 --2- 10.20.193.96:0/1563626007 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7d4010cfb0 0x7f7d4010d380 secure :-1 s=READY pgs=294 gs=1 cs=0 l=1 c_cookie=11659290461711340874 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d2c0099a0 tx=0x7f7d2c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:26.626 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.622+0000 7f7d465b06c0 1 -- 10.20.193.96:0/1563626007 shutdown_connections 2026-02-13T03:34:26.626 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.622+0000 7f7d465b06c0 1 --2- 10.20.193.96:0/1563626007 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7d401131c0 0x7f7d40173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.626 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.622+0000 7f7d465b06c0 1 --2- 10.20.193.96:0/1563626007 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7d4010d9a0 0x7f7d401129e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.626 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.622+0000 7f7d465b06c0 1 --2- 10.20.193.96:0/1563626007 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7d4010cfb0 0x7f7d4010d380 unknown :-1 s=CLOSED pgs=294 gs=1 cs=0 l=1 c_cookie=11659290461711340874 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.626 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.622+0000 7f7d465b06c0 1 -- 10.20.193.96:0/1563626007 >> 10.20.193.96:0/1563626007 conn(0x7f7d400ea8b0 msgr2=0x7f7d4010acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.626 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.623+0000 7f7d465b06c0 1 -- 10.20.193.96:0/1563626007 shutdown_connections 2026-02-13T03:34:26.626 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.623+0000 7f7d465b06c0 1 -- 10.20.193.96:0/1563626007 wait complete. 2026-02-13T03:34:26.628 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.623+0000 7f7d465b06c0 1 Processor -- start 2026-02-13T03:34:26.628 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.623+0000 7f7d465b06c0 1 -- start start 2026-02-13T03:34:26.628 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.623+0000 7f7d465b06c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7d4010cfb0 0x7f7d4011af90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.628 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.623+0000 7f7d465b06c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7d401131c0 0x7f7d4011b4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.628 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.623+0000 7f7d465b06c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7d40120890 0x7f7d40120d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.628 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.623+0000 7f7d465b06c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7d401212a0 con 0x7f7d4010cfb0 2026-02-13T03:34:26.628 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.623+0000 7f7d3ffff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7d4010cfb0 0x7f7d4011af90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.628 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.623+0000 7f7d465b06c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7d40121410 con 0x7f7d40120890 2026-02-13T03:34:26.629 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.623+0000 7f7d465b06c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7d401215d0 con 0x7f7d401131c0 2026-02-13T03:34:26.629 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.623+0000 7f7d3ffff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7d4010cfb0 0x7f7d4011af90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49330/0 (socket says 10.20.193.96:49330) 2026-02-13T03:34:26.629 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.623+0000 7f7d3ffff6c0 1 -- 10.20.193.96:0/3317759837 learned_addr learned my addr 10.20.193.96:0/3317759837 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:26.629 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.623+0000 7f7d3f7fe6c0 1 --2- 10.20.193.96:0/3317759837 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7d401131c0 0x7f7d4011b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.629 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.623+0000 7f7d44b226c0 1 --2- 10.20.193.96:0/3317759837 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7d40120890 0x7f7d40120d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.629 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.623+0000 7f7d3ffff6c0 1 -- 10.20.193.96:0/3317759837 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7d401131c0 msgr2=0x7f7d4011b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.629 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.623+0000 7f7d3ffff6c0 1 --2- 10.20.193.96:0/3317759837 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7d401131c0 0x7f7d4011b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.629 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.623+0000 7f7d3ffff6c0 1 -- 10.20.193.96:0/3317759837 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7d40120890 msgr2=0x7f7d40120d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.629 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.623+0000 7f7d3ffff6c0 1 --2- 10.20.193.96:0/3317759837 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7d40120890 0x7f7d40120d30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.629 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.623+0000 7f7d3ffff6c0 1 -- 10.20.193.96:0/3317759837 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d2c009590 con 0x7f7d4010cfb0 2026-02-13T03:34:26.629 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.623+0000 7f7d44b226c0 1 --2- 10.20.193.96:0/3317759837 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7d40120890 0x7f7d40120d30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:34:26.629 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.624+0000 7f7d3ffff6c0 1 --2- 10.20.193.96:0/3317759837 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7d4010cfb0 0x7f7d4011af90 secure :-1 s=READY pgs=295 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d2c02f230 tx=0x7f7d2c02fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.630 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.624+0000 7f7d3d7fa6c0 1 -- 10.20.193.96:0/3317759837 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7d2c002ae0 con 0x7f7d4010cfb0 2026-02-13T03:34:26.630 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.624+0000 7f7d3d7fa6c0 1 -- 10.20.193.96:0/3317759837 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f7d2c002c40 con 0x7f7d4010cfb0 2026-02-13T03:34:26.630 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.624+0000 7f7d3d7fa6c0 1 -- 10.20.193.96:0/3317759837 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7d2c0372f0 con 0x7f7d4010cfb0 2026-02-13T03:34:26.630 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.624+0000 7f7d465b06c0 1 -- 10.20.193.96:0/3317759837 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d40161a20 con 0x7f7d4010cfb0 2026-02-13T03:34:26.630 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.624+0000 7f7d465b06c0 1 -- 10.20.193.96:0/3317759837 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d40161e50 con 0x7f7d4010cfb0 2026-02-13T03:34:26.630 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.624+0000 7f7d465b06c0 1 -- 10.20.193.96:0/3317759837 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d4010e280 con 0x7f7d4010cfb0 2026-02-13T03:34:26.631 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.626+0000 7f7d3d7fa6c0 1 -- 10.20.193.96:0/3317759837 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f7d2c0078f0 con 0x7f7d4010cfb0 2026-02-13T03:34:26.631 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.627+0000 7f7d3d7fa6c0 1 --2- 10.20.193.96:0/3317759837 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7d180b5710 0x7f7d180d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:26.631 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.627+0000 7f7dc7cd36c0 1 -- 10.20.193.96:0/3178365145 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7dc010d950 con 0x7f7dc0120600 2026-02-13T03:34:26.631 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.627+0000 7f7d3d7fa6c0 1 -- 10.20.193.96:0/3317759837 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f7d2c107cb0 con 0x7f7d4010cfb0 2026-02-13T03:34:26.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.627+0000 7f7d3f7fe6c0 1 --2- 10.20.193.96:0/3317759837 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7d180b5710 0x7f7d180d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:26.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.627+0000 7f7d3f7fe6c0 1 --2- 10.20.193.96:0/3317759837 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7d180b5710 0x7f7d180d5bc0 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d40121920 tx=0x7f7d24009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:26.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.628+0000 7f7daeffd6c0 1 -- 10.20.193.96:0/3178365145 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7dbc003e60 con 0x7f7dc0120600 2026-02-13T03:34:26.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.628+0000 7f7d3d7fa6c0 1 -- 10.20.193.96:0/3317759837 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7d2c0ca6d0 con 0x7f7d4010cfb0 2026-02-13T03:34:26.633 INFO:teuthology.orchestra.run.trial096.stdout:81604378643 2026-02-13T03:34:26.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.629+0000 7f9019ffb6c0 1 -- 10.20.193.96:0/3046573155 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f9004005890 con 0x7f903c10dd30 2026-02-13T03:34:26.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.629+0000 7f901bfff6c0 1 -- 10.20.193.96:0/3046573155 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f90300a94f0 con 0x7f903c10dd30 2026-02-13T03:34:26.633 INFO:teuthology.orchestra.run.trial096.stdout:227633266697 2026-02-13T03:34:26.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.631+0000 7fcfcd9806c0 1 -- 10.20.193.96:0/528584071 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fcfc810f600 con 0x7fcfc8115440 2026-02-13T03:34:26.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.631+0000 7fcfcc97e6c0 1 -- 10.20.193.96:0/528584071 <== mon.1 v2:10.20.193.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcfb00cd6e0 con 0x7fcfc8115440 2026-02-13T03:34:26.635 INFO:teuthology.orchestra.run.trial096.stdout:167503724556 2026-02-13T03:34:26.635 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.631+0000 7f7dc7cd36c0 1 -- 10.20.193.96:0/3178365145 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7d9c0b5790 msgr2=0x7f7d9c0d5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.635 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.631+0000 7f7dc7cd36c0 1 --2- 10.20.193.96:0/3178365145 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7d9c0b5790 0x7f7d9c0d5c40 secure :-1 s=READY pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7db00095e0 tx=0x7f7db0009260 comp rx=0 tx=0).stop 2026-02-13T03:34:26.635 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.631+0000 7f7dc7cd36c0 1 -- 10.20.193.96:0/3178365145 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7dc0120600 msgr2=0x7f7dc0120aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.636 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.631+0000 7f7dc7cd36c0 1 --2- 10.20.193.96:0/3178365145 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7dc0120600 0x7f7dc0120aa0 secure :-1 s=READY pgs=281 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dbc030a30 tx=0x7f7dbc005820 comp rx=0 tx=0).stop 2026-02-13T03:34:26.636 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.632+0000 7f7dc7cd36c0 1 -- 10.20.193.96:0/3178365145 shutdown_connections 2026-02-13T03:34:26.636 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.632+0000 7f7dc7cd36c0 1 --2- 10.20.193.96:0/3178365145 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7d9c0b5790 0x7f7d9c0d5c40 unknown :-1 s=CLOSED pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.636 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.632+0000 7f7dc7cd36c0 1 --2- 10.20.193.96:0/3178365145 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7dc0120600 0x7f7dc0120aa0 unknown :-1 s=CLOSED pgs=281 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.636 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.632+0000 7f7dc7cd36c0 1 --2- 10.20.193.96:0/3178365145 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7dc01131c0 0x7f7dc011b240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.636 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.632+0000 7f7dc7cd36c0 1 --2- 10.20.193.96:0/3178365145 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7dc010cfb0 0x7f7dc011ad00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.636 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.632+0000 7f7dc7cd36c0 1 -- 10.20.193.96:0/3178365145 >> 10.20.193.96:0/3178365145 conn(0x7f7dc00ea8b0 msgr2=0x7f7dc010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.636 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.632+0000 7f7dc7cd36c0 1 -- 10.20.193.96:0/3178365145 shutdown_connections 2026-02-13T03:34:26.636 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.632+0000 7f7dc7cd36c0 1 -- 10.20.193.96:0/3178365145 wait complete. 2026-02-13T03:34:26.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.632+0000 7f9019ffb6c0 1 -- 10.20.193.96:0/3046573155 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f90100b5860 msgr2=0x7f90100d5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.632+0000 7f9019ffb6c0 1 --2- 10.20.193.96:0/3046573155 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f90100b5860 0x7f90100d5d10 secure :-1 s=READY pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f903c165a10 tx=0x7f9024009310 comp rx=0 tx=0).stop 2026-02-13T03:34:26.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.632+0000 7f9019ffb6c0 1 -- 10.20.193.96:0/3046573155 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f903c10dd30 msgr2=0x7f903c15f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.632+0000 7f9019ffb6c0 1 --2- 10.20.193.96:0/3046573155 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f903c10dd30 0x7f903c15f080 secure :-1 s=READY pgs=279 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9030009490 tx=0x7f903000bca0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.632+0000 7f9019ffb6c0 1 -- 10.20.193.96:0/3046573155 shutdown_connections 2026-02-13T03:34:26.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.632+0000 7f9019ffb6c0 1 --2- 10.20.193.96:0/3046573155 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f90100b5860 0x7f90100d5d10 unknown :-1 s=CLOSED pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.632+0000 7f9019ffb6c0 1 --2- 10.20.193.96:0/3046573155 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f903c1532e0 0x7f903c164980 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.632+0000 7f9019ffb6c0 1 --2- 10.20.193.96:0/3046573155 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f903c10e720 0x7f903c15f5c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.632+0000 7f9019ffb6c0 1 --2- 10.20.193.96:0/3046573155 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f903c10dd30 0x7f903c15f080 unknown :-1 s=CLOSED pgs=279 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.632+0000 7f9019ffb6c0 1 -- 10.20.193.96:0/3046573155 >> 10.20.193.96:0/3046573155 conn(0x7f903c063780 msgr2=0x7f903c109ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.632+0000 7f9019ffb6c0 1 -- 10.20.193.96:0/3046573155 shutdown_connections 2026-02-13T03:34:26.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.632+0000 7f9019ffb6c0 1 -- 10.20.193.96:0/3046573155 wait complete. 2026-02-13T03:34:26.638 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.634+0000 7fcfcd9806c0 1 -- 10.20.193.96:0/528584071 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcf9c0b5590 msgr2=0x7fcf9c0d5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.639 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.634+0000 7fcfcd9806c0 1 --2- 10.20.193.96:0/528584071 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcf9c0b5590 0x7fcf9c0d5a40 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfbc005b40 tx=0x7fcfbc009310 comp rx=0 tx=0).stop 2026-02-13T03:34:26.639 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.634+0000 7fcfcd9806c0 1 -- 10.20.193.96:0/528584071 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fcfc8115440 msgr2=0x7fcfc8175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.639 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.634+0000 7fcfcd9806c0 1 --2- 10.20.193.96:0/528584071 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fcfc8115440 0x7fcfc8175ce0 secure :-1 s=READY pgs=61 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfc8055800 tx=0x7fcfb002fb10 comp rx=0 tx=0).stop 2026-02-13T03:34:26.639 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.634+0000 7fcfcd9806c0 1 -- 10.20.193.96:0/528584071 shutdown_connections 2026-02-13T03:34:26.639 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.634+0000 7fcfcd9806c0 1 --2- 10.20.193.96:0/528584071 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcf9c0b5590 0x7fcf9c0d5a40 unknown :-1 s=CLOSED pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.639 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.634+0000 7fcfcd9806c0 1 --2- 10.20.193.96:0/528584071 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fcfc80f5160 0x7fcfc80fa430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.639 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.634+0000 7fcfcd9806c0 1 --2- 10.20.193.96:0/528584071 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fcfc8115440 0x7fcfc8175ce0 unknown :-1 s=CLOSED pgs=61 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.639 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.634+0000 7fcfcd9806c0 1 --2- 10.20.193.96:0/528584071 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcfc810f230 0x7fcfc80f4b30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.639 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.634+0000 7fcfcd9806c0 1 -- 10.20.193.96:0/528584071 >> 10.20.193.96:0/528584071 conn(0x7fcfc80ecb30 msgr2=0x7fcfc810d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.639 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.634+0000 7fcfcd9806c0 1 -- 10.20.193.96:0/528584071 shutdown_connections 2026-02-13T03:34:26.639 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.634+0000 7fcfcd9806c0 1 -- 10.20.193.96:0/528584071 wait complete. 2026-02-13T03:34:26.644 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.641+0000 7f496bbf56c0 1 -- 10.20.193.96:0/4200401531 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f496411e350 con 0x7f4964115410 2026-02-13T03:34:26.644 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.641+0000 7f4952ffd6c0 1 -- 10.20.193.96:0/4200401531 <== mon.2 v2:10.20.193.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f49580a9610 con 0x7f4964115410 2026-02-13T03:34:26.645 INFO:teuthology.orchestra.run.trial096.stdout:197568495626 2026-02-13T03:34:26.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.643+0000 7f496bbf56c0 1 -- 10.20.193.96:0/4200401531 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f49400b5690 msgr2=0x7f49400d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.643+0000 7f496bbf56c0 1 --2- 10.20.193.96:0/4200401531 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f49400b5690 0x7f49400d5b40 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4954005b40 tx=0x7f4954009310 comp rx=0 tx=0).stop 2026-02-13T03:34:26.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.643+0000 7f496bbf56c0 1 -- 10.20.193.96:0/4200401531 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4964115410 msgr2=0x7f496411d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.643+0000 7f496bbf56c0 1 --2- 10.20.193.96:0/4200401531 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4964115410 0x7f496411d740 secure :-1 s=READY pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f495800b800 tx=0x7f495800bcd0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.643+0000 7f496bbf56c0 1 -- 10.20.193.96:0/4200401531 shutdown_connections 2026-02-13T03:34:26.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.643+0000 7f496bbf56c0 1 --2- 10.20.193.96:0/4200401531 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f49400b5690 0x7f49400d5b40 unknown :-1 s=CLOSED pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.643+0000 7f496bbf56c0 1 --2- 10.20.193.96:0/4200401531 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4964122b00 0x7f4964122fa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.643+0000 7f496bbf56c0 1 --2- 10.20.193.96:0/4200401531 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4964115410 0x7f496411d740 unknown :-1 s=CLOSED pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.643+0000 7f496bbf56c0 1 --2- 10.20.193.96:0/4200401531 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f496410f200 0x7f496411d200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.643+0000 7f496bbf56c0 1 -- 10.20.193.96:0/4200401531 >> 10.20.193.96:0/4200401531 conn(0x7f49640ecb00 msgr2=0x7f496410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.643+0000 7f496bbf56c0 1 -- 10.20.193.96:0/4200401531 shutdown_connections 2026-02-13T03:34:26.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.643+0000 7f496bbf56c0 1 -- 10.20.193.96:0/4200401531 wait complete. 2026-02-13T03:34:26.654 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.651+0000 7f9871bc96c0 1 -- 10.20.193.96:0/4293855581 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f986c110500 con 0x7f986c0f52e0 2026-02-13T03:34:26.655 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.652+0000 7f9868ff96c0 1 -- 10.20.193.96:0/4293855581 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f98600aa420 con 0x7f986c0f52e0 2026-02-13T03:34:26.655 INFO:teuthology.orchestra.run.trial096.stdout:270582939654 2026-02-13T03:34:26.657 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.654+0000 7f555a71c6c0 1 -- 10.20.193.96:0/2211148984 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f5554063c90 con 0x7f555410f230 2026-02-13T03:34:26.657 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.654+0000 7f55517fa6c0 1 -- 10.20.193.96:0/2211148984 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f55400a94c0 con 0x7f555410f230 2026-02-13T03:34:26.658 INFO:teuthology.orchestra.run.trial096.stdout:240518168583 2026-02-13T03:34:26.659 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.656+0000 7f9871bc96c0 1 -- 10.20.193.96:0/4293855581 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f98400b5790 msgr2=0x7f98400d5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.659 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.656+0000 7f9871bc96c0 1 --2- 10.20.193.96:0/4293855581 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f98400b5790 0x7f98400d5c40 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9858005980 tx=0x7f9858009390 comp rx=0 tx=0).stop 2026-02-13T03:34:26.659 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.656+0000 7f9871bc96c0 1 -- 10.20.193.96:0/4293855581 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f986c0f52e0 msgr2=0x7f986c0fa560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.660 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.656+0000 7f9871bc96c0 1 --2- 10.20.193.96:0/4293855581 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f986c0f52e0 0x7f986c0fa560 secure :-1 s=READY pgs=283 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f986000c6c0 tx=0x7f986000cb90 comp rx=0 tx=0).stop 2026-02-13T03:34:26.660 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.656+0000 7f9871bc96c0 1 -- 10.20.193.96:0/4293855581 shutdown_connections 2026-02-13T03:34:26.660 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.656+0000 7f9871bc96c0 1 --2- 10.20.193.96:0/4293855581 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f98400b5790 0x7f98400d5c40 unknown :-1 s=CLOSED pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.660 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.656+0000 7f9871bc96c0 1 --2- 10.20.193.96:0/4293855581 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f986c0f52e0 0x7f986c0fa560 unknown :-1 s=CLOSED pgs=283 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.660 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.656+0000 7f9871bc96c0 1 --2- 10.20.193.96:0/4293855581 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f986c115440 0x7f986c175ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.660 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.656+0000 7f9871bc96c0 1 --2- 10.20.193.96:0/4293855581 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f986c10f230 0x7f986c0f4cb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.660 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.656+0000 7f9871bc96c0 1 -- 10.20.193.96:0/4293855581 >> 10.20.193.96:0/4293855581 conn(0x7f986c0ecb30 msgr2=0x7f986c113d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.660 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.656+0000 7f9871bc96c0 1 -- 10.20.193.96:0/4293855581 shutdown_connections 2026-02-13T03:34:26.660 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.656+0000 7f9871bc96c0 1 -- 10.20.193.96:0/4293855581 wait complete. 2026-02-13T03:34:26.661 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.657+0000 7f555a71c6c0 1 -- 10.20.193.96:0/2211148984 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f55280b5710 msgr2=0x7f55280d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.661 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.657+0000 7f555a71c6c0 1 --2- 10.20.193.96:0/2211148984 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f55280b5710 0x7f55280d5bc0 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5544005b40 tx=0x7f5544005da0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.661 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.657+0000 7f555a71c6c0 1 -- 10.20.193.96:0/2211148984 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f555410f230 msgr2=0x7f5554066730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.661 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.657+0000 7f555a71c6c0 1 --2- 10.20.193.96:0/2211148984 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f555410f230 0x7f5554066730 secure :-1 s=READY pgs=285 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f554000b6c0 tx=0x7f554000bb90 comp rx=0 tx=0).stop 2026-02-13T03:34:26.661 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.657+0000 7f555a71c6c0 1 -- 10.20.193.96:0/2211148984 shutdown_connections 2026-02-13T03:34:26.661 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.657+0000 7f555a71c6c0 1 --2- 10.20.193.96:0/2211148984 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f55280b5710 0x7f55280d5bc0 unknown :-1 s=CLOSED pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.662 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.657+0000 7f555a71c6c0 1 --2- 10.20.193.96:0/2211148984 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5554062990 0x7f5554062e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.662 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.657+0000 7f555a71c6c0 1 --2- 10.20.193.96:0/2211148984 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5554115440 0x7f5554175ce0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.662 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.657+0000 7f555a71c6c0 1 --2- 10.20.193.96:0/2211148984 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f555410f230 0x7f5554066730 unknown :-1 s=CLOSED pgs=285 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.662 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.657+0000 7f555a71c6c0 1 -- 10.20.193.96:0/2211148984 >> 10.20.193.96:0/2211148984 conn(0x7f55540ecb30 msgr2=0x7f555410d790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.662 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.658+0000 7f555a71c6c0 1 -- 10.20.193.96:0/2211148984 shutdown_connections 2026-02-13T03:34:26.662 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.658+0000 7f555a71c6c0 1 -- 10.20.193.96:0/2211148984 wait complete. 2026-02-13T03:34:26.679 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.676+0000 7f380b2f56c0 1 -- 10.20.193.96:0/2097564760 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f3804161690 con 0x7f380410ba70 2026-02-13T03:34:26.680 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.677+0000 7f37f27fc6c0 1 -- 10.20.193.96:0/2097564760 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f37f40cd810 con 0x7f380410ba70 2026-02-13T03:34:26.680 INFO:teuthology.orchestra.run.trial096.stdout:42949672981 2026-02-13T03:34:26.682 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.679+0000 7f380b2f56c0 1 -- 10.20.193.96:0/2097564760 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f37e00b5690 msgr2=0x7f37e00d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.682 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.679+0000 7f380b2f56c0 1 --2- 10.20.193.96:0/2097564760 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f37e00b5690 0x7f37e00d5b40 secure :-1 s=READY pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3804166ed0 tx=0x7f37f8009260 comp rx=0 tx=0).stop 2026-02-13T03:34:26.682 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.679+0000 7f380b2f56c0 1 -- 10.20.193.96:0/2097564760 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f380410ba70 msgr2=0x7f3804160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.682 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.679+0000 7f380b2f56c0 1 --2- 10.20.193.96:0/2097564760 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f380410ba70 0x7f3804160540 secure :-1 s=READY pgs=287 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37f4031fd0 tx=0x7f37f402fc70 comp rx=0 tx=0).stop 2026-02-13T03:34:26.682 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.679+0000 7f380b2f56c0 1 -- 10.20.193.96:0/2097564760 shutdown_connections 2026-02-13T03:34:26.682 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.679+0000 7f380b2f56c0 1 --2- 10.20.193.96:0/2097564760 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f37e00b5690 0x7f37e00d5b40 unknown :-1 s=CLOSED pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.682 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.679+0000 7f380b2f56c0 1 --2- 10.20.193.96:0/2097564760 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f38041557a0 0x7f3804165e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.682 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.679+0000 7f380b2f56c0 1 --2- 10.20.193.96:0/2097564760 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f380410c380 0x7f3804160a80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.683 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.679+0000 7f380b2f56c0 1 --2- 10.20.193.96:0/2097564760 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f380410ba70 0x7f3804160540 unknown :-1 s=CLOSED pgs=287 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.683 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.679+0000 7f380b2f56c0 1 -- 10.20.193.96:0/2097564760 >> 10.20.193.96:0/2097564760 conn(0x7f38040e9770 msgr2=0x7f3804109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.683 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.679+0000 7f380b2f56c0 1 -- 10.20.193.96:0/2097564760 shutdown_connections 2026-02-13T03:34:26.683 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.679+0000 7f380b2f56c0 1 -- 10.20.193.96:0/2097564760 wait complete. 2026-02-13T03:34:26.690 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.687+0000 7f34830806c0 1 -- 10.20.193.96:0/3270492048 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f347c11e3f0 con 0x7f347c115440 2026-02-13T03:34:26.690 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.687+0000 7f3471ffb6c0 1 -- 10.20.193.96:0/3270492048 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f34640cd950 con 0x7f347c115440 2026-02-13T03:34:26.691 INFO:teuthology.orchestra.run.trial096.stdout:124554051599 2026-02-13T03:34:26.691 INFO:teuthology.orchestra.run.trial096.stdout:111669149712 2026-02-13T03:34:26.692 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.688+0000 7f76e32fc6c0 1 -- 10.20.193.96:0/998693319 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f76dc10d380 con 0x7f76dc1131c0 2026-02-13T03:34:26.692 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.688+0000 7f76ca7fc6c0 1 -- 10.20.193.96:0/998693319 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f76d00a92f0 con 0x7f76dc1131c0 2026-02-13T03:34:26.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.691+0000 7f76e32fc6c0 1 -- 10.20.193.96:0/998693319 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f76ac0b5710 msgr2=0x7f76ac0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.691+0000 7f76e32fc6c0 1 --2- 10.20.193.96:0/998693319 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f76ac0b5710 0x7f76ac0d5bc0 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76cc005980 tx=0x7f76cc005910 comp rx=0 tx=0).stop 2026-02-13T03:34:26.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.691+0000 7f76e32fc6c0 1 -- 10.20.193.96:0/998693319 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f76dc1131c0 msgr2=0x7f76dc173a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.694 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.691+0000 7f76e32fc6c0 1 --2- 10.20.193.96:0/998693319 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f76dc1131c0 0x7f76dc173a60 secure :-1 s=READY pgs=289 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76d000b6c0 tx=0x7f76d000bb90 comp rx=0 tx=0).stop 2026-02-13T03:34:26.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.691+0000 7f34830806c0 1 -- 10.20.193.96:0/3270492048 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f34580b5710 msgr2=0x7f34580d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.691+0000 7f34830806c0 1 --2- 10.20.193.96:0/3270492048 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f34580b5710 0x7f34580d5bc0 secure :-1 s=READY pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f346c005980 tx=0x7f346c005910 comp rx=0 tx=0).stop 2026-02-13T03:34:26.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.691+0000 7f34830806c0 1 -- 10.20.193.96:0/3270492048 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f347c115440 msgr2=0x7f347c11d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.691+0000 7f34830806c0 1 --2- 10.20.193.96:0/3270492048 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f347c115440 0x7f347c11d780 secure :-1 s=READY pgs=290 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3464005b40 tx=0x7f346402fc60 comp rx=0 tx=0).stop 2026-02-13T03:34:26.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.691+0000 7f34830806c0 1 -- 10.20.193.96:0/3270492048 shutdown_connections 2026-02-13T03:34:26.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.691+0000 7f34830806c0 1 --2- 10.20.193.96:0/3270492048 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f34580b5710 0x7f34580d5bc0 unknown :-1 s=CLOSED pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.695 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.691+0000 7f34830806c0 1 --2- 10.20.193.96:0/3270492048 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f347c122b40 0x7f347c122fe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.696 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.691+0000 7f34830806c0 1 --2- 10.20.193.96:0/3270492048 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f347c115440 0x7f347c11d780 unknown :-1 s=CLOSED pgs=290 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.696 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.691+0000 7f34830806c0 1 --2- 10.20.193.96:0/3270492048 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f347c10f230 0x7f347c11d240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.696 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.691+0000 7f34830806c0 1 -- 10.20.193.96:0/3270492048 >> 10.20.193.96:0/3270492048 conn(0x7f347c0ecb30 msgr2=0x7f347c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.696 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.691+0000 7f34830806c0 1 -- 10.20.193.96:0/3270492048 shutdown_connections 2026-02-13T03:34:26.696 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.691+0000 7f34830806c0 1 -- 10.20.193.96:0/3270492048 wait complete. 2026-02-13T03:34:26.696 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.691+0000 7f76e32fc6c0 1 -- 10.20.193.96:0/998693319 shutdown_connections 2026-02-13T03:34:26.696 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.691+0000 7f76e32fc6c0 1 --2- 10.20.193.96:0/998693319 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f76ac0b5710 0x7f76ac0d5bc0 unknown :-1 s=CLOSED pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.697 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.691+0000 7f76e32fc6c0 1 --2- 10.20.193.96:0/998693319 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f76dc0f50b0 0x7f76dc0fa380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.697 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.691+0000 7f76e32fc6c0 1 --2- 10.20.193.96:0/998693319 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f76dc1131c0 0x7f76dc173a60 unknown :-1 s=CLOSED pgs=289 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.697 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.691+0000 7f76e32fc6c0 1 --2- 10.20.193.96:0/998693319 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f76dc10cfb0 0x7f76dc0f4a80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.697 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.691+0000 7f76e32fc6c0 1 -- 10.20.193.96:0/998693319 >> 10.20.193.96:0/998693319 conn(0x7f76dc0ea8b0 msgr2=0x7f76dc10e770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.697 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.691+0000 7f76e32fc6c0 1 -- 10.20.193.96:0/998693319 shutdown_connections 2026-02-13T03:34:26.697 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.691+0000 7f76e32fc6c0 1 -- 10.20.193.96:0/998693319 wait complete. 2026-02-13T03:34:26.701 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.698+0000 7f8aeaf206c0 1 -- 10.20.193.96:0/1683976725 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8ae410be60 con 0x7f8ae41557c0 2026-02-13T03:34:26.701 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.698+0000 7f8ad9ffb6c0 1 -- 10.20.193.96:0/1683976725 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8ae00aa670 con 0x7f8ae41557c0 2026-02-13T03:34:26.702 INFO:teuthology.orchestra.run.trial096.stdout:55834574867 2026-02-13T03:34:26.705 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.702+0000 7f8aeaf206c0 1 -- 10.20.193.96:0/1683976725 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f8ac00b5610 msgr2=0x7f8ac00d5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.705 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.702+0000 7f8aeaf206c0 1 --2- 10.20.193.96:0/1683976725 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f8ac00b5610 0x7f8ac00d5ac0 secure :-1 s=READY pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ad4004750 tx=0x7f8ad4009390 comp rx=0 tx=0).stop 2026-02-13T03:34:26.706 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.702+0000 7f8aeaf206c0 1 -- 10.20.193.96:0/1683976725 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8ae41557c0 msgr2=0x7f8ae4165ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.706 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.702+0000 7f8aeaf206c0 1 --2- 10.20.193.96:0/1683976725 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8ae41557c0 0x7f8ae4165ea0 secure :-1 s=READY pgs=292 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ae0006ea0 tx=0x7f8ae000cca0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.707 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.704+0000 7f8aeaf206c0 1 -- 10.20.193.96:0/1683976725 shutdown_connections 2026-02-13T03:34:26.707 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.704+0000 7f8aeaf206c0 1 --2- 10.20.193.96:0/1683976725 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f8ac00b5610 0x7f8ac00d5ac0 unknown :-1 s=CLOSED pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.707 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.704+0000 7f8aeaf206c0 1 --2- 10.20.193.96:0/1683976725 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8ae41557c0 0x7f8ae4165ea0 unknown :-1 s=CLOSED pgs=292 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.707 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.704+0000 7f8aeaf206c0 1 --2- 10.20.193.96:0/1683976725 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8ae410c3a0 0x7f8ae4160ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.707 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.704+0000 7f8aeaf206c0 1 --2- 10.20.193.96:0/1683976725 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8ae410ba90 0x7f8ae41605a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.707 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.704+0000 7f8aeaf206c0 1 -- 10.20.193.96:0/1683976725 >> 10.20.193.96:0/1683976725 conn(0x7f8ae40e9770 msgr2=0x7f8ae4109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.707 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.704+0000 7f8aeaf206c0 1 -- 10.20.193.96:0/1683976725 shutdown_connections 2026-02-13T03:34:26.708 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.704+0000 7f8aeaf206c0 1 -- 10.20.193.96:0/1683976725 wait complete. 2026-02-13T03:34:26.709 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266698 got 227633266697 for osd.9 2026-02-13T03:34:26.717 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.713+0000 7f42a047d6c0 1 -- 10.20.193.96:0/8865235 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f429810d9a0 con 0x7f42980f7c90 2026-02-13T03:34:26.717 INFO:teuthology.orchestra.run.trial096.stdout:154618822669 2026-02-13T03:34:26.717 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.714+0000 7f428f7fe6c0 1 -- 10.20.193.96:0/8865235 <== mon.1 v2:10.20.193.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f42940aa490 con 0x7f42980f7c90 2026-02-13T03:34:26.719 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724557 got 167503724556 for osd.7 2026-02-13T03:34:26.720 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495628 got 197568495626 for osd.8 2026-02-13T03:34:26.721 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.717+0000 7f42a047d6c0 1 -- 10.20.193.96:0/8865235 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f42740b5790 msgr2=0x7f42740d5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.721 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.717+0000 7f42a047d6c0 1 --2- 10.20.193.96:0/8865235 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f42740b5790 0x7f42740d5c40 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4288006f90 tx=0x7f4288009290 comp rx=0 tx=0).stop 2026-02-13T03:34:26.721 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.717+0000 7f42a047d6c0 1 -- 10.20.193.96:0/8865235 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f42980f7c90 msgr2=0x7f42980f8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.721 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.717+0000 7f42a047d6c0 1 --2- 10.20.193.96:0/8865235 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f42980f7c90 0x7f42980f8130 secure :-1 s=READY pgs=62 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f429400c6c0 tx=0x7f429400cb90 comp rx=0 tx=0).stop 2026-02-13T03:34:26.721 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.717+0000 7f42a047d6c0 1 -- 10.20.193.96:0/8865235 shutdown_connections 2026-02-13T03:34:26.721 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.717+0000 7f42a047d6c0 1 --2- 10.20.193.96:0/8865235 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f42740b5790 0x7f42740d5c40 unknown :-1 s=CLOSED pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.721 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.717+0000 7f42a047d6c0 1 --2- 10.20.193.96:0/8865235 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f42980f7c90 0x7f42980f8130 unknown :-1 s=CLOSED pgs=62 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.722 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.717+0000 7f42a047d6c0 1 --2- 10.20.193.96:0/8865235 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f42981131c0 0x7f42980f28d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.722 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.717+0000 7f42a047d6c0 1 --2- 10.20.193.96:0/8865235 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f429810cfb0 0x7f42980f2390 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.722 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.717+0000 7f42a047d6c0 1 -- 10.20.193.96:0/8865235 >> 10.20.193.96:0/8865235 conn(0x7f42980ea8b0 msgr2=0x7f429810f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.722 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.717+0000 7f42a047d6c0 1 -- 10.20.193.96:0/8865235 shutdown_connections 2026-02-13T03:34:26.722 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.717+0000 7f42a047d6c0 1 -- 10.20.193.96:0/8865235 wait complete. 2026-02-13T03:34:26.725 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168585 got 240518168583 for osd.10 2026-02-13T03:34:26.738 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378644 got 81604378643 for osd.3 2026-02-13T03:34:26.740 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949672982 got 42949672981 for osd.1 2026-02-13T03:34:26.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.745+0000 7f7d465b06c0 1 -- 10.20.193.96:0/3317759837 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f7d4011c140 con 0x7f7d4010cfb0 2026-02-13T03:34:26.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.745+0000 7f7d3d7fa6c0 1 -- 10.20.193.96:0/3317759837 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7d2c0cd880 con 0x7f7d4010cfb0 2026-02-13T03:34:26.748 INFO:teuthology.orchestra.run.trial096.stdout:30064771095 2026-02-13T03:34:26.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.749+0000 7f7d465b06c0 1 -- 10.20.193.96:0/3317759837 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7d180b5710 msgr2=0x7f7d180d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.749+0000 7f7d465b06c0 1 --2- 10.20.193.96:0/3317759837 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7d180b5710 0x7f7d180d5bc0 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d40121920 tx=0x7f7d24009260 comp rx=0 tx=0).stop 2026-02-13T03:34:26.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.749+0000 7f7d465b06c0 1 -- 10.20.193.96:0/3317759837 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7d4010cfb0 msgr2=0x7f7d4011af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:26.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.749+0000 7f7d465b06c0 1 --2- 10.20.193.96:0/3317759837 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7d4010cfb0 0x7f7d4011af90 secure :-1 s=READY pgs=295 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d2c02f230 tx=0x7f7d2c02fc70 comp rx=0 tx=0).stop 2026-02-13T03:34:26.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.749+0000 7f7d465b06c0 1 -- 10.20.193.96:0/3317759837 shutdown_connections 2026-02-13T03:34:26.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.749+0000 7f7d465b06c0 1 --2- 10.20.193.96:0/3317759837 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7d180b5710 0x7f7d180d5bc0 unknown :-1 s=CLOSED pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.749+0000 7f7d465b06c0 1 --2- 10.20.193.96:0/3317759837 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7d40120890 0x7f7d40120d30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.749+0000 7f7d465b06c0 1 --2- 10.20.193.96:0/3317759837 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7d401131c0 0x7f7d4011b4d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.749+0000 7f7d465b06c0 1 --2- 10.20.193.96:0/3317759837 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7d4010cfb0 0x7f7d4011af90 unknown :-1 s=CLOSED pgs=295 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:26.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.749+0000 7f7d465b06c0 1 -- 10.20.193.96:0/3317759837 >> 10.20.193.96:0/3317759837 conn(0x7f7d400ea8b0 msgr2=0x7f7d4010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:26.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.749+0000 7f7d465b06c0 1 -- 10.20.193.96:0/3317759837 shutdown_connections 2026-02-13T03:34:26.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:26.749+0000 7f7d465b06c0 1 -- 10.20.193.96:0/3317759837 wait complete. 2026-02-13T03:34:26.754 INFO:tasks.cephadm.ceph_manager.ceph:need seq 124554051600 got 124554051599 for osd.5 2026-02-13T03:34:26.759 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574869 got 55834574867 for osd.2 2026-02-13T03:34:26.770 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939655 got 270582939654 for osd.11 2026-02-13T03:34:26.776 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822671 got 154618822669 for osd.6 2026-02-13T03:34:26.793 INFO:tasks.cephadm.ceph_manager.ceph:need seq 30064771097 got 30064771095 for osd.0 2026-02-13T03:34:26.794 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149714 got 111669149712 for osd.4 2026-02-13T03:34:27.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:27 trial096 ceph-mon[24671]: pgmap v189: 97 pgs: 97 active+clean; 632 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 9.0 KiB/s rd, 9.5 KiB/s wr, 19 op/s 2026-02-13T03:34:27.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:27 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3178365145' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T03:34:27.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:27 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3046573155' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T03:34:27.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:27 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/528584071' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T03:34:27.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:27 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/4200401531' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T03:34:27.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:27 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/4293855581' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T03:34:27.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:27 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2211148984' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T03:34:27.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:27 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2097564760' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T03:34:27.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:27 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3270492048' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T03:34:27.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:27 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/998693319' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T03:34:27.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:27 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1683976725' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T03:34:27.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:27 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/8865235' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T03:34:27.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:27 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3317759837' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T03:34:27.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:27 trial132 ceph-mon[26888]: pgmap v189: 97 pgs: 97 active+clean; 632 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 9.0 KiB/s rd, 9.5 KiB/s wr, 19 op/s 2026-02-13T03:34:27.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:27 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3178365145' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T03:34:27.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:27 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3046573155' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T03:34:27.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:27 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/528584071' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T03:34:27.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:27 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/4200401531' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T03:34:27.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:27 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/4293855581' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T03:34:27.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:27 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2211148984' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T03:34:27.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:27 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2097564760' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T03:34:27.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:27 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3270492048' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T03:34:27.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:27 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/998693319' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T03:34:27.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:27 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1683976725' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T03:34:27.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:27 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/8865235' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T03:34:27.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:27 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3317759837' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T03:34:27.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:27 trial133 ceph-mon[26943]: pgmap v189: 97 pgs: 97 active+clean; 632 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 9.0 KiB/s rd, 9.5 KiB/s wr, 19 op/s 2026-02-13T03:34:27.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:27 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3178365145' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T03:34:27.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:27 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3046573155' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T03:34:27.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:27 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/528584071' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T03:34:27.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:27 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/4200401531' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T03:34:27.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:27 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/4293855581' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T03:34:27.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:27 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2211148984' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T03:34:27.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:27 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2097564760' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T03:34:27.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:27 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3270492048' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T03:34:27.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:27 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/998693319' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T03:34:27.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:27 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1683976725' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T03:34:27.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:27 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/8865235' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T03:34:27.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:27 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3317759837' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T03:34:27.710 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd last-stat-seq osd.9 2026-02-13T03:34:27.720 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-13T03:34:27.721 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd last-stat-seq osd.8 2026-02-13T03:34:27.725 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd last-stat-seq osd.10 2026-02-13T03:34:27.739 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-13T03:34:27.741 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-13T03:34:27.754 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-13T03:34:27.760 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-13T03:34:27.770 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd last-stat-seq osd.11 2026-02-13T03:34:27.776 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-13T03:34:27.794 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-13T03:34:27.795 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-13T03:34:27.837 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:27.876 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:27.878 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:27.881 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:27.884 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:27.885 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:27.936 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:27.942 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:27.946 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:27.989 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.986+0000 7ff4896d36c0 1 -- 10.20.193.96:0/1013788095 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff48410fc20 msgr2=0x7ff484114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:27.989 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.986+0000 7ff4896d36c0 1 --2- 10.20.193.96:0/1013788095 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff48410fc20 0x7ff484114c60 secure :-1 s=READY pgs=296 gs=1 cs=0 l=1 c_cookie=18243497651448975016 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff46c0099a0 tx=0x7ff46c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:27.989 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.986+0000 7ff4896d36c0 1 -- 10.20.193.96:0/1013788095 shutdown_connections 2026-02-13T03:34:27.989 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.986+0000 7ff4896d36c0 1 --2- 10.20.193.96:0/1013788095 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff484115440 0x7ff484175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:27.989 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.986+0000 7ff4896d36c0 1 --2- 10.20.193.96:0/1013788095 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff48410fc20 0x7ff484114c60 unknown :-1 s=CLOSED pgs=296 gs=1 cs=0 l=1 c_cookie=18243497651448975016 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:27.989 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.986+0000 7ff4896d36c0 1 --2- 10.20.193.96:0/1013788095 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff48410f230 0x7ff48410f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:27.989 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.986+0000 7ff4896d36c0 1 -- 10.20.193.96:0/1013788095 >> 10.20.193.96:0/1013788095 conn(0x7ff4840ecb30 msgr2=0x7ff48410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:27.990 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.986+0000 7ff4896d36c0 1 -- 10.20.193.96:0/1013788095 shutdown_connections 2026-02-13T03:34:27.990 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.986+0000 7ff4896d36c0 1 -- 10.20.193.96:0/1013788095 wait complete. 2026-02-13T03:34:27.990 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.987+0000 7ff4896d36c0 1 Processor -- start 2026-02-13T03:34:27.990 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.987+0000 7ff4896d36c0 1 -- start start 2026-02-13T03:34:27.990 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.987+0000 7ff4896d36c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff48410f230 0x7ff4840f4ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:27.990 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.987+0000 7ff4896d36c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff484115440 0x7ff484175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:27.990 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.987+0000 7ff4896d36c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff4840f51d0 0x7ff4840fa4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:27.990 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.987+0000 7ff4896d36c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff4840f58c0 con 0x7ff48410f230 2026-02-13T03:34:27.990 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.987+0000 7ff4896d36c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff4840fa9e0 con 0x7ff4840f51d0 2026-02-13T03:34:27.990 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.987+0000 7ff4896d36c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff4840faba0 con 0x7ff484115440 2026-02-13T03:34:27.990 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.987+0000 7ff482ffd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff48410f230 0x7ff4840f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:27.990 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.987+0000 7ff482ffd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff48410f230 0x7ff4840f4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49352/0 (socket says 10.20.193.96:49352) 2026-02-13T03:34:27.990 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.987+0000 7ff482ffd6c0 1 -- 10.20.193.96:0/4017355000 learned_addr learned my addr 10.20.193.96:0/4017355000 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:27.990 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.987+0000 7ff4827fc6c0 1 --2- 10.20.193.96:0/4017355000 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff484115440 0x7ff484175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:27.990 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.987+0000 7ff4837fe6c0 1 --2- 10.20.193.96:0/4017355000 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff4840f51d0 0x7ff4840fa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:27.990 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.987+0000 7ff482ffd6c0 1 -- 10.20.193.96:0/4017355000 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff484115440 msgr2=0x7ff484175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:27.990 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.987+0000 7ff482ffd6c0 1 --2- 10.20.193.96:0/4017355000 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff484115440 0x7ff484175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:27.990 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.987+0000 7ff482ffd6c0 1 -- 10.20.193.96:0/4017355000 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff4840f51d0 msgr2=0x7ff4840fa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:27.990 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.987+0000 7ff482ffd6c0 1 --2- 10.20.193.96:0/4017355000 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff4840f51d0 0x7ff4840fa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:27.990 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.987+0000 7ff482ffd6c0 1 -- 10.20.193.96:0/4017355000 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff46c009590 con 0x7ff48410f230 2026-02-13T03:34:27.990 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.987+0000 7ff482ffd6c0 1 --2- 10.20.193.96:0/4017355000 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff48410f230 0x7ff4840f4ba0 secure :-1 s=READY pgs=297 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff478009490 tx=0x7ff47800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:27.991 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.987+0000 7ff463fff6c0 1 -- 10.20.193.96:0/4017355000 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff478004a80 con 0x7ff48410f230 2026-02-13T03:34:27.991 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.987+0000 7ff4896d36c0 1 -- 10.20.193.96:0/4017355000 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4840fae80 con 0x7ff48410f230 2026-02-13T03:34:27.991 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.987+0000 7ff463fff6c0 1 -- 10.20.193.96:0/4017355000 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7ff478009030 con 0x7ff48410f230 2026-02-13T03:34:27.991 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.988+0000 7ff463fff6c0 1 -- 10.20.193.96:0/4017355000 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff47800cea0 con 0x7ff48410f230 2026-02-13T03:34:27.991 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.988+0000 7ff4896d36c0 1 -- 10.20.193.96:0/4017355000 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4840fb610 con 0x7ff48410f230 2026-02-13T03:34:27.991 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.989+0000 7ff4896d36c0 1 -- 10.20.193.96:0/4017355000 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff484110500 con 0x7ff48410f230 2026-02-13T03:34:27.992 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.990+0000 7ff463fff6c0 1 -- 10.20.193.96:0/4017355000 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7ff478004be0 con 0x7ff48410f230 2026-02-13T03:34:27.993 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.990+0000 7ff463fff6c0 1 --2- 10.20.193.96:0/4017355000 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff4580b5690 0x7ff4580d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:27.993 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.991+0000 7ff4827fc6c0 1 --2- 10.20.193.96:0/4017355000 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff4580b5690 0x7ff4580d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:27.993 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.991+0000 7ff463fff6c0 1 -- 10.20.193.96:0/4017355000 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7ff4780e3b00 con 0x7ff48410f230 2026-02-13T03:34:27.993 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.991+0000 7ff4827fc6c0 1 --2- 10.20.193.96:0/4017355000 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff4580b5690 0x7ff4580d5b40 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff46c0023e0 tx=0x7ff46c009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:27.995 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:27.992+0000 7ff463fff6c0 1 -- 10.20.193.96:0/4017355000 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff4780a6520 con 0x7ff48410f230 2026-02-13T03:34:28.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.003+0000 7efd06c696c0 1 -- 10.20.193.96:0/523034413 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efd0010fbf0 msgr2=0x7efd00114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.003+0000 7efd06c696c0 1 --2- 10.20.193.96:0/523034413 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efd0010fbf0 0x7efd00114c30 secure :-1 s=READY pgs=298 gs=1 cs=0 l=1 c_cookie=9075221757369583586 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efce80099a0 tx=0x7efce802ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:28.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.003+0000 7efd06c696c0 1 -- 10.20.193.96:0/523034413 shutdown_connections 2026-02-13T03:34:28.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.003+0000 7efd06c696c0 1 --2- 10.20.193.96:0/523034413 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efd00115410 0x7efd00175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.003+0000 7efd06c696c0 1 --2- 10.20.193.96:0/523034413 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efd0010fbf0 0x7efd00114c30 unknown :-1 s=CLOSED pgs=298 gs=1 cs=0 l=1 c_cookie=9075221757369583586 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.003+0000 7efd06c696c0 1 --2- 10.20.193.96:0/523034413 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efd0010f200 0x7efd0010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.003+0000 7efd06c696c0 1 -- 10.20.193.96:0/523034413 >> 10.20.193.96:0/523034413 conn(0x7efd000ecb00 msgr2=0x7efd0010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.003+0000 7efd06c696c0 1 -- 10.20.193.96:0/523034413 shutdown_connections 2026-02-13T03:34:28.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.003+0000 7efd06c696c0 1 -- 10.20.193.96:0/523034413 wait complete. 2026-02-13T03:34:28.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.003+0000 7efd06c696c0 1 Processor -- start 2026-02-13T03:34:28.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.004+0000 7efd06c696c0 1 -- start start 2026-02-13T03:34:28.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.004+0000 7efd06c696c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efd0010f200 0x7efd0011d230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.004+0000 7efd06c696c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efd00115410 0x7efd0011d770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.004+0000 7efd06c696c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efd00122b30 0x7efd00122fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.004+0000 7efd06c696c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7efd00123540 con 0x7efd00115410 2026-02-13T03:34:28.006 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.004+0000 7efd06c696c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7efd001236b0 con 0x7efd00122b30 2026-02-13T03:34:28.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.004+0000 7efd06c696c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7efd00123870 con 0x7efd0010f200 2026-02-13T03:34:28.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.004+0000 7efcf7fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efd00115410 0x7efd0011d770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.004+0000 7efcf7fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efd00115410 0x7efd0011d770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49370/0 (socket says 10.20.193.96:49370) 2026-02-13T03:34:28.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.004+0000 7efcf7fff6c0 1 -- 10.20.193.96:0/3002933231 learned_addr learned my addr 10.20.193.96:0/3002933231 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:28.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.004+0000 7efd049da6c0 1 --2- 10.20.193.96:0/3002933231 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efd0010f200 0x7efd0011d230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.004+0000 7efd051db6c0 1 --2- 10.20.193.96:0/3002933231 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efd00122b30 0x7efd00122fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.004+0000 7efcf7fff6c0 1 -- 10.20.193.96:0/3002933231 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efd0010f200 msgr2=0x7efd0011d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.004+0000 7efcf7fff6c0 1 --2- 10.20.193.96:0/3002933231 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efd0010f200 0x7efd0011d230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.004+0000 7efcf7fff6c0 1 -- 10.20.193.96:0/3002933231 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efd00122b30 msgr2=0x7efd00122fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.004+0000 7efcf7fff6c0 1 --2- 10.20.193.96:0/3002933231 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efd00122b30 0x7efd00122fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.004+0000 7efcf7fff6c0 1 -- 10.20.193.96:0/3002933231 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce8009590 con 0x7efd00115410 2026-02-13T03:34:28.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.004+0000 7efcf7fff6c0 1 --2- 10.20.193.96:0/3002933231 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efd00115410 0x7efd0011d770 secure :-1 s=READY pgs=300 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efce802f230 tx=0x7efce802fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:28.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.004+0000 7efcf5ffb6c0 1 -- 10.20.193.96:0/3002933231 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efce8002ae0 con 0x7efd00115410 2026-02-13T03:34:28.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.004+0000 7efcf5ffb6c0 1 -- 10.20.193.96:0/3002933231 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7efce8002c40 con 0x7efd00115410 2026-02-13T03:34:28.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.004+0000 7efd06c696c0 1 -- 10.20.193.96:0/3002933231 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd00163cc0 con 0x7efd00115410 2026-02-13T03:34:28.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.004+0000 7efcf5ffb6c0 1 -- 10.20.193.96:0/3002933231 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efce80312b0 con 0x7efd00115410 2026-02-13T03:34:28.007 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.005+0000 7efd06c696c0 1 -- 10.20.193.96:0/3002933231 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd00164140 con 0x7efd00115410 2026-02-13T03:34:28.008 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.005+0000 7fe5e30916c0 1 -- 10.20.193.96:0/924398923 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe5dc10d9a0 msgr2=0x7fe5dc1129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.008 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.005+0000 7fe5e30916c0 1 --2- 10.20.193.96:0/924398923 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe5dc10d9a0 0x7fe5dc1129e0 secure :-1 s=READY pgs=299 gs=1 cs=0 l=1 c_cookie=11389805801028958206 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe5c40099a0 tx=0x7fe5c402ed70 comp rx=0 tx=0).stop 2026-02-13T03:34:28.008 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.005+0000 7fe5e30916c0 1 -- 10.20.193.96:0/924398923 shutdown_connections 2026-02-13T03:34:28.008 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.005+0000 7fe5e30916c0 1 --2- 10.20.193.96:0/924398923 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe5dc1131c0 0x7fe5dc173b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.008 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.005+0000 7fe5e30916c0 1 --2- 10.20.193.96:0/924398923 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe5dc10d9a0 0x7fe5dc1129e0 unknown :-1 s=CLOSED pgs=299 gs=1 cs=0 l=1 c_cookie=11389805801028958206 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.008 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.005+0000 7fe5e30916c0 1 --2- 10.20.193.96:0/924398923 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe5dc10cfb0 0x7fe5dc10d380 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.008 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.005+0000 7fe5e30916c0 1 -- 10.20.193.96:0/924398923 >> 10.20.193.96:0/924398923 conn(0x7fe5dc0ea8b0 msgr2=0x7fe5dc10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.008 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.005+0000 7efd06c696c0 1 -- 10.20.193.96:0/3002933231 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd001104d0 con 0x7efd00115410 2026-02-13T03:34:28.008 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.005+0000 7fe5e30916c0 1 -- 10.20.193.96:0/924398923 shutdown_connections 2026-02-13T03:34:28.008 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.005+0000 7fe5e30916c0 1 -- 10.20.193.96:0/924398923 wait complete. 2026-02-13T03:34:28.008 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.006+0000 7fe5e30916c0 1 Processor -- start 2026-02-13T03:34:28.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.006+0000 7fe5e30916c0 1 -- start start 2026-02-13T03:34:28.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.006+0000 7fe5e30916c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe5dc10cfb0 0x7fe5dc0f2ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.006+0000 7fe5e30916c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe5dc1131c0 0x7fe5dc173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.006+0000 7fe5e30916c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe5dc0f30f0 0x7fe5dc0f8320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.006+0000 7fe5e30916c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc0f37e0 con 0x7fe5dc10cfb0 2026-02-13T03:34:28.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.006+0000 7fe5e30916c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc0f8860 con 0x7fe5dc0f30f0 2026-02-13T03:34:28.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.006+0000 7fe5e30916c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc0f8a20 con 0x7fe5dc1131c0 2026-02-13T03:34:28.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.006+0000 7fe5e0e026c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe5dc10cfb0 0x7fe5dc0f2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.006+0000 7fe5e0e026c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe5dc10cfb0 0x7fe5dc0f2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49386/0 (socket says 10.20.193.96:49386) 2026-02-13T03:34:28.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.006+0000 7fe5e0e026c0 1 -- 10.20.193.96:0/1537763392 learned_addr learned my addr 10.20.193.96:0/1537763392 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:28.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.006+0000 7fe5d3fff6c0 1 --2- 10.20.193.96:0/1537763392 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe5dc1131c0 0x7fe5dc173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.006+0000 7fe5e16036c0 1 --2- 10.20.193.96:0/1537763392 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe5dc0f30f0 0x7fe5dc0f8320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.006+0000 7fe5e0e026c0 1 -- 10.20.193.96:0/1537763392 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe5dc1131c0 msgr2=0x7fe5dc173a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.006+0000 7fe5e0e026c0 1 --2- 10.20.193.96:0/1537763392 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe5dc1131c0 0x7fe5dc173a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.006+0000 7fe5e0e026c0 1 -- 10.20.193.96:0/1537763392 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe5dc0f30f0 msgr2=0x7fe5dc0f8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.006+0000 7fe5e0e026c0 1 --2- 10.20.193.96:0/1537763392 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe5dc0f30f0 0x7fe5dc0f8320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.006+0000 7fe5e0e026c0 1 -- 10.20.193.96:0/1537763392 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c4009590 con 0x7fe5dc10cfb0 2026-02-13T03:34:28.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.006+0000 7fe5e0e026c0 1 --2- 10.20.193.96:0/1537763392 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe5dc10cfb0 0x7fe5dc0f2ac0 secure :-1 s=READY pgs=301 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe5cc00b750 tx=0x7fe5cc00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:28.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.007+0000 7efcf5ffb6c0 1 -- 10.20.193.96:0/3002933231 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7efce8007980 con 0x7efd00115410 2026-02-13T03:34:28.010 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.007+0000 7efcf5ffb6c0 1 --2- 10.20.193.96:0/3002933231 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efcdc0b5790 0x7efcdc0d5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.010 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.007+0000 7efd049da6c0 1 --2- 10.20.193.96:0/3002933231 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efcdc0b5790 0x7efcdc0d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.010 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.007+0000 7efcf5ffb6c0 1 -- 10.20.193.96:0/3002933231 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7efce8107ca0 con 0x7efd00115410 2026-02-13T03:34:28.010 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.008+0000 7efd049da6c0 1 --2- 10.20.193.96:0/3002933231 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efcdc0b5790 0x7efcdc0d5c40 secure :-1 s=READY pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efcf0005980 tx=0x7efcf0005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:28.010 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.008+0000 7efcf5ffb6c0 1 -- 10.20.193.96:0/3002933231 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7efce80ca6c0 con 0x7efd00115410 2026-02-13T03:34:28.011 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.008+0000 7fe5d1ffb6c0 1 -- 10.20.193.96:0/1537763392 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe5cc004290 con 0x7fe5dc10cfb0 2026-02-13T03:34:28.011 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.008+0000 7fe5d1ffb6c0 1 -- 10.20.193.96:0/1537763392 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fe5cc0043f0 con 0x7fe5dc10cfb0 2026-02-13T03:34:28.011 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.008+0000 7fe5e30916c0 1 -- 10.20.193.96:0/1537763392 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5dc0f8d00 con 0x7fe5dc10cfb0 2026-02-13T03:34:28.011 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.008+0000 7fe5e30916c0 1 -- 10.20.193.96:0/1537763392 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5dc0f9490 con 0x7fe5dc10cfb0 2026-02-13T03:34:28.011 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.008+0000 7fe5d1ffb6c0 1 -- 10.20.193.96:0/1537763392 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe5cc00cd40 con 0x7fe5dc10cfb0 2026-02-13T03:34:28.011 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.009+0000 7fe5e30916c0 1 -- 10.20.193.96:0/1537763392 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5dc10e280 con 0x7fe5dc10cfb0 2026-02-13T03:34:28.012 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.010+0000 7fe5d1ffb6c0 1 -- 10.20.193.96:0/1537763392 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fe5cc002750 con 0x7fe5dc10cfb0 2026-02-13T03:34:28.013 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.010+0000 7fe5d1ffb6c0 1 --2- 10.20.193.96:0/1537763392 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe5b80b5860 0x7fe5b80d5d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.013 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.010+0000 7fd1874876c0 1 -- 10.20.193.96:0/767348120 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd180114190 msgr2=0x7fd180119140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.013 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.010+0000 7fd1874876c0 1 --2- 10.20.193.96:0/767348120 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd180114190 0x7fd180119140 secure :-1 s=READY pgs=56 gs=3 cs=0 l=1 c_cookie=2338941661671437237 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd1740098a0 tx=0x7fd17402ec60 comp rx=0 tx=0).stop 2026-02-13T03:34:28.013 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.011+0000 7fe5d3fff6c0 1 --2- 10.20.193.96:0/1537763392 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe5b80b5860 0x7fe5b80d5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.013 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.011+0000 7fe5d1ffb6c0 1 -- 10.20.193.96:0/1537763392 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7fe5cc0e3780 con 0x7fe5dc10cfb0 2026-02-13T03:34:28.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.011+0000 7fd1874876c0 1 -- 10.20.193.96:0/767348120 shutdown_connections 2026-02-13T03:34:28.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.011+0000 7fd1874876c0 1 --2- 10.20.193.96:0/767348120 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd1801198f0 0x7fd18017a2c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.011+0000 7fd1874876c0 1 --2- 10.20.193.96:0/767348120 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd180114190 0x7fd180119140 unknown :-1 s=CLOSED pgs=56 gs=3 cs=0 l=1 c_cookie=2338941661671437237 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.011+0000 7fd1874876c0 1 --2- 10.20.193.96:0/767348120 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd1801137a0 0x7fd180113b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.011+0000 7fd1874876c0 1 -- 10.20.193.96:0/767348120 >> 10.20.193.96:0/767348120 conn(0x7fd180060760 msgr2=0x7fd180060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.011+0000 7fd1874876c0 1 -- 10.20.193.96:0/767348120 shutdown_connections 2026-02-13T03:34:28.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.011+0000 7fd1874876c0 1 -- 10.20.193.96:0/767348120 wait complete. 2026-02-13T03:34:28.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.011+0000 7fe5d3fff6c0 1 --2- 10.20.193.96:0/1537763392 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe5b80b5860 0x7fe5b80d5d10 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe5dc0f93b0 tx=0x7fe5c40023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:28.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.011+0000 7fd1874876c0 1 Processor -- start 2026-02-13T03:34:28.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.011+0000 7fd1874876c0 1 -- start start 2026-02-13T03:34:28.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.011+0000 7fe5d1ffb6c0 1 -- 10.20.193.96:0/1537763392 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe5cc0a6230 con 0x7fe5dc10cfb0 2026-02-13T03:34:28.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.011+0000 7fd1874876c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd1801137a0 0x7fd1801216f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.011+0000 7fd1874876c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd1801198f0 0x7fd180121c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.011+0000 7fd1874876c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd180126ff0 0x7fd180127490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.011+0000 7fd1874876c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd180127a00 con 0x7fd1801198f0 2026-02-13T03:34:28.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.011+0000 7fd1874876c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd180127b70 con 0x7fd180126ff0 2026-02-13T03:34:28.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.011+0000 7fd1874876c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd180127d30 con 0x7fd1801137a0 2026-02-13T03:34:28.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.011+0000 7fd1851f86c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd1801137a0 0x7fd1801216f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.011+0000 7fd1849f76c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd1801198f0 0x7fd180121c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.011+0000 7fd1851f86c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd1801137a0 0x7fd1801216f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.133:3300/0 says I am v2:10.20.193.96:42274/0 (socket says 10.20.193.96:42274) 2026-02-13T03:34:28.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.011+0000 7fd1851f86c0 1 -- 10.20.193.96:0/1964348582 learned_addr learned my addr 10.20.193.96:0/1964348582 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:28.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.012+0000 7fd1859f96c0 1 --2- 10.20.193.96:0/1964348582 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd180126ff0 0x7fd180127490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.012+0000 7fd1849f76c0 1 -- 10.20.193.96:0/1964348582 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd1801137a0 msgr2=0x7fd1801216f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.012+0000 7fd1849f76c0 1 --2- 10.20.193.96:0/1964348582 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd1801137a0 0x7fd1801216f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.012+0000 7fd1849f76c0 1 -- 10.20.193.96:0/1964348582 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd180126ff0 msgr2=0x7fd180127490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.012+0000 7fd1849f76c0 1 --2- 10.20.193.96:0/1964348582 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd180126ff0 0x7fd180127490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.012+0000 7fd1849f76c0 1 -- 10.20.193.96:0/1964348582 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1740094c0 con 0x7fd1801198f0 2026-02-13T03:34:28.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.012+0000 7fd1849f76c0 1 --2- 10.20.193.96:0/1964348582 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd1801198f0 0x7fd180121c30 secure :-1 s=READY pgs=302 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd1740098a0 tx=0x7fd17402fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:28.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.012+0000 7fd16e7fc6c0 1 -- 10.20.193.96:0/1964348582 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd174002ae0 con 0x7fd1801198f0 2026-02-13T03:34:28.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.012+0000 7fd1874876c0 1 -- 10.20.193.96:0/1964348582 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd180168180 con 0x7fd1801198f0 2026-02-13T03:34:28.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.012+0000 7fd16e7fc6c0 1 -- 10.20.193.96:0/1964348582 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fd1740076a0 con 0x7fd1801198f0 2026-02-13T03:34:28.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.012+0000 7fd16e7fc6c0 1 -- 10.20.193.96:0/1964348582 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd174037620 con 0x7fd1801198f0 2026-02-13T03:34:28.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.012+0000 7fd1874876c0 1 -- 10.20.193.96:0/1964348582 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd180168600 con 0x7fd1801198f0 2026-02-13T03:34:28.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.012+0000 7fd1874876c0 1 -- 10.20.193.96:0/1964348582 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1801149e0 con 0x7fd1801198f0 2026-02-13T03:34:28.016 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.014+0000 7fd16e7fc6c0 1 -- 10.20.193.96:0/1964348582 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fd174002c40 con 0x7fd1801198f0 2026-02-13T03:34:28.017 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.014+0000 7fd16e7fc6c0 1 --2- 10.20.193.96:0/1964348582 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd15c0b5690 0x7fd15c0d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.017 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.014+0000 7fd16e7fc6c0 1 -- 10.20.193.96:0/1964348582 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7fd174107ca0 con 0x7fd1801198f0 2026-02-13T03:34:28.017 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.014+0000 7fd1851f86c0 1 --2- 10.20.193.96:0/1964348582 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd15c0b5690 0x7fd15c0d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.017 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.014+0000 7fd1851f86c0 1 --2- 10.20.193.96:0/1964348582 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd15c0b5690 0x7fd15c0d5b40 secure :-1 s=READY pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd170005fd0 tx=0x7fd170009470 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:28.017 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.015+0000 7fd16e7fc6c0 1 -- 10.20.193.96:0/1964348582 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd1740ca6c0 con 0x7fd1801198f0 2026-02-13T03:34:28.018 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.015+0000 7fd71d07f6c0 1 -- 10.20.193.96:0/2790453895 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd71810d9a0 msgr2=0x7fd7181129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.018 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.015+0000 7fd71d07f6c0 1 --2- 10.20.193.96:0/2790453895 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd71810d9a0 0x7fd7181129e0 secure :-1 s=READY pgs=303 gs=1 cs=0 l=1 c_cookie=18258388550588512173 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7000099a0 tx=0x7fd70002ed50 comp rx=0 tx=0).stop 2026-02-13T03:34:28.018 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.015+0000 7fd71d07f6c0 1 -- 10.20.193.96:0/2790453895 shutdown_connections 2026-02-13T03:34:28.018 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.015+0000 7fd71d07f6c0 1 --2- 10.20.193.96:0/2790453895 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd7181131c0 0x7fd718173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.018 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.015+0000 7fd71d07f6c0 1 --2- 10.20.193.96:0/2790453895 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd71810d9a0 0x7fd7181129e0 unknown :-1 s=CLOSED pgs=303 gs=1 cs=0 l=1 c_cookie=18258388550588512173 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.018 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.016+0000 7fd71d07f6c0 1 --2- 10.20.193.96:0/2790453895 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd71810cfb0 0x7fd71810d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.018 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.016+0000 7fd71d07f6c0 1 -- 10.20.193.96:0/2790453895 >> 10.20.193.96:0/2790453895 conn(0x7fd7180ea8b0 msgr2=0x7fd71810acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.018 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.016+0000 7fd71d07f6c0 1 -- 10.20.193.96:0/2790453895 shutdown_connections 2026-02-13T03:34:28.018 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.016+0000 7fd71d07f6c0 1 -- 10.20.193.96:0/2790453895 wait complete. 2026-02-13T03:34:28.019 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.016+0000 7fd71d07f6c0 1 Processor -- start 2026-02-13T03:34:28.019 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.016+0000 7fd71d07f6c0 1 -- start start 2026-02-13T03:34:28.019 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.016+0000 7fd71d07f6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd71810cfb0 0x7fd71811b000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.019 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.016+0000 7fd71d07f6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd7181131c0 0x7fd71811b540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.019 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.016+0000 7fd71d07f6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd718120900 0x7fd718120da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.019 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.016+0000 7fd71d07f6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd718121310 con 0x7fd71810cfb0 2026-02-13T03:34:28.019 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.016+0000 7fd71d07f6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd718121480 con 0x7fd718120900 2026-02-13T03:34:28.019 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.016+0000 7fd71d07f6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd718121640 con 0x7fd7181131c0 2026-02-13T03:34:28.019 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.016+0000 7fd716d766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd71810cfb0 0x7fd71811b000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.019 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.016+0000 7fd716d766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd71810cfb0 0x7fd71811b000 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49422/0 (socket says 10.20.193.96:49422) 2026-02-13T03:34:28.019 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.016+0000 7fd716d766c0 1 -- 10.20.193.96:0/2914173632 learned_addr learned my addr 10.20.193.96:0/2914173632 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:28.019 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.016+0000 7fd7165756c0 1 --2- 10.20.193.96:0/2914173632 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd7181131c0 0x7fd71811b540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.019 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.016+0000 7fd7175776c0 1 --2- 10.20.193.96:0/2914173632 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd718120900 0x7fd718120da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.019 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.016+0000 7fd716d766c0 1 -- 10.20.193.96:0/2914173632 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd7181131c0 msgr2=0x7fd71811b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.019 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.016+0000 7fd716d766c0 1 --2- 10.20.193.96:0/2914173632 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd7181131c0 0x7fd71811b540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.019 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.016+0000 7fd716d766c0 1 -- 10.20.193.96:0/2914173632 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd718120900 msgr2=0x7fd718120da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.019 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.016+0000 7fd716d766c0 1 --2- 10.20.193.96:0/2914173632 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd718120900 0x7fd718120da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.020 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.016+0000 7fd716d766c0 1 -- 10.20.193.96:0/2914173632 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd700009590 con 0x7fd71810cfb0 2026-02-13T03:34:28.020 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.016+0000 7fd716d766c0 1 --2- 10.20.193.96:0/2914173632 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd71810cfb0 0x7fd71811b000 secure :-1 s=READY pgs=304 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd70c009490 tx=0x7fd70c00bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:28.020 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.017+0000 7fd6f7fff6c0 1 -- 10.20.193.96:0/2914173632 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd70c004a80 con 0x7fd71810cfb0 2026-02-13T03:34:28.020 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.017+0000 7fd71d07f6c0 1 -- 10.20.193.96:0/2914173632 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd718161af0 con 0x7fd71810cfb0 2026-02-13T03:34:28.020 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.017+0000 7fd6f7fff6c0 1 -- 10.20.193.96:0/2914173632 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fd70c009030 con 0x7fd71810cfb0 2026-02-13T03:34:28.020 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.017+0000 7fd6f7fff6c0 1 -- 10.20.193.96:0/2914173632 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd70c00cea0 con 0x7fd71810cfb0 2026-02-13T03:34:28.020 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.017+0000 7fd71d07f6c0 1 -- 10.20.193.96:0/2914173632 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd718161fd0 con 0x7fd71810cfb0 2026-02-13T03:34:28.020 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.018+0000 7fd71d07f6c0 1 -- 10.20.193.96:0/2914173632 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd71810e280 con 0x7fd71810cfb0 2026-02-13T03:34:28.021 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.019+0000 7fd6f7fff6c0 1 -- 10.20.193.96:0/2914173632 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fd70c004060 con 0x7fd71810cfb0 2026-02-13T03:34:28.022 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.019+0000 7fd6f7fff6c0 1 --2- 10.20.193.96:0/2914173632 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd6ec0b5790 0x7fd6ec0d5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.022 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.019+0000 7fd7165756c0 1 --2- 10.20.193.96:0/2914173632 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd6ec0b5790 0x7fd6ec0d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.022 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.019+0000 7fd6f7fff6c0 1 -- 10.20.193.96:0/2914173632 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7fd70c0e3bd0 con 0x7fd71810cfb0 2026-02-13T03:34:28.022 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.020+0000 7fd7165756c0 1 --2- 10.20.193.96:0/2914173632 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd6ec0b5790 0x7fd6ec0d5c40 secure :-1 s=READY pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7000092e0 tx=0x7fd700005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:28.024 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.021+0000 7fd6f7fff6c0 1 -- 10.20.193.96:0/2914173632 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd70c0a65f0 con 0x7fd71810cfb0 2026-02-13T03:34:28.026 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.023+0000 7ff50abc36c0 1 -- 10.20.193.96:0/2406069461 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff50410d970 msgr2=0x7ff5041129b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.026 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.023+0000 7ff50abc36c0 1 --2- 10.20.193.96:0/2406069461 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff50410d970 0x7ff5041129b0 secure :-1 s=READY pgs=305 gs=1 cs=0 l=1 c_cookie=9262404536935942761 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4ec0099a0 tx=0x7ff4ec02ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:28.026 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.023+0000 7ff50abc36c0 1 -- 10.20.193.96:0/2406069461 shutdown_connections 2026-02-13T03:34:28.026 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.023+0000 7ff50abc36c0 1 --2- 10.20.193.96:0/2406069461 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff504113190 0x7ff504173b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.026 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.023+0000 7ff50abc36c0 1 --2- 10.20.193.96:0/2406069461 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff50410d970 0x7ff5041129b0 unknown :-1 s=CLOSED pgs=305 gs=1 cs=0 l=1 c_cookie=9262404536935942761 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.026 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.023+0000 7ff50abc36c0 1 --2- 10.20.193.96:0/2406069461 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff50410cf80 0x7ff50410d350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.026 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.023+0000 7ff50abc36c0 1 -- 10.20.193.96:0/2406069461 >> 10.20.193.96:0/2406069461 conn(0x7ff5040ea880 msgr2=0x7ff50410ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.026 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.023+0000 7ff50abc36c0 1 -- 10.20.193.96:0/2406069461 shutdown_connections 2026-02-13T03:34:28.026 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.023+0000 7ff50abc36c0 1 -- 10.20.193.96:0/2406069461 wait complete. 2026-02-13T03:34:28.026 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.024+0000 7ff50abc36c0 1 Processor -- start 2026-02-13T03:34:28.026 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.024+0000 7ff50abc36c0 1 -- start start 2026-02-13T03:34:28.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.024+0000 7ff50abc36c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff50410cf80 0x7ff5040f2850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.024+0000 7ff50abc36c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff504113190 0x7ff504173a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.024+0000 7ff50abc36c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff5040f2e80 0x7ff5040f8150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.024+0000 7ff5089346c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff50410cf80 0x7ff5040f2850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.024+0000 7ff50abc36c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff5040f3570 con 0x7ff50410cf80 2026-02-13T03:34:28.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.024+0000 7ff5089346c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff50410cf80 0x7ff5040f2850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49448/0 (socket says 10.20.193.96:49448) 2026-02-13T03:34:28.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.024+0000 7ff50abc36c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff5040f8690 con 0x7ff5040f2e80 2026-02-13T03:34:28.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.024+0000 7ff5089346c0 1 -- 10.20.193.96:0/3702391580 learned_addr learned my addr 10.20.193.96:0/3702391580 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:28.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.024+0000 7ff50abc36c0 1 -- 10.20.193.96:0/3702391580 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff5040f8850 con 0x7ff504113190 2026-02-13T03:34:28.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.024+0000 7ff4fbfff6c0 1 --2- 10.20.193.96:0/3702391580 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff504113190 0x7ff504173a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.024+0000 7ff5091356c0 1 --2- 10.20.193.96:0/3702391580 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff5040f2e80 0x7ff5040f8150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.024+0000 7ff5089346c0 1 -- 10.20.193.96:0/3702391580 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff504113190 msgr2=0x7ff504173a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.024+0000 7ff5089346c0 1 --2- 10.20.193.96:0/3702391580 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff504113190 0x7ff504173a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.027 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.024+0000 7ff5089346c0 1 -- 10.20.193.96:0/3702391580 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff5040f2e80 msgr2=0x7ff5040f8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.028 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.024+0000 7ff5089346c0 1 --2- 10.20.193.96:0/3702391580 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff5040f2e80 0x7ff5040f8150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.028 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.024+0000 7ff5089346c0 1 -- 10.20.193.96:0/3702391580 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ec009590 con 0x7ff50410cf80 2026-02-13T03:34:28.028 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.024+0000 7ff5091356c0 1 --2- 10.20.193.96:0/3702391580 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff5040f2e80 0x7ff5040f8150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:34:28.028 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.025+0000 7ff5089346c0 1 --2- 10.20.193.96:0/3702391580 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff50410cf80 0x7ff5040f2850 secure :-1 s=READY pgs=306 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4f400ba30 tx=0x7ff4f400bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:28.028 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.025+0000 7ff4f9ffb6c0 1 -- 10.20.193.96:0/3702391580 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4f4004290 con 0x7ff50410cf80 2026-02-13T03:34:28.028 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.025+0000 7ff4f9ffb6c0 1 -- 10.20.193.96:0/3702391580 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7ff4f4009030 con 0x7ff50410cf80 2026-02-13T03:34:28.028 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.025+0000 7ff4f9ffb6c0 1 -- 10.20.193.96:0/3702391580 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4f400cd10 con 0x7ff50410cf80 2026-02-13T03:34:28.028 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.025+0000 7ff50abc36c0 1 -- 10.20.193.96:0/3702391580 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5040f8b30 con 0x7ff50410cf80 2026-02-13T03:34:28.028 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.025+0000 7ff50abc36c0 1 -- 10.20.193.96:0/3702391580 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5040f92c0 con 0x7ff50410cf80 2026-02-13T03:34:28.028 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.025+0000 7ff4d37fe6c0 1 -- 10.20.193.96:0/3702391580 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4c4005310 con 0x7ff50410cf80 2026-02-13T03:34:28.029 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.027+0000 7ff4f9ffb6c0 1 -- 10.20.193.96:0/3702391580 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7ff4f40026b0 con 0x7ff50410cf80 2026-02-13T03:34:28.030 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.027+0000 7ff4f9ffb6c0 1 --2- 10.20.193.96:0/3702391580 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff4e00b5710 0x7ff4e00d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.030 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.028+0000 7ff4fbfff6c0 1 --2- 10.20.193.96:0/3702391580 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff4e00b5710 0x7ff4e00d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.030 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.028+0000 7ff4f9ffb6c0 1 -- 10.20.193.96:0/3702391580 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7ff4f40e39d0 con 0x7ff50410cf80 2026-02-13T03:34:28.031 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.028+0000 7ff4fbfff6c0 1 --2- 10.20.193.96:0/3702391580 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff4e00b5710 0x7ff4e00d5bc0 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5040f91e0 tx=0x7ff4ec0091e0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:28.031 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.028+0000 7ff4f9ffb6c0 1 -- 10.20.193.96:0/3702391580 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff4f40a63f0 con 0x7ff50410cf80 2026-02-13T03:34:28.053 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:28.061 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:28.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.066+0000 7fd9c67076c0 1 -- 10.20.193.96:0/274562532 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd9c010fc20 msgr2=0x7fd9c0114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.066+0000 7fd9c67076c0 1 --2- 10.20.193.96:0/274562532 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd9c010fc20 0x7fd9c0114c60 secure :-1 s=READY pgs=307 gs=1 cs=0 l=1 c_cookie=5504800423355812356 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9b00099a0 tx=0x7fd9b002ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:28.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.066+0000 7fd9c67076c0 1 -- 10.20.193.96:0/274562532 shutdown_connections 2026-02-13T03:34:28.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.066+0000 7fd9c67076c0 1 --2- 10.20.193.96:0/274562532 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd9c0115440 0x7fd9c0175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.066+0000 7fd9c67076c0 1 --2- 10.20.193.96:0/274562532 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd9c010fc20 0x7fd9c0114c60 unknown :-1 s=CLOSED pgs=307 gs=1 cs=0 l=1 c_cookie=5504800423355812356 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.066+0000 7fd9c67076c0 1 --2- 10.20.193.96:0/274562532 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd9c010f230 0x7fd9c010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.066+0000 7fd9c67076c0 1 -- 10.20.193.96:0/274562532 >> 10.20.193.96:0/274562532 conn(0x7fd9c00ecb30 msgr2=0x7fd9c010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.066+0000 7fd9c67076c0 1 -- 10.20.193.96:0/274562532 shutdown_connections 2026-02-13T03:34:28.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.066+0000 7fd9c67076c0 1 -- 10.20.193.96:0/274562532 wait complete. 2026-02-13T03:34:28.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.066+0000 7f8ba200b6c0 1 -- 10.20.193.96:0/3237938886 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8b9c0669a0 msgr2=0x7f8b9c0629b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.066+0000 7f8ba200b6c0 1 --2- 10.20.193.96:0/3237938886 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8b9c0669a0 0x7f8b9c0629b0 secure :-1 s=READY pgs=308 gs=1 cs=0 l=1 c_cookie=15137267907776565524 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b88009bd0 tx=0x7f8b8802efb0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.066+0000 7f8ba200b6c0 1 -- 10.20.193.96:0/3237938886 shutdown_connections 2026-02-13T03:34:28.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.066+0000 7f8ba200b6c0 1 --2- 10.20.193.96:0/3237938886 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8b9c159a80 0x7f8b9c179ee0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.066+0000 7f8ba200b6c0 1 --2- 10.20.193.96:0/3237938886 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8b9c062fd0 0x7f8b9c063400 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.066+0000 7f8ba200b6c0 1 --2- 10.20.193.96:0/3237938886 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8b9c0669a0 0x7f8b9c0629b0 unknown :-1 s=CLOSED pgs=308 gs=1 cs=0 l=1 c_cookie=15137267907776565524 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.066+0000 7f8ba200b6c0 1 -- 10.20.193.96:0/3237938886 >> 10.20.193.96:0/3237938886 conn(0x7f8b9c0ecb30 msgr2=0x7f8b9c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.066+0000 7f8ba200b6c0 1 -- 10.20.193.96:0/3237938886 shutdown_connections 2026-02-13T03:34:28.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.067+0000 7f8ba200b6c0 1 -- 10.20.193.96:0/3237938886 wait complete. 2026-02-13T03:34:28.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.067+0000 7f8ba200b6c0 1 Processor -- start 2026-02-13T03:34:28.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.067+0000 7fd9c67076c0 1 Processor -- start 2026-02-13T03:34:28.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.067+0000 7f8ba200b6c0 1 -- start start 2026-02-13T03:34:28.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.067+0000 7fd9c67076c0 1 -- start start 2026-02-13T03:34:28.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.067+0000 7f8ba200b6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8b9c062fd0 0x7f8b9c1632f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.067+0000 7f8ba200b6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8b9c159a80 0x7f8b9c163830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.067+0000 7f8ba200b6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8b9c168bf0 0x7f8b9c169090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.067+0000 7f8b9affd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8b9c159a80 0x7f8b9c163830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.067+0000 7f8b9affd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8b9c159a80 0x7f8b9c163830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49476/0 (socket says 10.20.193.96:49476) 2026-02-13T03:34:28.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.067+0000 7f8b9affd6c0 1 -- 10.20.193.96:0/1964130867 learned_addr learned my addr 10.20.193.96:0/1964130867 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:28.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.067+0000 7f8ba200b6c0 1 -- 10.20.193.96:0/1964130867 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c169600 con 0x7f8b9c159a80 2026-02-13T03:34:28.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.067+0000 7f8ba200b6c0 1 -- 10.20.193.96:0/1964130867 --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c169770 con 0x7f8b9c168bf0 2026-02-13T03:34:28.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.067+0000 7f8ba200b6c0 1 -- 10.20.193.96:0/1964130867 --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c169930 con 0x7f8b9c062fd0 2026-02-13T03:34:28.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.067+0000 7fd9c67076c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd9c010f230 0x7fd9c011d1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7fd9c67076c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd9c0115440 0x7fd9c011d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.071 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7f8b9bfff6c0 1 --2- 10.20.193.96:0/1964130867 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8b9c168bf0 0x7f8b9c169090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.071 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7fd9c67076c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd9c0122af0 0x7fd9c0122f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.071 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7fd9c67076c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c0123500 con 0x7fd9c0115440 2026-02-13T03:34:28.071 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7fd9c67076c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c0123670 con 0x7fd9c010f230 2026-02-13T03:34:28.071 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7fd9c67076c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c0123830 con 0x7fd9c0122af0 2026-02-13T03:34:28.071 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7fd9bf7fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd9c0115440 0x7fd9c011d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.071 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7fd9bf7fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd9c0115440 0x7fd9c011d730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49478/0 (socket says 10.20.193.96:49478) 2026-02-13T03:34:28.071 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7fd9bf7fe6c0 1 -- 10.20.193.96:0/1500959647 learned_addr learned my addr 10.20.193.96:0/1500959647 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:28.071 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7f8b9affd6c0 1 -- 10.20.193.96:0/1964130867 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8b9c062fd0 msgr2=0x7f8b9c1632f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.071 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7f8b9affd6c0 1 --2- 10.20.193.96:0/1964130867 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8b9c062fd0 0x7f8b9c1632f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.071 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7f8b9affd6c0 1 -- 10.20.193.96:0/1964130867 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8b9c168bf0 msgr2=0x7f8b9c169090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.071 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7f8b9affd6c0 1 --2- 10.20.193.96:0/1964130867 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8b9c168bf0 0x7f8b9c169090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.071 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7f8b9affd6c0 1 -- 10.20.193.96:0/1964130867 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b88009590 con 0x7f8b9c159a80 2026-02-13T03:34:28.071 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7fd9c4c796c0 1 --2- 10.20.193.96:0/1500959647 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd9c0122af0 0x7fd9c0122f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.071 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7fd9bffff6c0 1 --2- 10.20.193.96:0/1500959647 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd9c010f230 0x7fd9c011d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.071 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7f8b9affd6c0 1 --2- 10.20.193.96:0/1964130867 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8b9c159a80 0x7f8b9c163830 secure :-1 s=READY pgs=309 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b8c00b6c0 tx=0x7f8b8c00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:28.071 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7fd9bf7fe6c0 1 -- 10.20.193.96:0/1500959647 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd9c0122af0 msgr2=0x7fd9c0122f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.072 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7fd9bf7fe6c0 1 --2- 10.20.193.96:0/1500959647 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd9c0122af0 0x7fd9c0122f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.072 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7fd9bf7fe6c0 1 -- 10.20.193.96:0/1500959647 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd9c010f230 msgr2=0x7fd9c011d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.072 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7fd9bf7fe6c0 1 --2- 10.20.193.96:0/1500959647 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd9c010f230 0x7fd9c011d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.072 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7fd9bf7fe6c0 1 -- 10.20.193.96:0/1500959647 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b0009590 con 0x7fd9c0115440 2026-02-13T03:34:28.072 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7fd9c4c796c0 1 --2- 10.20.193.96:0/1500959647 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd9c0122af0 0x7fd9c0122f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:34:28.072 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7f8b98ff96c0 1 -- 10.20.193.96:0/1964130867 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8b8c0044a0 con 0x7f8b9c159a80 2026-02-13T03:34:28.072 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7fd9bf7fe6c0 1 --2- 10.20.193.96:0/1500959647 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd9c0115440 0x7fd9c011d730 secure :-1 s=READY pgs=310 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9b0005b40 tx=0x7fd9b002fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:28.072 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7f8b98ff96c0 1 -- 10.20.193.96:0/1964130867 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f8b8c004600 con 0x7f8b9c159a80 2026-02-13T03:34:28.072 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7f8ba200b6c0 1 -- 10.20.193.96:0/1964130867 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b9c157940 con 0x7f8b9c159a80 2026-02-13T03:34:28.072 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7f8b98ff96c0 1 -- 10.20.193.96:0/1964130867 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8b8c00cd20 con 0x7f8b9c159a80 2026-02-13T03:34:28.072 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.068+0000 7f8ba200b6c0 1 -- 10.20.193.96:0/1964130867 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b9c157e20 con 0x7f8b9c159a80 2026-02-13T03:34:28.072 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.069+0000 7fd9bd7fa6c0 1 -- 10.20.193.96:0/1500959647 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd9b0002ae0 con 0x7fd9c0115440 2026-02-13T03:34:28.072 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.069+0000 7fd9c67076c0 1 -- 10.20.193.96:0/1500959647 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9c0163c80 con 0x7fd9c0115440 2026-02-13T03:34:28.072 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.069+0000 7fd9c67076c0 1 -- 10.20.193.96:0/1500959647 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9c0164100 con 0x7fd9c0115440 2026-02-13T03:34:28.072 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.069+0000 7fd9bd7fa6c0 1 -- 10.20.193.96:0/1500959647 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fd9b0007740 con 0x7fd9c0115440 2026-02-13T03:34:28.072 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.069+0000 7fd9bd7fa6c0 1 -- 10.20.193.96:0/1500959647 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd9b0002ae0 con 0x7fd9c0115440 2026-02-13T03:34:28.072 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.069+0000 7f8b767fc6c0 1 -- 10.20.193.96:0/1964130867 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b64005310 con 0x7f8b9c159a80 2026-02-13T03:34:28.072 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.069+0000 7fd9c67076c0 1 -- 10.20.193.96:0/1500959647 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9c0110500 con 0x7fd9c0115440 2026-02-13T03:34:28.073 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.071+0000 7fd9bd7fa6c0 1 -- 10.20.193.96:0/1500959647 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fd9b0002c40 con 0x7fd9c0115440 2026-02-13T03:34:28.073 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.071+0000 7f8b98ff96c0 1 -- 10.20.193.96:0/1964130867 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f8b8c002750 con 0x7f8b9c159a80 2026-02-13T03:34:28.074 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.071+0000 7fd9bd7fa6c0 1 --2- 10.20.193.96:0/1500959647 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd9940b5750 0x7fd9940d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.074 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.071+0000 7fd9bd7fa6c0 1 -- 10.20.193.96:0/1500959647 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7fd9b00ce600 con 0x7fd9c0115440 2026-02-13T03:34:28.074 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.071+0000 7fd9bffff6c0 1 --2- 10.20.193.96:0/1500959647 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd9940b5750 0x7fd9940d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.074 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.072+0000 7fd9bffff6c0 1 --2- 10.20.193.96:0/1500959647 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd9940b5750 0x7fd9940d5c00 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9ac004750 tx=0x7fd9ac009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:28.074 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.072+0000 7f8b98ff96c0 1 --2- 10.20.193.96:0/1964130867 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f8b700b5710 0x7f8b700d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.075 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.072+0000 7f8b9b7fe6c0 1 --2- 10.20.193.96:0/1964130867 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f8b700b5710 0x7f8b700d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.075 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.072+0000 7f8b98ff96c0 1 -- 10.20.193.96:0/1964130867 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f8b8c0e3910 con 0x7f8b9c159a80 2026-02-13T03:34:28.075 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.072+0000 7f8b9b7fe6c0 1 --2- 10.20.193.96:0/1964130867 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f8b700b5710 0x7f8b700d5bc0 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b88009bd0 tx=0x7f8b88005bc0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:28.078 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.075+0000 7f8b98ff96c0 1 -- 10.20.193.96:0/1964130867 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8b8c0a6330 con 0x7f8b9c159a80 2026-02-13T03:34:28.080 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.077+0000 7fd9bd7fa6c0 1 -- 10.20.193.96:0/1500959647 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd9b00ca3f0 con 0x7fd9c0115440 2026-02-13T03:34:28.081 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.078+0000 7fcb72b946c0 1 -- 10.20.193.96:0/1842846690 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcb6c1131c0 msgr2=0x7fcb6c173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.081 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.078+0000 7fcb72b946c0 1 --2- 10.20.193.96:0/1842846690 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcb6c1131c0 0x7fcb6c173b60 secure :-1 s=READY pgs=311 gs=1 cs=0 l=1 c_cookie=7925889507173191061 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb6800aa70 tx=0x7fcb6802fde0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.081 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.078+0000 7fcb72b946c0 1 -- 10.20.193.96:0/1842846690 shutdown_connections 2026-02-13T03:34:28.081 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.078+0000 7fcb72b946c0 1 --2- 10.20.193.96:0/1842846690 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcb6c1131c0 0x7fcb6c173b60 unknown :-1 s=CLOSED pgs=311 gs=1 cs=0 l=1 c_cookie=7925889507173191061 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.081 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.078+0000 7fcb72b946c0 1 --2- 10.20.193.96:0/1842846690 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fcb6c10d9a0 0x7fcb6c1129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.081 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.078+0000 7fcb72b946c0 1 --2- 10.20.193.96:0/1842846690 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fcb6c10cfb0 0x7fcb6c10d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.081 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.078+0000 7fcb72b946c0 1 -- 10.20.193.96:0/1842846690 >> 10.20.193.96:0/1842846690 conn(0x7fcb6c0ea8b0 msgr2=0x7fcb6c10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.081 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.078+0000 7fcb72b946c0 1 -- 10.20.193.96:0/1842846690 shutdown_connections 2026-02-13T03:34:28.081 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.078+0000 7fcb72b946c0 1 -- 10.20.193.96:0/1842846690 wait complete. 2026-02-13T03:34:28.081 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:28.081 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.078+0000 7fcb72b946c0 1 Processor -- start 2026-02-13T03:34:28.081 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.078+0000 7fcb72b946c0 1 -- start start 2026-02-13T03:34:28.081 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.079+0000 7fcb72b946c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fcb6c10cfb0 0x7fcb6c11ad00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.081 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.079+0000 7fcb72b946c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fcb6c1131c0 0x7fcb6c11b240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.081 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.079+0000 7fcb72b946c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcb6c120600 0x7fcb6c120aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.082 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.079+0000 7fcb72b946c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c121010 con 0x7fcb6c120600 2026-02-13T03:34:28.082 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.079+0000 7fcb72b946c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c121180 con 0x7fcb6c10cfb0 2026-02-13T03:34:28.082 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.079+0000 7fcb72b946c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c121340 con 0x7fcb6c1131c0 2026-02-13T03:34:28.082 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.079+0000 7fcb7110a6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcb6c120600 0x7fcb6c120aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.082 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.079+0000 7fcb7110a6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcb6c120600 0x7fcb6c120aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49490/0 (socket says 10.20.193.96:49490) 2026-02-13T03:34:28.082 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.079+0000 7fcb7110a6c0 1 -- 10.20.193.96:0/805362229 learned_addr learned my addr 10.20.193.96:0/805362229 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:28.082 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.079+0000 7fcb709096c0 1 --2- 10.20.193.96:0/805362229 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fcb6c10cfb0 0x7fcb6c11ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.082 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.079+0000 7fcb63fff6c0 1 --2- 10.20.193.96:0/805362229 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fcb6c1131c0 0x7fcb6c11b240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.082 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.079+0000 7fcb7110a6c0 1 -- 10.20.193.96:0/805362229 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fcb6c1131c0 msgr2=0x7fcb6c11b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.082 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.079+0000 7fcb7110a6c0 1 --2- 10.20.193.96:0/805362229 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fcb6c1131c0 0x7fcb6c11b240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.082 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.079+0000 7fcb7110a6c0 1 -- 10.20.193.96:0/805362229 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fcb6c10cfb0 msgr2=0x7fcb6c11ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.082 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.079+0000 7fcb7110a6c0 1 --2- 10.20.193.96:0/805362229 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fcb6c10cfb0 0x7fcb6c11ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.082 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.079+0000 7fcb7110a6c0 1 -- 10.20.193.96:0/805362229 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6800a660 con 0x7fcb6c120600 2026-02-13T03:34:28.082 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.079+0000 7fcb63fff6c0 1 --2- 10.20.193.96:0/805362229 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fcb6c1131c0 0x7fcb6c11b240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:34:28.082 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.079+0000 7fcb7110a6c0 1 --2- 10.20.193.96:0/805362229 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcb6c120600 0x7fcb6c120aa0 secure :-1 s=READY pgs=312 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb680302f0 tx=0x7fcb68005820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:28.082 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.079+0000 7fcb61ffb6c0 1 -- 10.20.193.96:0/805362229 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb68032e80 con 0x7fcb6c120600 2026-02-13T03:34:28.082 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.079+0000 7fcb61ffb6c0 1 -- 10.20.193.96:0/805362229 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fcb68003cf0 con 0x7fcb6c120600 2026-02-13T03:34:28.082 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.079+0000 7fcb61ffb6c0 1 -- 10.20.193.96:0/805362229 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb680086b0 con 0x7fcb6c120600 2026-02-13T03:34:28.082 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.079+0000 7fcb72b946c0 1 -- 10.20.193.96:0/805362229 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb6c161790 con 0x7fcb6c120600 2026-02-13T03:34:28.082 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.080+0000 7fcb72b946c0 1 -- 10.20.193.96:0/805362229 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb6c161bc0 con 0x7fcb6c120600 2026-02-13T03:34:28.083 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.081+0000 7fcb61ffb6c0 1 -- 10.20.193.96:0/805362229 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fcb68003810 con 0x7fcb6c120600 2026-02-13T03:34:28.084 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.081+0000 7fcb72b946c0 1 -- 10.20.193.96:0/805362229 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb6c10e280 con 0x7fcb6c120600 2026-02-13T03:34:28.084 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.081+0000 7fcb61ffb6c0 1 --2- 10.20.193.96:0/805362229 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcb480b5710 0x7fcb480d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.084 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.081+0000 7fcb61ffb6c0 1 -- 10.20.193.96:0/805362229 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7fcb68108e80 con 0x7fcb6c120600 2026-02-13T03:34:28.084 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.082+0000 7fcb709096c0 1 --2- 10.20.193.96:0/805362229 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcb480b5710 0x7fcb480d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.084 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.082+0000 7fcb709096c0 1 --2- 10.20.193.96:0/805362229 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcb480b5710 0x7fcb480d5bc0 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb5c004750 tx=0x7fcb5c009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:28.086 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.083+0000 7fcb61ffb6c0 1 -- 10.20.193.96:0/805362229 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fcb680cbc00 con 0x7fcb6c120600 2026-02-13T03:34:28.105 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.102+0000 7ff4896d36c0 1 -- 10.20.193.96:0/4017355000 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7ff48410f600 con 0x7ff48410f230 2026-02-13T03:34:28.105 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.102+0000 7ff463fff6c0 1 -- 10.20.193.96:0/4017355000 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff4780a96d0 con 0x7ff48410f230 2026-02-13T03:34:28.105 INFO:teuthology.orchestra.run.trial096.stdout:227633266698 2026-02-13T03:34:28.107 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.105+0000 7ff4896d36c0 1 -- 10.20.193.96:0/4017355000 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff4580b5690 msgr2=0x7ff4580d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.108 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.105+0000 7ff4896d36c0 1 --2- 10.20.193.96:0/4017355000 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff4580b5690 0x7ff4580d5b40 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff46c0023e0 tx=0x7ff46c009260 comp rx=0 tx=0).stop 2026-02-13T03:34:28.108 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.105+0000 7ff4896d36c0 1 -- 10.20.193.96:0/4017355000 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff48410f230 msgr2=0x7ff4840f4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.108 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.105+0000 7ff4896d36c0 1 --2- 10.20.193.96:0/4017355000 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff48410f230 0x7ff4840f4ba0 secure :-1 s=READY pgs=297 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff478009490 tx=0x7ff47800bca0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.108 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.105+0000 7ff4896d36c0 1 -- 10.20.193.96:0/4017355000 shutdown_connections 2026-02-13T03:34:28.108 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.105+0000 7ff4896d36c0 1 --2- 10.20.193.96:0/4017355000 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff4580b5690 0x7ff4580d5b40 unknown :-1 s=CLOSED pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.108 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.105+0000 7ff4896d36c0 1 --2- 10.20.193.96:0/4017355000 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff4840f51d0 0x7ff4840fa4a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.108 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.105+0000 7ff4896d36c0 1 --2- 10.20.193.96:0/4017355000 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff484115440 0x7ff484175ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.108 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.105+0000 7ff4896d36c0 1 --2- 10.20.193.96:0/4017355000 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff48410f230 0x7ff4840f4ba0 unknown :-1 s=CLOSED pgs=297 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.108 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.105+0000 7ff4896d36c0 1 -- 10.20.193.96:0/4017355000 >> 10.20.193.96:0/4017355000 conn(0x7ff4840ecb30 msgr2=0x7ff484113c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.108 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.105+0000 7ff4896d36c0 1 -- 10.20.193.96:0/4017355000 shutdown_connections 2026-02-13T03:34:28.108 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.105+0000 7ff4896d36c0 1 -- 10.20.193.96:0/4017355000 wait complete. 2026-02-13T03:34:28.122 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.119+0000 7fe5e30916c0 1 -- 10.20.193.96:0/1537763392 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe5dc0f3b70 con 0x7fe5dc10cfb0 2026-02-13T03:34:28.122 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.120+0000 7efd06c696c0 1 -- 10.20.193.96:0/3002933231 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7efd0011e3b0 con 0x7efd00115410 2026-02-13T03:34:28.122 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.120+0000 7fe5d1ffb6c0 1 -- 10.20.193.96:0/1537763392 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe5cc0a9350 con 0x7fe5dc10cfb0 2026-02-13T03:34:28.123 INFO:teuthology.orchestra.run.trial096.stdout:167503724557 2026-02-13T03:34:28.123 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.120+0000 7efcf5ffb6c0 1 -- 10.20.193.96:0/3002933231 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7efce8005c00 con 0x7efd00115410 2026-02-13T03:34:28.123 INFO:teuthology.orchestra.run.trial096.stdout:197568495628 2026-02-13T03:34:28.125 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.122+0000 7fe5e30916c0 1 -- 10.20.193.96:0/1537763392 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe5b80b5860 msgr2=0x7fe5b80d5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.125 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.122+0000 7fe5e30916c0 1 --2- 10.20.193.96:0/1537763392 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe5b80b5860 0x7fe5b80d5d10 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe5dc0f93b0 tx=0x7fe5c40023a0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.125 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.122+0000 7fe5e30916c0 1 -- 10.20.193.96:0/1537763392 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe5dc10cfb0 msgr2=0x7fe5dc0f2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.125 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.122+0000 7fe5e30916c0 1 --2- 10.20.193.96:0/1537763392 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe5dc10cfb0 0x7fe5dc0f2ac0 secure :-1 s=READY pgs=301 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe5cc00b750 tx=0x7fe5cc00bc20 comp rx=0 tx=0).stop 2026-02-13T03:34:28.125 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.122+0000 7fe5e30916c0 1 -- 10.20.193.96:0/1537763392 shutdown_connections 2026-02-13T03:34:28.125 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.122+0000 7fe5e30916c0 1 --2- 10.20.193.96:0/1537763392 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe5b80b5860 0x7fe5b80d5d10 unknown :-1 s=CLOSED pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.125 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.122+0000 7fe5e30916c0 1 --2- 10.20.193.96:0/1537763392 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe5dc0f30f0 0x7fe5dc0f8320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.125 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.122+0000 7fe5e30916c0 1 --2- 10.20.193.96:0/1537763392 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe5dc1131c0 0x7fe5dc173a60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.125 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.122+0000 7fe5e30916c0 1 --2- 10.20.193.96:0/1537763392 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe5dc10cfb0 0x7fe5dc0f2ac0 unknown :-1 s=CLOSED pgs=301 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.125 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.122+0000 7fe5e30916c0 1 -- 10.20.193.96:0/1537763392 >> 10.20.193.96:0/1537763392 conn(0x7fe5dc0ea8b0 msgr2=0x7fe5dc10b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.126 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.123+0000 7efd06c696c0 1 -- 10.20.193.96:0/3002933231 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efcdc0b5790 msgr2=0x7efcdc0d5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.126 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.123+0000 7efd06c696c0 1 --2- 10.20.193.96:0/3002933231 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efcdc0b5790 0x7efcdc0d5c40 secure :-1 s=READY pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efcf0005980 tx=0x7efcf0005910 comp rx=0 tx=0).stop 2026-02-13T03:34:28.126 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.123+0000 7efd06c696c0 1 -- 10.20.193.96:0/3002933231 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efd00115410 msgr2=0x7efd0011d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.126 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.123+0000 7efd06c696c0 1 --2- 10.20.193.96:0/3002933231 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efd00115410 0x7efd0011d770 secure :-1 s=READY pgs=300 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efce802f230 tx=0x7efce802fc60 comp rx=0 tx=0).stop 2026-02-13T03:34:28.126 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.123+0000 7efd06c696c0 1 -- 10.20.193.96:0/3002933231 shutdown_connections 2026-02-13T03:34:28.126 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.123+0000 7efd06c696c0 1 --2- 10.20.193.96:0/3002933231 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efcdc0b5790 0x7efcdc0d5c40 unknown :-1 s=CLOSED pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.126 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.123+0000 7efd06c696c0 1 --2- 10.20.193.96:0/3002933231 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efd00122b30 0x7efd00122fd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.126 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.123+0000 7efd06c696c0 1 --2- 10.20.193.96:0/3002933231 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efd00115410 0x7efd0011d770 unknown :-1 s=CLOSED pgs=300 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.126 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.123+0000 7efd06c696c0 1 --2- 10.20.193.96:0/3002933231 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efd0010f200 0x7efd0011d230 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.126 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.123+0000 7efd06c696c0 1 -- 10.20.193.96:0/3002933231 >> 10.20.193.96:0/3002933231 conn(0x7efd000ecb00 msgr2=0x7efd0010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.126 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.123+0000 7efd06c696c0 1 -- 10.20.193.96:0/3002933231 shutdown_connections 2026-02-13T03:34:28.126 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.123+0000 7efd06c696c0 1 -- 10.20.193.96:0/3002933231 wait complete. 2026-02-13T03:34:28.127 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.124+0000 7fd1874876c0 1 -- 10.20.193.96:0/1964348582 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fd180122840 con 0x7fd1801198f0 2026-02-13T03:34:28.127 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.125+0000 7fd16e7fc6c0 1 -- 10.20.193.96:0/1964348582 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd1740cd870 con 0x7fd1801198f0 2026-02-13T03:34:28.127 INFO:teuthology.orchestra.run.trial096.stdout:42949672982 2026-02-13T03:34:28.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.126+0000 7fe5e30916c0 1 -- 10.20.193.96:0/1537763392 shutdown_connections 2026-02-13T03:34:28.128 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.126+0000 7fe5e30916c0 1 -- 10.20.193.96:0/1537763392 wait complete. 2026-02-13T03:34:28.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.127+0000 7fd1874876c0 1 -- 10.20.193.96:0/1964348582 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd15c0b5690 msgr2=0x7fd15c0d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.127+0000 7fd1874876c0 1 --2- 10.20.193.96:0/1964348582 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd15c0b5690 0x7fd15c0d5b40 secure :-1 s=READY pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd170005fd0 tx=0x7fd170009470 comp rx=0 tx=0).stop 2026-02-13T03:34:28.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.127+0000 7fd1874876c0 1 -- 10.20.193.96:0/1964348582 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd1801198f0 msgr2=0x7fd180121c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.127+0000 7fd1874876c0 1 --2- 10.20.193.96:0/1964348582 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd1801198f0 0x7fd180121c30 secure :-1 s=READY pgs=302 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd1740098a0 tx=0x7fd17402fbb0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.128+0000 7fd1874876c0 1 -- 10.20.193.96:0/1964348582 shutdown_connections 2026-02-13T03:34:28.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.128+0000 7fd1874876c0 1 --2- 10.20.193.96:0/1964348582 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd15c0b5690 0x7fd15c0d5b40 unknown :-1 s=CLOSED pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.128+0000 7fd1874876c0 1 --2- 10.20.193.96:0/1964348582 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd180126ff0 0x7fd180127490 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.128+0000 7fd1874876c0 1 --2- 10.20.193.96:0/1964348582 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd1801198f0 0x7fd180121c30 unknown :-1 s=CLOSED pgs=302 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.130 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.128+0000 7fd1874876c0 1 --2- 10.20.193.96:0/1964348582 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd1801137a0 0x7fd1801216f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.128+0000 7fd1874876c0 1 -- 10.20.193.96:0/1964348582 >> 10.20.193.96:0/1964348582 conn(0x7fd180060760 msgr2=0x7fd180114ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.128+0000 7fd1874876c0 1 -- 10.20.193.96:0/1964348582 shutdown_connections 2026-02-13T03:34:28.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.128+0000 7fd1874876c0 1 -- 10.20.193.96:0/1964348582 wait complete. 2026-02-13T03:34:28.135 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.133+0000 7fd71d07f6c0 1 -- 10.20.193.96:0/2914173632 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fd71811c1b0 con 0x7fd71810cfb0 2026-02-13T03:34:28.136 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.133+0000 7fd6f7fff6c0 1 -- 10.20.193.96:0/2914173632 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fd70c0a97a0 con 0x7fd71810cfb0 2026-02-13T03:34:28.136 INFO:teuthology.orchestra.run.trial096.stdout:240518168585 2026-02-13T03:34:28.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.137+0000 7fd71d07f6c0 1 -- 10.20.193.96:0/2914173632 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd6ec0b5790 msgr2=0x7fd6ec0d5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.137+0000 7fd71d07f6c0 1 --2- 10.20.193.96:0/2914173632 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd6ec0b5790 0x7fd6ec0d5c40 secure :-1 s=READY pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7000092e0 tx=0x7fd700005c00 comp rx=0 tx=0).stop 2026-02-13T03:34:28.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.137+0000 7fd71d07f6c0 1 -- 10.20.193.96:0/2914173632 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd71810cfb0 msgr2=0x7fd71811b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.137+0000 7fd71d07f6c0 1 --2- 10.20.193.96:0/2914173632 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd71810cfb0 0x7fd71811b000 secure :-1 s=READY pgs=304 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd70c009490 tx=0x7fd70c00bca0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.137+0000 7fd71d07f6c0 1 -- 10.20.193.96:0/2914173632 shutdown_connections 2026-02-13T03:34:28.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.137+0000 7fd71d07f6c0 1 --2- 10.20.193.96:0/2914173632 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd6ec0b5790 0x7fd6ec0d5c40 unknown :-1 s=CLOSED pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.137+0000 7fd71d07f6c0 1 --2- 10.20.193.96:0/2914173632 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd718120900 0x7fd718120da0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.137+0000 7fd71d07f6c0 1 --2- 10.20.193.96:0/2914173632 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd7181131c0 0x7fd71811b540 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.137+0000 7fd71d07f6c0 1 --2- 10.20.193.96:0/2914173632 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd71810cfb0 0x7fd71811b000 unknown :-1 s=CLOSED pgs=304 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.137+0000 7fd71d07f6c0 1 -- 10.20.193.96:0/2914173632 >> 10.20.193.96:0/2914173632 conn(0x7fd7180ea8b0 msgr2=0x7fd71810ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.137+0000 7fd71d07f6c0 1 -- 10.20.193.96:0/2914173632 shutdown_connections 2026-02-13T03:34:28.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.137+0000 7fd71d07f6c0 1 -- 10.20.193.96:0/2914173632 wait complete. 2026-02-13T03:34:28.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.142+0000 7ff4d37fe6c0 1 -- 10.20.193.96:0/3702391580 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff4c4005890 con 0x7ff50410cf80 2026-02-13T03:34:28.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.143+0000 7ff4f9ffb6c0 1 -- 10.20.193.96:0/3702391580 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff4f40a95a0 con 0x7ff50410cf80 2026-02-13T03:34:28.146 INFO:teuthology.orchestra.run.trial096.stdout:81604378644 2026-02-13T03:34:28.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.146+0000 7ff4d37fe6c0 1 -- 10.20.193.96:0/3702391580 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff4e00b5710 msgr2=0x7ff4e00d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.146+0000 7ff4d37fe6c0 1 --2- 10.20.193.96:0/3702391580 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff4e00b5710 0x7ff4e00d5bc0 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5040f91e0 tx=0x7ff4ec0091e0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.146+0000 7ff4d37fe6c0 1 -- 10.20.193.96:0/3702391580 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff50410cf80 msgr2=0x7ff5040f2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.146+0000 7ff4d37fe6c0 1 --2- 10.20.193.96:0/3702391580 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff50410cf80 0x7ff5040f2850 secure :-1 s=READY pgs=306 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4f400ba30 tx=0x7ff4f400bf00 comp rx=0 tx=0).stop 2026-02-13T03:34:28.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.146+0000 7ff4d37fe6c0 1 -- 10.20.193.96:0/3702391580 shutdown_connections 2026-02-13T03:34:28.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.146+0000 7ff4d37fe6c0 1 --2- 10.20.193.96:0/3702391580 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff4e00b5710 0x7ff4e00d5bc0 unknown :-1 s=CLOSED pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.146+0000 7ff4d37fe6c0 1 --2- 10.20.193.96:0/3702391580 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff5040f2e80 0x7ff5040f8150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.146+0000 7ff4d37fe6c0 1 --2- 10.20.193.96:0/3702391580 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff504113190 0x7ff504173a30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.146+0000 7ff4d37fe6c0 1 --2- 10.20.193.96:0/3702391580 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff50410cf80 0x7ff5040f2850 unknown :-1 s=CLOSED pgs=306 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.146+0000 7ff4d37fe6c0 1 -- 10.20.193.96:0/3702391580 >> 10.20.193.96:0/3702391580 conn(0x7ff5040ea880 msgr2=0x7ff50410f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.146+0000 7ff4d37fe6c0 1 -- 10.20.193.96:0/3702391580 shutdown_connections 2026-02-13T03:34:28.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.146+0000 7ff4d37fe6c0 1 -- 10.20.193.96:0/3702391580 wait complete. 2026-02-13T03:34:28.186 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266698 got 227633266698 for osd.9 2026-02-13T03:34:28.186 DEBUG:teuthology.parallel:result is None 2026-02-13T03:34:28.188 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949672982 got 42949672982 for osd.1 2026-02-13T03:34:28.188 DEBUG:teuthology.parallel:result is None 2026-02-13T03:34:28.190 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724557 got 167503724557 for osd.7 2026-02-13T03:34:28.190 DEBUG:teuthology.parallel:result is None 2026-02-13T03:34:28.193 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.190+0000 7f8b767fc6c0 1 -- 10.20.193.96:0/1964130867 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f8b640055c0 con 0x7f8b9c159a80 2026-02-13T03:34:28.193 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.190+0000 7f8b98ff96c0 1 -- 10.20.193.96:0/1964130867 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8b8c0a94e0 con 0x7f8b9c159a80 2026-02-13T03:34:28.193 INFO:teuthology.orchestra.run.trial096.stdout:154618822671 2026-02-13T03:34:28.195 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.192+0000 7f8b767fc6c0 1 -- 10.20.193.96:0/1964130867 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f8b700b5710 msgr2=0x7f8b700d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.195 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.192+0000 7f8b767fc6c0 1 --2- 10.20.193.96:0/1964130867 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f8b700b5710 0x7f8b700d5bc0 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b88009bd0 tx=0x7f8b88005bc0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.195 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.192+0000 7f8b767fc6c0 1 -- 10.20.193.96:0/1964130867 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8b9c159a80 msgr2=0x7f8b9c163830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.195 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.192+0000 7f8b767fc6c0 1 --2- 10.20.193.96:0/1964130867 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8b9c159a80 0x7f8b9c163830 secure :-1 s=READY pgs=309 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b8c00b6c0 tx=0x7f8b8c00bb90 comp rx=0 tx=0).stop 2026-02-13T03:34:28.195 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.192+0000 7f8b767fc6c0 1 -- 10.20.193.96:0/1964130867 shutdown_connections 2026-02-13T03:34:28.195 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.192+0000 7f8b767fc6c0 1 --2- 10.20.193.96:0/1964130867 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f8b700b5710 0x7f8b700d5bc0 unknown :-1 s=CLOSED pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.195 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.192+0000 7f8b767fc6c0 1 --2- 10.20.193.96:0/1964130867 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8b9c168bf0 0x7f8b9c169090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.195 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.192+0000 7f8b767fc6c0 1 --2- 10.20.193.96:0/1964130867 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8b9c159a80 0x7f8b9c163830 unknown :-1 s=CLOSED pgs=309 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.195 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.192+0000 7f8b767fc6c0 1 --2- 10.20.193.96:0/1964130867 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8b9c062fd0 0x7f8b9c1632f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.195 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.192+0000 7f8b767fc6c0 1 -- 10.20.193.96:0/1964130867 >> 10.20.193.96:0/1964130867 conn(0x7f8b9c0ecb30 msgr2=0x7f8b9c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.195 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.192+0000 7f8b767fc6c0 1 -- 10.20.193.96:0/1964130867 shutdown_connections 2026-02-13T03:34:28.195 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.192+0000 7f8b767fc6c0 1 -- 10.20.193.96:0/1964130867 wait complete. 2026-02-13T03:34:28.196 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f793ae7d6c0 1 -- 10.20.193.96:0/4139045140 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7934115440 msgr2=0x7f7934175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.196 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f793ae7d6c0 1 --2- 10.20.193.96:0/4139045140 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7934115440 0x7f7934175de0 secure :-1 s=READY pgs=313 gs=1 cs=0 l=1 c_cookie=11813218855308372689 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f793000aa70 tx=0x7f793002fde0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.196 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f793ae7d6c0 1 -- 10.20.193.96:0/4139045140 shutdown_connections 2026-02-13T03:34:28.196 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f793ae7d6c0 1 --2- 10.20.193.96:0/4139045140 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7934115440 0x7f7934175de0 unknown :-1 s=CLOSED pgs=313 gs=1 cs=0 l=1 c_cookie=11813218855308372689 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.196 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f793ae7d6c0 1 --2- 10.20.193.96:0/4139045140 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f793410fc20 0x7f7934114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.197 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f793ae7d6c0 1 --2- 10.20.193.96:0/4139045140 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f793410f230 0x7f793410f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.197 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f793ae7d6c0 1 -- 10.20.193.96:0/4139045140 >> 10.20.193.96:0/4139045140 conn(0x7f79340ecb30 msgr2=0x7f793410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.197 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f793ae7d6c0 1 -- 10.20.193.96:0/4139045140 shutdown_connections 2026-02-13T03:34:28.197 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f793ae7d6c0 1 -- 10.20.193.96:0/4139045140 wait complete. 2026-02-13T03:34:28.197 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f793ae7d6c0 1 Processor -- start 2026-02-13T03:34:28.197 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f793ae7d6c0 1 -- start start 2026-02-13T03:34:28.197 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f793ae7d6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f793410f230 0x7f793411d1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.197 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f793ae7d6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7934115440 0x7f793411d6e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.197 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f793ae7d6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7934122aa0 0x7f7934122f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.197 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7fd9c67076c0 1 -- 10.20.193.96:0/1500959647 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fd9c011e340 con 0x7fd9c0115440 2026-02-13T03:34:28.197 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f793ae7d6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f79341234b0 con 0x7f793410f230 2026-02-13T03:34:28.197 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f793ae7d6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7934123620 con 0x7f7934115440 2026-02-13T03:34:28.197 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f793ae7d6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f79341237e0 con 0x7f7934122aa0 2026-02-13T03:34:28.197 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f7938bee6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f793410f230 0x7f793411d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.197 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f7938bee6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f793410f230 0x7f793411d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49504/0 (socket says 10.20.193.96:49504) 2026-02-13T03:34:28.197 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f7938bee6c0 1 -- 10.20.193.96:0/3365246735 learned_addr learned my addr 10.20.193.96:0/3365246735 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:28.197 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f792bfff6c0 1 --2- 10.20.193.96:0/3365246735 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7934115440 0x7f793411d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.197 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f79393ef6c0 1 --2- 10.20.193.96:0/3365246735 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7934122aa0 0x7f7934122f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.198 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7fd9bd7fa6c0 1 -- 10.20.193.96:0/1500959647 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fd9b00ca3f0 con 0x7fd9c0115440 2026-02-13T03:34:28.198 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f7938bee6c0 1 -- 10.20.193.96:0/3365246735 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7934122aa0 msgr2=0x7f7934122f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.198 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f7938bee6c0 1 --2- 10.20.193.96:0/3365246735 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7934122aa0 0x7f7934122f40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.198 INFO:teuthology.orchestra.run.trial096.stdout:270582939655 2026-02-13T03:34:28.198 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f7938bee6c0 1 -- 10.20.193.96:0/3365246735 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7934115440 msgr2=0x7f793411d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.198 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f7938bee6c0 1 --2- 10.20.193.96:0/3365246735 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7934115440 0x7f793411d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.198 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.194+0000 7f7938bee6c0 1 -- 10.20.193.96:0/3365246735 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793000a660 con 0x7f793410f230 2026-02-13T03:34:28.198 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.195+0000 7f7938bee6c0 1 --2- 10.20.193.96:0/3365246735 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f793410f230 0x7f793411d1a0 secure :-1 s=READY pgs=314 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7924009490 tx=0x7f792400bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:28.198 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.195+0000 7f7929ffb6c0 1 -- 10.20.193.96:0/3365246735 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7924004a80 con 0x7f793410f230 2026-02-13T03:34:28.198 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.195+0000 7f793ae7d6c0 1 -- 10.20.193.96:0/3365246735 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7934163c90 con 0x7f793410f230 2026-02-13T03:34:28.198 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.195+0000 7f7929ffb6c0 1 -- 10.20.193.96:0/3365246735 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f7924009030 con 0x7f793410f230 2026-02-13T03:34:28.198 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.195+0000 7f7929ffb6c0 1 -- 10.20.193.96:0/3365246735 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f792400cea0 con 0x7f793410f230 2026-02-13T03:34:28.198 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.195+0000 7f793ae7d6c0 1 -- 10.20.193.96:0/3365246735 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7934164170 con 0x7f793410f230 2026-02-13T03:34:28.198 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.195+0000 7f793ae7d6c0 1 -- 10.20.193.96:0/3365246735 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7934110500 con 0x7f793410f230 2026-02-13T03:34:28.199 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.196+0000 7fcb72b946c0 1 -- 10.20.193.96:0/805362229 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fcb6c10d9a0 con 0x7fcb6c120600 2026-02-13T03:34:28.199 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.197+0000 7fd9c67076c0 1 -- 10.20.193.96:0/1500959647 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd9940b5750 msgr2=0x7fd9940d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.200 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.197+0000 7fd9c67076c0 1 --2- 10.20.193.96:0/1500959647 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd9940b5750 0x7fd9940d5c00 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9ac004750 tx=0x7fd9ac009260 comp rx=0 tx=0).stop 2026-02-13T03:34:28.200 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.197+0000 7fd9c67076c0 1 -- 10.20.193.96:0/1500959647 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd9c0115440 msgr2=0x7fd9c011d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.200 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.197+0000 7fd9c67076c0 1 --2- 10.20.193.96:0/1500959647 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd9c0115440 0x7fd9c011d730 secure :-1 s=READY pgs=310 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9b0005b40 tx=0x7fd9b002fbf0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.200 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.197+0000 7f7929ffb6c0 1 -- 10.20.193.96:0/3365246735 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f7924004060 con 0x7f793410f230 2026-02-13T03:34:28.200 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.197+0000 7fd9c67076c0 1 -- 10.20.193.96:0/1500959647 shutdown_connections 2026-02-13T03:34:28.200 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.197+0000 7fd9c67076c0 1 --2- 10.20.193.96:0/1500959647 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd9940b5750 0x7fd9940d5c00 unknown :-1 s=CLOSED pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.200 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.197+0000 7fd9c67076c0 1 --2- 10.20.193.96:0/1500959647 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd9c0122af0 0x7fd9c0122f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.200 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.197+0000 7fd9c67076c0 1 --2- 10.20.193.96:0/1500959647 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd9c0115440 0x7fd9c011d730 unknown :-1 s=CLOSED pgs=310 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.200 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.197+0000 7fd9c67076c0 1 --2- 10.20.193.96:0/1500959647 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd9c010f230 0x7fd9c011d1f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.200 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.197+0000 7fd9c67076c0 1 -- 10.20.193.96:0/1500959647 >> 10.20.193.96:0/1500959647 conn(0x7fd9c00ecb30 msgr2=0x7fd9c010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.200 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.197+0000 7fd9c67076c0 1 -- 10.20.193.96:0/1500959647 shutdown_connections 2026-02-13T03:34:28.200 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.197+0000 7fd9c67076c0 1 -- 10.20.193.96:0/1500959647 wait complete. 2026-02-13T03:34:28.200 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.198+0000 7f7929ffb6c0 1 --2- 10.20.193.96:0/3365246735 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f79100b5690 0x7f79100d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.200 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.198+0000 7f792bfff6c0 1 --2- 10.20.193.96:0/3365246735 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f79100b5690 0x7f79100d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.200 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.198+0000 7fcb61ffb6c0 1 -- 10.20.193.96:0/805362229 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcb68006ce0 con 0x7fcb6c120600 2026-02-13T03:34:28.200 INFO:teuthology.orchestra.run.trial096.stdout:55834574869 2026-02-13T03:34:28.201 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.198+0000 7f7929ffb6c0 1 -- 10.20.193.96:0/3365246735 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f79240e3b90 con 0x7f793410f230 2026-02-13T03:34:28.201 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.198+0000 7f792bfff6c0 1 --2- 10.20.193.96:0/3365246735 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f79100b5690 0x7f79100d5b40 secure :-1 s=READY pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7934123b30 tx=0x7f791c0093f0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:28.201 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.198+0000 7f7929ffb6c0 1 -- 10.20.193.96:0/3365246735 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f79240aa010 con 0x7f793410f230 2026-02-13T03:34:28.203 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.201+0000 7fcb72b946c0 1 -- 10.20.193.96:0/805362229 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcb480b5710 msgr2=0x7fcb480d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.201+0000 7fcb72b946c0 1 --2- 10.20.193.96:0/805362229 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcb480b5710 0x7fcb480d5bc0 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb5c004750 tx=0x7fcb5c009260 comp rx=0 tx=0).stop 2026-02-13T03:34:28.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.201+0000 7fcb72b946c0 1 -- 10.20.193.96:0/805362229 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcb6c120600 msgr2=0x7fcb6c120aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.201+0000 7fcb72b946c0 1 --2- 10.20.193.96:0/805362229 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcb6c120600 0x7fcb6c120aa0 secure :-1 s=READY pgs=312 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb680302f0 tx=0x7fcb68005820 comp rx=0 tx=0).stop 2026-02-13T03:34:28.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.201+0000 7fcb72b946c0 1 -- 10.20.193.96:0/805362229 shutdown_connections 2026-02-13T03:34:28.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.201+0000 7fcb72b946c0 1 --2- 10.20.193.96:0/805362229 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fcb480b5710 0x7fcb480d5bc0 unknown :-1 s=CLOSED pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.201+0000 7fcb72b946c0 1 --2- 10.20.193.96:0/805362229 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fcb6c120600 0x7fcb6c120aa0 unknown :-1 s=CLOSED pgs=312 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.201+0000 7fcb72b946c0 1 --2- 10.20.193.96:0/805362229 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fcb6c1131c0 0x7fcb6c11b240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.201+0000 7fcb72b946c0 1 --2- 10.20.193.96:0/805362229 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fcb6c10cfb0 0x7fcb6c11ad00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.201+0000 7fcb72b946c0 1 -- 10.20.193.96:0/805362229 >> 10.20.193.96:0/805362229 conn(0x7fcb6c0ea8b0 msgr2=0x7fcb6c10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.201+0000 7fcb72b946c0 1 -- 10.20.193.96:0/805362229 shutdown_connections 2026-02-13T03:34:28.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.201+0000 7fcb72b946c0 1 -- 10.20.193.96:0/805362229 wait complete. 2026-02-13T03:34:28.206 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495628 got 197568495628 for osd.8 2026-02-13T03:34:28.206 DEBUG:teuthology.parallel:result is None 2026-02-13T03:34:28.207 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.204+0000 7f29659b86c0 1 -- 10.20.193.96:0/3876233085 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f296010fc20 msgr2=0x7f2960114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.207 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.204+0000 7f29659b86c0 1 --2- 10.20.193.96:0/3876233085 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f296010fc20 0x7f2960114c60 secure :-1 s=READY pgs=315 gs=1 cs=0 l=1 c_cookie=8272984325274142466 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29480099a0 tx=0x7f294802ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:28.207 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.204+0000 7f29659b86c0 1 -- 10.20.193.96:0/3876233085 shutdown_connections 2026-02-13T03:34:28.207 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.204+0000 7f29659b86c0 1 --2- 10.20.193.96:0/3876233085 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2960115440 0x7f2960175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.207 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.204+0000 7f29659b86c0 1 --2- 10.20.193.96:0/3876233085 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f296010fc20 0x7f2960114c60 unknown :-1 s=CLOSED pgs=315 gs=1 cs=0 l=1 c_cookie=8272984325274142466 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.207 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.204+0000 7f29659b86c0 1 --2- 10.20.193.96:0/3876233085 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f296010f230 0x7f296010f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.207 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.204+0000 7f29659b86c0 1 -- 10.20.193.96:0/3876233085 >> 10.20.193.96:0/3876233085 conn(0x7f29600ecb30 msgr2=0x7f296010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.207 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.204+0000 7f29659b86c0 1 -- 10.20.193.96:0/3876233085 shutdown_connections 2026-02-13T03:34:28.207 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.204+0000 7f29659b86c0 1 -- 10.20.193.96:0/3876233085 wait complete. 2026-02-13T03:34:28.207 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.204+0000 7f29659b86c0 1 Processor -- start 2026-02-13T03:34:28.207 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f29659b86c0 1 -- start start 2026-02-13T03:34:28.207 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f29659b86c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f296010f230 0x7f29600f4ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.207 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f29659b86c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2960115440 0x7f2960175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.207 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f29659b86c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f29600f51d0 0x7f29600fa4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.208 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f29659b86c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f29600f58c0 con 0x7f2960115440 2026-02-13T03:34:28.208 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f29659b86c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f29600fa9e0 con 0x7f296010f230 2026-02-13T03:34:28.208 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f29659b86c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f29600faba0 con 0x7f29600f51d0 2026-02-13T03:34:28.208 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f295e7fc6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2960115440 0x7f2960175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.208 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f295e7fc6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2960115440 0x7f2960175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49516/0 (socket says 10.20.193.96:49516) 2026-02-13T03:34:28.208 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f295e7fc6c0 1 -- 10.20.193.96:0/3303730510 learned_addr learned my addr 10.20.193.96:0/3303730510 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:28.208 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f295effd6c0 1 --2- 10.20.193.96:0/3303730510 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f296010f230 0x7f29600f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.208 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f295e7fc6c0 1 -- 10.20.193.96:0/3303730510 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f29600f51d0 msgr2=0x7f29600fa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.208 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f295f7fe6c0 1 --2- 10.20.193.96:0/3303730510 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f29600f51d0 0x7f29600fa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.208 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f295e7fc6c0 1 --2- 10.20.193.96:0/3303730510 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f29600f51d0 0x7f29600fa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.208 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f295e7fc6c0 1 -- 10.20.193.96:0/3303730510 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f296010f230 msgr2=0x7f29600f4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.208 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f295e7fc6c0 1 --2- 10.20.193.96:0/3303730510 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f296010f230 0x7f29600f4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.208 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f295e7fc6c0 1 -- 10.20.193.96:0/3303730510 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2948009590 con 0x7f2960115440 2026-02-13T03:34:28.208 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f295effd6c0 1 --2- 10.20.193.96:0/3303730510 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f296010f230 0x7f29600f4ba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:34:28.208 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f295f7fe6c0 1 --2- 10.20.193.96:0/3303730510 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f29600f51d0 0x7f29600fa4a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:34:28.208 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f295e7fc6c0 1 --2- 10.20.193.96:0/3303730510 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2960115440 0x7f2960175ce0 secure :-1 s=READY pgs=316 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f294802f230 tx=0x7f294802fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:28.208 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f29649b26c0 1 -- 10.20.193.96:0/3303730510 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2948002ae0 con 0x7f2960115440 2026-02-13T03:34:28.208 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f29659b86c0 1 -- 10.20.193.96:0/3303730510 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29600fae20 con 0x7f2960115440 2026-02-13T03:34:28.208 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f29649b26c0 1 -- 10.20.193.96:0/3303730510 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f2948007740 con 0x7f2960115440 2026-02-13T03:34:28.208 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f29649b26c0 1 -- 10.20.193.96:0/3303730510 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2948031630 con 0x7f2960115440 2026-02-13T03:34:28.208 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.205+0000 7f29659b86c0 1 -- 10.20.193.96:0/3303730510 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29600fb2f0 con 0x7f2960115440 2026-02-13T03:34:28.208 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.206+0000 7f29659b86c0 1 -- 10.20.193.96:0/3303730510 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2960110500 con 0x7f2960115440 2026-02-13T03:34:28.209 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168585 got 240518168585 for osd.10 2026-02-13T03:34:28.209 DEBUG:teuthology.parallel:result is None 2026-02-13T03:34:28.210 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378644 got 81604378644 for osd.3 2026-02-13T03:34:28.210 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.208+0000 7f29649b26c0 1 -- 10.20.193.96:0/3303730510 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f2948002c40 con 0x7f2960115440 2026-02-13T03:34:28.210 DEBUG:teuthology.parallel:result is None 2026-02-13T03:34:28.211 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.208+0000 7f29649b26c0 1 --2- 10.20.193.96:0/3303730510 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f29340b5690 0x7f29340d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.211 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.208+0000 7f29649b26c0 1 -- 10.20.193.96:0/3303730510 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f2948107c20 con 0x7f2960115440 2026-02-13T03:34:28.211 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.208+0000 7f295effd6c0 1 --2- 10.20.193.96:0/3303730510 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f29340b5690 0x7f29340d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.211 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.209+0000 7f295effd6c0 1 --2- 10.20.193.96:0/3303730510 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f29340b5690 0x7f29340d5b40 secure :-1 s=READY pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2954004750 tx=0x7f2954005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:28.212 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.209+0000 7f29649b26c0 1 -- 10.20.193.96:0/3303730510 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f29480ca680 con 0x7f2960115440 2026-02-13T03:34:28.213 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.210+0000 7f2344b376c0 1 -- 10.20.193.96:0/3750701078 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f234010f200 msgr2=0x7f234010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.213 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.210+0000 7f2344b376c0 1 --2- 10.20.193.96:0/3750701078 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f234010f200 0x7f234010f5d0 secure :-1 s=READY pgs=317 gs=1 cs=0 l=1 c_cookie=8683822501670202509 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23340099a0 tx=0x7f233402ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:28.213 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.210+0000 7f2344b376c0 1 -- 10.20.193.96:0/3750701078 shutdown_connections 2026-02-13T03:34:28.213 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.210+0000 7f2344b376c0 1 --2- 10.20.193.96:0/3750701078 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2340115410 0x7f2340175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.213 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.210+0000 7f2344b376c0 1 --2- 10.20.193.96:0/3750701078 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f234010fbf0 0x7f2340114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.213 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.210+0000 7f2344b376c0 1 --2- 10.20.193.96:0/3750701078 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f234010f200 0x7f234010f5d0 unknown :-1 s=CLOSED pgs=317 gs=1 cs=0 l=1 c_cookie=8683822501670202509 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.213 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.210+0000 7f2344b376c0 1 -- 10.20.193.96:0/3750701078 >> 10.20.193.96:0/3750701078 conn(0x7f23400ecb00 msgr2=0x7f234010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.213 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.210+0000 7f2344b376c0 1 -- 10.20.193.96:0/3750701078 shutdown_connections 2026-02-13T03:34:28.213 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.210+0000 7f2344b376c0 1 -- 10.20.193.96:0/3750701078 wait complete. 2026-02-13T03:34:28.213 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.210+0000 7f2344b376c0 1 Processor -- start 2026-02-13T03:34:28.213 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.211+0000 7f2344b376c0 1 -- start start 2026-02-13T03:34:28.213 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.211+0000 7f2344b376c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f234010f200 0x7f234011d1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.213 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.211+0000 7f2344b376c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2340115410 0x7f234011d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.213 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.211+0000 7f2344b376c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2340122af0 0x7f2340122f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.211+0000 7f2344b376c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2340123500 con 0x7f2340115410 2026-02-13T03:34:28.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.211+0000 7f2344b376c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2340123670 con 0x7f234010f200 2026-02-13T03:34:28.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.211+0000 7f2344b376c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2340123830 con 0x7f2340122af0 2026-02-13T03:34:28.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.211+0000 7f233dd746c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2340115410 0x7f234011d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.211+0000 7f233dd746c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2340115410 0x7f234011d730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49538/0 (socket says 10.20.193.96:49538) 2026-02-13T03:34:28.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.211+0000 7f233dd746c0 1 -- 10.20.193.96:0/451425112 learned_addr learned my addr 10.20.193.96:0/451425112 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:28.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.211+0000 7f233e5756c0 1 --2- 10.20.193.96:0/451425112 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f234010f200 0x7f234011d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.211+0000 7f233ed766c0 1 --2- 10.20.193.96:0/451425112 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2340122af0 0x7f2340122f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.211+0000 7f233dd746c0 1 -- 10.20.193.96:0/451425112 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2340122af0 msgr2=0x7f2340122f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.211+0000 7f233dd746c0 1 --2- 10.20.193.96:0/451425112 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2340122af0 0x7f2340122f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.211+0000 7f233dd746c0 1 -- 10.20.193.96:0/451425112 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f234010f200 msgr2=0x7f234011d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.211+0000 7f233dd746c0 1 --2- 10.20.193.96:0/451425112 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f234010f200 0x7f234011d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.211+0000 7f233dd746c0 1 -- 10.20.193.96:0/451425112 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2334009590 con 0x7f2340115410 2026-02-13T03:34:28.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.211+0000 7f233e5756c0 1 --2- 10.20.193.96:0/451425112 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f234010f200 0x7f234011d1f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:34:28.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.211+0000 7f233dd746c0 1 --2- 10.20.193.96:0/451425112 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2340115410 0x7f234011d730 secure :-1 s=READY pgs=318 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2328005dc0 tx=0x7f232800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:28.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.211+0000 7f23277fe6c0 1 -- 10.20.193.96:0/451425112 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2328004250 con 0x7f2340115410 2026-02-13T03:34:28.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.211+0000 7f2344b376c0 1 -- 10.20.193.96:0/451425112 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2340163ce0 con 0x7f2340115410 2026-02-13T03:34:28.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.211+0000 7f23277fe6c0 1 -- 10.20.193.96:0/451425112 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f2328009070 con 0x7f2340115410 2026-02-13T03:34:28.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.211+0000 7f23277fe6c0 1 -- 10.20.193.96:0/451425112 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f232800cdb0 con 0x7f2340115410 2026-02-13T03:34:28.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.211+0000 7f2344b376c0 1 -- 10.20.193.96:0/451425112 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2340164170 con 0x7f2340115410 2026-02-13T03:34:28.214 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.212+0000 7f2344b376c0 1 -- 10.20.193.96:0/451425112 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23401104d0 con 0x7f2340115410 2026-02-13T03:34:28.216 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.213+0000 7f23277fe6c0 1 -- 10.20.193.96:0/451425112 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f23280028c0 con 0x7f2340115410 2026-02-13T03:34:28.216 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.214+0000 7f23277fe6c0 1 --2- 10.20.193.96:0/451425112 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f23180b5690 0x7f23180d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.217 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.214+0000 7f233e5756c0 1 --2- 10.20.193.96:0/451425112 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f23180b5690 0x7f23180d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.217 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.214+0000 7f23277fe6c0 1 -- 10.20.193.96:0/451425112 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f23280e3b50 con 0x7f2340115410 2026-02-13T03:34:28.217 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.214+0000 7f233e5756c0 1 --2- 10.20.193.96:0/451425112 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f23180b5690 0x7f23180d5b40 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23340098c0 tx=0x7f23340091a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:28.217 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.214+0000 7f23277fe6c0 1 -- 10.20.193.96:0/451425112 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f23280a9fd0 con 0x7f2340115410 2026-02-13T03:34:28.235 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:28 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/4017355000' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T03:34:28.235 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:28 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1537763392' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T03:34:28.235 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:28 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3002933231' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T03:34:28.235 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:28 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1964348582' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T03:34:28.235 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:28 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2914173632' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T03:34:28.235 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:28 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3702391580' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T03:34:28.242 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822671 got 154618822671 for osd.6 2026-02-13T03:34:28.242 DEBUG:teuthology.parallel:result is None 2026-02-13T03:34:28.250 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939655 got 270582939655 for osd.11 2026-02-13T03:34:28.250 DEBUG:teuthology.parallel:result is None 2026-02-13T03:34:28.256 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574869 got 55834574869 for osd.2 2026-02-13T03:34:28.256 DEBUG:teuthology.parallel:result is None 2026-02-13T03:34:28.300 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.297+0000 7f793ae7d6c0 1 -- 10.20.193.96:0/3365246735 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f793410f600 con 0x7f793410f230 2026-02-13T03:34:28.300 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.298+0000 7f7929ffb6c0 1 -- 10.20.193.96:0/3365246735 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f79240705e0 con 0x7f793410f230 2026-02-13T03:34:28.300 INFO:teuthology.orchestra.run.trial096.stdout:124554051600 2026-02-13T03:34:28.302 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.299+0000 7f793ae7d6c0 1 -- 10.20.193.96:0/3365246735 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f79100b5690 msgr2=0x7f79100d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.302 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.299+0000 7f793ae7d6c0 1 --2- 10.20.193.96:0/3365246735 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f79100b5690 0x7f79100d5b40 secure :-1 s=READY pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7934123b30 tx=0x7f791c0093f0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.302 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.299+0000 7f793ae7d6c0 1 -- 10.20.193.96:0/3365246735 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f793410f230 msgr2=0x7f793411d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.302 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.299+0000 7f793ae7d6c0 1 --2- 10.20.193.96:0/3365246735 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f793410f230 0x7f793411d1a0 secure :-1 s=READY pgs=314 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7924009490 tx=0x7f792400bca0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.302 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.299+0000 7f793ae7d6c0 1 -- 10.20.193.96:0/3365246735 shutdown_connections 2026-02-13T03:34:28.302 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.299+0000 7f793ae7d6c0 1 --2- 10.20.193.96:0/3365246735 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f79100b5690 0x7f79100d5b40 unknown :-1 s=CLOSED pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.302 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.299+0000 7f793ae7d6c0 1 --2- 10.20.193.96:0/3365246735 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7934122aa0 0x7f7934122f40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.302 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.299+0000 7f793ae7d6c0 1 --2- 10.20.193.96:0/3365246735 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7934115440 0x7f793411d6e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.302 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.299+0000 7f793ae7d6c0 1 --2- 10.20.193.96:0/3365246735 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f793410f230 0x7f793411d1a0 unknown :-1 s=CLOSED pgs=314 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.302 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.299+0000 7f793ae7d6c0 1 -- 10.20.193.96:0/3365246735 >> 10.20.193.96:0/3365246735 conn(0x7f79340ecb30 msgr2=0x7f793410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.302 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.299+0000 7f793ae7d6c0 1 -- 10.20.193.96:0/3365246735 shutdown_connections 2026-02-13T03:34:28.302 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.299+0000 7f793ae7d6c0 1 -- 10.20.193.96:0/3365246735 wait complete. 2026-02-13T03:34:28.309 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.307+0000 7f29659b86c0 1 -- 10.20.193.96:0/3303730510 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f296010fc20 con 0x7f2960115440 2026-02-13T03:34:28.310 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.307+0000 7f29649b26c0 1 -- 10.20.193.96:0/3303730510 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f29480cd830 con 0x7f2960115440 2026-02-13T03:34:28.310 INFO:teuthology.orchestra.run.trial096.stdout:30064771097 2026-02-13T03:34:28.311 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.309+0000 7f29659b86c0 1 -- 10.20.193.96:0/3303730510 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f29340b5690 msgr2=0x7f29340d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.311 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.309+0000 7f29659b86c0 1 --2- 10.20.193.96:0/3303730510 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f29340b5690 0x7f29340d5b40 secure :-1 s=READY pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2954004750 tx=0x7f2954005f10 comp rx=0 tx=0).stop 2026-02-13T03:34:28.312 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.309+0000 7f29659b86c0 1 -- 10.20.193.96:0/3303730510 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2960115440 msgr2=0x7f2960175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.312 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.309+0000 7f29659b86c0 1 --2- 10.20.193.96:0/3303730510 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2960115440 0x7f2960175ce0 secure :-1 s=READY pgs=316 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f294802f230 tx=0x7f294802fc60 comp rx=0 tx=0).stop 2026-02-13T03:34:28.312 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.309+0000 7f29659b86c0 1 -- 10.20.193.96:0/3303730510 shutdown_connections 2026-02-13T03:34:28.312 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.309+0000 7f29659b86c0 1 --2- 10.20.193.96:0/3303730510 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f29340b5690 0x7f29340d5b40 unknown :-1 s=CLOSED pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.312 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.309+0000 7f29659b86c0 1 --2- 10.20.193.96:0/3303730510 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f29600f51d0 0x7f29600fa4a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.312 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.309+0000 7f29659b86c0 1 --2- 10.20.193.96:0/3303730510 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2960115440 0x7f2960175ce0 unknown :-1 s=CLOSED pgs=316 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.312 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.309+0000 7f29659b86c0 1 --2- 10.20.193.96:0/3303730510 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f296010f230 0x7f29600f4ba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.312 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.309+0000 7f29659b86c0 1 -- 10.20.193.96:0/3303730510 >> 10.20.193.96:0/3303730510 conn(0x7f29600ecb30 msgr2=0x7f2960113c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.312 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.309+0000 7f29659b86c0 1 -- 10.20.193.96:0/3303730510 shutdown_connections 2026-02-13T03:34:28.312 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.309+0000 7f29659b86c0 1 -- 10.20.193.96:0/3303730510 wait complete. 2026-02-13T03:34:28.317 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.314+0000 7f2344b376c0 1 -- 10.20.193.96:0/451425112 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f234010f5d0 con 0x7f2340115410 2026-02-13T03:34:28.317 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.314+0000 7f23277fe6c0 1 -- 10.20.193.96:0/451425112 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f23280705a0 con 0x7f2340115410 2026-02-13T03:34:28.317 INFO:teuthology.orchestra.run.trial096.stdout:111669149714 2026-02-13T03:34:28.320 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.316+0000 7f2344b376c0 1 -- 10.20.193.96:0/451425112 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f23180b5690 msgr2=0x7f23180d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.320 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.316+0000 7f2344b376c0 1 --2- 10.20.193.96:0/451425112 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f23180b5690 0x7f23180d5b40 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23340098c0 tx=0x7f23340091a0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.320 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.316+0000 7f2344b376c0 1 -- 10.20.193.96:0/451425112 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2340115410 msgr2=0x7f234011d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.320 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.316+0000 7f2344b376c0 1 --2- 10.20.193.96:0/451425112 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2340115410 0x7f234011d730 secure :-1 s=READY pgs=318 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2328005dc0 tx=0x7f232800bbb0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.320 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.316+0000 7f2344b376c0 1 -- 10.20.193.96:0/451425112 shutdown_connections 2026-02-13T03:34:28.320 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.316+0000 7f2344b376c0 1 --2- 10.20.193.96:0/451425112 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f23180b5690 0x7f23180d5b40 unknown :-1 s=CLOSED pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.320 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.316+0000 7f2344b376c0 1 --2- 10.20.193.96:0/451425112 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2340122af0 0x7f2340122f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.320 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.316+0000 7f2344b376c0 1 --2- 10.20.193.96:0/451425112 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2340115410 0x7f234011d730 unknown :-1 s=CLOSED pgs=318 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.320 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.316+0000 7f2344b376c0 1 --2- 10.20.193.96:0/451425112 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f234010f200 0x7f234011d1f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.321 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.316+0000 7f2344b376c0 1 -- 10.20.193.96:0/451425112 >> 10.20.193.96:0/451425112 conn(0x7f23400ecb00 msgr2=0x7f234010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.321 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.316+0000 7f2344b376c0 1 -- 10.20.193.96:0/451425112 shutdown_connections 2026-02-13T03:34:28.321 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.316+0000 7f2344b376c0 1 -- 10.20.193.96:0/451425112 wait complete. 2026-02-13T03:34:28.345 INFO:tasks.cephadm.ceph_manager.ceph:need seq 124554051600 got 124554051600 for osd.5 2026-02-13T03:34:28.346 DEBUG:teuthology.parallel:result is None 2026-02-13T03:34:28.359 INFO:tasks.cephadm.ceph_manager.ceph:need seq 30064771097 got 30064771097 for osd.0 2026-02-13T03:34:28.359 DEBUG:teuthology.parallel:result is None 2026-02-13T03:34:28.363 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149714 got 111669149714 for osd.4 2026-02-13T03:34:28.363 DEBUG:teuthology.parallel:result is None 2026-02-13T03:34:28.363 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-13T03:34:28.364 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T03:34:28.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:28 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/4017355000' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T03:34:28.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:28 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1537763392' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T03:34:28.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:28 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3002933231' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T03:34:28.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:28 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1964348582' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T03:34:28.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:28 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2914173632' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T03:34:28.483 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:28 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3702391580' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T03:34:28.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:28 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/4017355000' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T03:34:28.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:28 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1537763392' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T03:34:28.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:28 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3002933231' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T03:34:28.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:28 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1964348582' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T03:34:28.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:28 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2914173632' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T03:34:28.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:28 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3702391580' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T03:34:28.517 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:28.644 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.640+0000 7f19fbb1c6c0 1 -- 10.20.193.96:0/2746185938 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f19f410f200 msgr2=0x7f19f410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.640+0000 7f19fbb1c6c0 1 --2- 10.20.193.96:0/2746185938 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f19f410f200 0x7f19f410f5d0 secure :-1 s=READY pgs=319 gs=1 cs=0 l=1 c_cookie=8741622813523814696 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19e40099a0 tx=0x7f19e402ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:28.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.640+0000 7f19fbb1c6c0 1 -- 10.20.193.96:0/2746185938 shutdown_connections 2026-02-13T03:34:28.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.640+0000 7f19fbb1c6c0 1 --2- 10.20.193.96:0/2746185938 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f19f4115410 0x7f19f4175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.640+0000 7f19fbb1c6c0 1 --2- 10.20.193.96:0/2746185938 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f19f410fbf0 0x7f19f4114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.640+0000 7f19fbb1c6c0 1 --2- 10.20.193.96:0/2746185938 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f19f410f200 0x7f19f410f5d0 unknown :-1 s=CLOSED pgs=319 gs=1 cs=0 l=1 c_cookie=8741622813523814696 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.640+0000 7f19fbb1c6c0 1 -- 10.20.193.96:0/2746185938 >> 10.20.193.96:0/2746185938 conn(0x7f19f40ecb00 msgr2=0x7f19f410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.640+0000 7f19fbb1c6c0 1 -- 10.20.193.96:0/2746185938 shutdown_connections 2026-02-13T03:34:28.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.640+0000 7f19fbb1c6c0 1 -- 10.20.193.96:0/2746185938 wait complete. 2026-02-13T03:34:28.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.640+0000 7f19fbb1c6c0 1 Processor -- start 2026-02-13T03:34:28.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.640+0000 7f19fbb1c6c0 1 -- start start 2026-02-13T03:34:28.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.640+0000 7f19fbb1c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f19f410f200 0x7f19f411d190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.640+0000 7f19fbb1c6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f19f4115410 0x7f19f411d6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.640+0000 7f19fbb1c6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f19f4122a90 0x7f19f4122f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.640+0000 7f19fbb1c6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f19f41234a0 con 0x7f19f410f200 2026-02-13T03:34:28.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.640+0000 7f19fbb1c6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f19f4123610 con 0x7f19f4122a90 2026-02-13T03:34:28.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.640+0000 7f19fbb1c6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f19f41237d0 con 0x7f19f4115410 2026-02-13T03:34:28.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.640+0000 7f19f98916c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f19f410f200 0x7f19f411d190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.640+0000 7f19f98916c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f19f410f200 0x7f19f411d190 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49558/0 (socket says 10.20.193.96:49558) 2026-02-13T03:34:28.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.640+0000 7f19f98916c0 1 -- 10.20.193.96:0/2626680837 learned_addr learned my addr 10.20.193.96:0/2626680837 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:28.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.640+0000 7f19f90906c0 1 --2- 10.20.193.96:0/2626680837 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f19f4115410 0x7f19f411d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.641+0000 7f19fa0926c0 1 --2- 10.20.193.96:0/2626680837 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f19f4122a90 0x7f19f4122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.641+0000 7f19f98916c0 1 -- 10.20.193.96:0/2626680837 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f19f4115410 msgr2=0x7f19f411d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.641+0000 7f19f98916c0 1 --2- 10.20.193.96:0/2626680837 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f19f4115410 0x7f19f411d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.641+0000 7f19f98916c0 1 -- 10.20.193.96:0/2626680837 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f19f4122a90 msgr2=0x7f19f4122f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.641+0000 7f19f98916c0 1 --2- 10.20.193.96:0/2626680837 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f19f4122a90 0x7f19f4122f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.641+0000 7f19f98916c0 1 -- 10.20.193.96:0/2626680837 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e4009590 con 0x7f19f410f200 2026-02-13T03:34:28.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.641+0000 7f19f98916c0 1 --2- 10.20.193.96:0/2626680837 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f19f410f200 0x7f19f411d190 secure :-1 s=READY pgs=320 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19e40098c0 tx=0x7f19e40047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:28.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.641+0000 7f19e2ffd6c0 1 -- 10.20.193.96:0/2626680837 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19e4002ae0 con 0x7f19f410f200 2026-02-13T03:34:28.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.641+0000 7f19e2ffd6c0 1 -- 10.20.193.96:0/2626680837 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f19e4002c40 con 0x7f19f410f200 2026-02-13T03:34:28.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.641+0000 7f19fbb1c6c0 1 -- 10.20.193.96:0/2626680837 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f4163c20 con 0x7f19f410f200 2026-02-13T03:34:28.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.641+0000 7f19e2ffd6c0 1 -- 10.20.193.96:0/2626680837 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19e40372f0 con 0x7f19f410f200 2026-02-13T03:34:28.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.641+0000 7f19fbb1c6c0 1 -- 10.20.193.96:0/2626680837 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f41640a0 con 0x7f19f410f200 2026-02-13T03:34:28.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.641+0000 7f19fbb1c6c0 1 -- 10.20.193.96:0/2626680837 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19f41104d0 con 0x7f19f410f200 2026-02-13T03:34:28.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.643+0000 7f19e2ffd6c0 1 -- 10.20.193.96:0/2626680837 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f19e4007960 con 0x7f19f410f200 2026-02-13T03:34:28.649 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.644+0000 7f19e2ffd6c0 1 --2- 10.20.193.96:0/2626680837 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f19d00b5710 0x7f19d00d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:28.649 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.644+0000 7f19f90906c0 1 --2- 10.20.193.96:0/2626680837 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f19d00b5710 0x7f19d00d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:28.649 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.644+0000 7f19e2ffd6c0 1 -- 10.20.193.96:0/2626680837 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f19e4107d70 con 0x7f19f410f200 2026-02-13T03:34:28.649 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.644+0000 7f19f90906c0 1 --2- 10.20.193.96:0/2626680837 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f19d00b5710 0x7f19d00d5bc0 secure :-1 s=READY pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19e8005980 tx=0x7f19e8005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:28.649 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.644+0000 7f19e2ffd6c0 1 -- 10.20.193.96:0/2626680837 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f19e40cd940 con 0x7f19f410f200 2026-02-13T03:34:28.735 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.733+0000 7f19fbb1c6c0 1 -- 10.20.193.96:0/2626680837 --> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f19f411e370 con 0x7f19d00b5710 2026-02-13T03:34:28.738 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.735+0000 7f19e2ffd6c0 1 -- 10.20.193.96:0/2626680837 <== mgr.14116 v2:10.20.193.96:6800/1736050816 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258970 (secure 0 0 0) 0x7f19e800b7d0 con 0x7f19d00b5710 2026-02-13T03:34:28.741 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:28.743 INFO:teuthology.orchestra.run.trial096.stderr:dumped all 2026-02-13T03:34:28.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.736+0000 7f19fbb1c6c0 1 -- 10.20.193.96:0/2626680837 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f19d00b5710 msgr2=0x7f19d00d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.736+0000 7f19fbb1c6c0 1 --2- 10.20.193.96:0/2626680837 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f19d00b5710 0x7f19d00d5bc0 secure :-1 s=READY pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19e8005980 tx=0x7f19e8005910 comp rx=0 tx=0).stop 2026-02-13T03:34:28.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.736+0000 7f19fbb1c6c0 1 -- 10.20.193.96:0/2626680837 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f19f410f200 msgr2=0x7f19f411d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:28.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.736+0000 7f19fbb1c6c0 1 --2- 10.20.193.96:0/2626680837 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f19f410f200 0x7f19f411d190 secure :-1 s=READY pgs=320 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19e40098c0 tx=0x7f19e40047f0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.736+0000 7f19fbb1c6c0 1 -- 10.20.193.96:0/2626680837 shutdown_connections 2026-02-13T03:34:28.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.736+0000 7f19fbb1c6c0 1 --2- 10.20.193.96:0/2626680837 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f19d00b5710 0x7f19d00d5bc0 unknown :-1 s=CLOSED pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.736+0000 7f19fbb1c6c0 1 --2- 10.20.193.96:0/2626680837 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f19f4122a90 0x7f19f4122f30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.736+0000 7f19fbb1c6c0 1 --2- 10.20.193.96:0/2626680837 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f19f4115410 0x7f19f411d6d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.736+0000 7f19fbb1c6c0 1 --2- 10.20.193.96:0/2626680837 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f19f410f200 0x7f19f411d190 unknown :-1 s=CLOSED pgs=320 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:28.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.736+0000 7f19fbb1c6c0 1 -- 10.20.193.96:0/2626680837 >> 10.20.193.96:0/2626680837 conn(0x7f19f40ecb00 msgr2=0x7f19f410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:28.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.736+0000 7f19fbb1c6c0 1 -- 10.20.193.96:0/2626680837 shutdown_connections 2026-02-13T03:34:28.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:28.736+0000 7f19fbb1c6c0 1 -- 10.20.193.96:0/2626680837 wait complete. 2026-02-13T03:34:28.778 INFO:teuthology.orchestra.run.trial096.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2026-02-13T03:34:28.580047+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647532,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":172,"num_read_kb":185,"num_write":337,"num_write_kb":3822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":281,"ondisk_log_size":281,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":332664,"kb_used_data":9096,"kb_used_omap":383,"kb_used_meta":322944,"kb_avail":8807705736,"statfs":{"total":9019431321600,"available":9019090673664,"internally_reserved":0,"allocated":9314304,"data_stored":6186396,"data_compressed":114354,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":392886,"internal_metadata":330694986},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":57130,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":66,"num_read_kb":94,"num_write":142,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002557"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.949202+0000","last_change":"2026-02-13T03:34:15.119248+0000","last_active":"2026-02-13T03:34:16.949202+0000","last_peered":"2026-02-13T03:34:16.949202+0000","last_clean":"2026-02-13T03:34:16.949202+0000","last_became_active":"2026-02-13T03:34:15.118886+0000","last_became_peered":"2026-02-13T03:34:15.118886+0000","last_unstale":"2026-02-13T03:34:16.949202+0000","last_undegraded":"2026-02-13T03:34:16.949202+0000","last_fullsized":"2026-02-13T03:34:16.949202+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:56:49.614786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910225+0000","last_change":"2026-02-13T03:34:15.118140+0000","last_active":"2026-02-13T03:34:16.910225+0000","last_peered":"2026-02-13T03:34:16.910225+0000","last_clean":"2026-02-13T03:34:16.910225+0000","last_became_active":"2026-02-13T03:34:15.117796+0000","last_became_peered":"2026-02-13T03:34:15.117796+0000","last_unstale":"2026-02-13T03:34:16.910225+0000","last_undegraded":"2026-02-13T03:34:16.910225+0000","last_fullsized":"2026-02-13T03:34:16.910225+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:08:34.780460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910178+0000","last_change":"2026-02-13T03:34:15.116927+0000","last_active":"2026-02-13T03:34:16.910178+0000","last_peered":"2026-02-13T03:34:16.910178+0000","last_clean":"2026-02-13T03:34:16.910178+0000","last_became_active":"2026-02-13T03:34:15.116646+0000","last_became_peered":"2026-02-13T03:34:15.116646+0000","last_unstale":"2026-02-13T03:34:16.910178+0000","last_undegraded":"2026-02-13T03:34:16.910178+0000","last_fullsized":"2026-02-13T03:34:16.910178+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:24:45.374886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.122075+0000","last_change":"2026-02-13T03:34:15.127414+0000","last_active":"2026-02-13T03:34:16.122075+0000","last_peered":"2026-02-13T03:34:16.122075+0000","last_clean":"2026-02-13T03:34:16.122075+0000","last_became_active":"2026-02-13T03:34:15.127284+0000","last_became_peered":"2026-02-13T03:34:15.127284+0000","last_unstale":"2026-02-13T03:34:16.122075+0000","last_undegraded":"2026-02-13T03:34:16.122075+0000","last_fullsized":"2026-02-13T03:34:16.122075+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:10:58.233447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909667+0000","last_change":"2026-02-13T03:34:15.117815+0000","last_active":"2026-02-13T03:34:16.909667+0000","last_peered":"2026-02-13T03:34:16.909667+0000","last_clean":"2026-02-13T03:34:16.909667+0000","last_became_active":"2026-02-13T03:34:15.117642+0000","last_became_peered":"2026-02-13T03:34:15.117642+0000","last_unstale":"2026-02-13T03:34:16.909667+0000","last_undegraded":"2026-02-13T03:34:16.909667+0000","last_fullsized":"2026-02-13T03:34:16.909667+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:06:59.379987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.912593+0000","last_change":"2026-02-13T03:34:15.127838+0000","last_active":"2026-02-13T03:34:16.912593+0000","last_peered":"2026-02-13T03:34:16.912593+0000","last_clean":"2026-02-13T03:34:16.912593+0000","last_became_active":"2026-02-13T03:34:15.127492+0000","last_became_peered":"2026-02-13T03:34:15.127492+0000","last_unstale":"2026-02-13T03:34:16.912593+0000","last_undegraded":"2026-02-13T03:34:16.912593+0000","last_fullsized":"2026-02-13T03:34:16.912593+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:10:44.948452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.177724+0000","last_change":"2026-02-13T03:34:15.128751+0000","last_active":"2026-02-13T03:34:16.177724+0000","last_peered":"2026-02-13T03:34:16.177724+0000","last_clean":"2026-02-13T03:34:16.177724+0000","last_became_active":"2026-02-13T03:34:15.128588+0000","last_became_peered":"2026-02-13T03:34:15.128588+0000","last_unstale":"2026-02-13T03:34:16.177724+0000","last_undegraded":"2026-02-13T03:34:16.177724+0000","last_fullsized":"2026-02-13T03:34:16.177724+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:46:50.929612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.790967+0000","last_change":"2026-02-13T03:34:15.119765+0000","last_active":"2026-02-13T03:34:16.790967+0000","last_peered":"2026-02-13T03:34:16.790967+0000","last_clean":"2026-02-13T03:34:16.790967+0000","last_became_active":"2026-02-13T03:34:15.118656+0000","last_became_peered":"2026-02-13T03:34:15.118656+0000","last_unstale":"2026-02-13T03:34:16.790967+0000","last_undegraded":"2026-02-13T03:34:16.790967+0000","last_fullsized":"2026-02-13T03:34:16.790967+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:32:01.369279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.921188+0000","last_change":"2026-02-13T03:34:15.129750+0000","last_active":"2026-02-13T03:34:16.921188+0000","last_peered":"2026-02-13T03:34:16.921188+0000","last_clean":"2026-02-13T03:34:16.921188+0000","last_became_active":"2026-02-13T03:34:15.129277+0000","last_became_peered":"2026-02-13T03:34:15.129277+0000","last_unstale":"2026-02-13T03:34:16.921188+0000","last_undegraded":"2026-02-13T03:34:16.921188+0000","last_fullsized":"2026-02-13T03:34:16.921188+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:54:36.873732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.912899+0000","last_change":"2026-02-13T03:34:15.127742+0000","last_active":"2026-02-13T03:34:16.912899+0000","last_peered":"2026-02-13T03:34:16.912899+0000","last_clean":"2026-02-13T03:34:16.912899+0000","last_became_active":"2026-02-13T03:34:15.127189+0000","last_became_peered":"2026-02-13T03:34:15.127189+0000","last_unstale":"2026-02-13T03:34:16.912899+0000","last_undegraded":"2026-02-13T03:34:16.912899+0000","last_fullsized":"2026-02-13T03:34:16.912899+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:55:52.004058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.178276+0000","last_change":"2026-02-13T03:34:15.127809+0000","last_active":"2026-02-13T03:34:16.178276+0000","last_peered":"2026-02-13T03:34:16.178276+0000","last_clean":"2026-02-13T03:34:16.178276+0000","last_became_active":"2026-02-13T03:34:15.127680+0000","last_became_peered":"2026-02-13T03:34:15.127680+0000","last_unstale":"2026-02-13T03:34:16.178276+0000","last_undegraded":"2026-02-13T03:34:16.178276+0000","last_fullsized":"2026-02-13T03:34:16.178276+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:22:18.420199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.122122+0000","last_change":"2026-02-13T03:34:15.127680+0000","last_active":"2026-02-13T03:34:16.122122+0000","last_peered":"2026-02-13T03:34:16.122122+0000","last_clean":"2026-02-13T03:34:16.122122+0000","last_became_active":"2026-02-13T03:34:15.127508+0000","last_became_peered":"2026-02-13T03:34:15.127508+0000","last_unstale":"2026-02-13T03:34:16.122122+0000","last_undegraded":"2026-02-13T03:34:16.122122+0000","last_fullsized":"2026-02-13T03:34:16.122122+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:22:12.516766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111152+0000","last_change":"2026-02-13T03:34:15.117625+0000","last_active":"2026-02-13T03:34:16.111152+0000","last_peered":"2026-02-13T03:34:16.111152+0000","last_clean":"2026-02-13T03:34:16.111152+0000","last_became_active":"2026-02-13T03:34:15.117420+0000","last_became_peered":"2026-02-13T03:34:15.117420+0000","last_unstale":"2026-02-13T03:34:16.111152+0000","last_undegraded":"2026-02-13T03:34:16.111152+0000","last_fullsized":"2026-02-13T03:34:16.111152+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:53:17.688410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910011+0000","last_change":"2026-02-13T03:34:15.117960+0000","last_active":"2026-02-13T03:34:16.910011+0000","last_peered":"2026-02-13T03:34:16.910011+0000","last_clean":"2026-02-13T03:34:16.910011+0000","last_became_active":"2026-02-13T03:34:15.117819+0000","last_became_peered":"2026-02-13T03:34:15.117819+0000","last_unstale":"2026-02-13T03:34:16.910011+0000","last_undegraded":"2026-02-13T03:34:16.910011+0000","last_fullsized":"2026-02-13T03:34:16.910011+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:53:45.980536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909998+0000","last_change":"2026-02-13T03:34:15.113255+0000","last_active":"2026-02-13T03:34:16.909998+0000","last_peered":"2026-02-13T03:34:16.909998+0000","last_clean":"2026-02-13T03:34:16.909998+0000","last_became_active":"2026-02-13T03:34:15.112672+0000","last_became_peered":"2026-02-13T03:34:15.112672+0000","last_unstale":"2026-02-13T03:34:16.909998+0000","last_undegraded":"2026-02-13T03:34:16.909998+0000","last_fullsized":"2026-02-13T03:34:16.909998+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:28:34.724819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.920815+0000","last_change":"2026-02-13T03:34:15.127054+0000","last_active":"2026-02-13T03:34:16.920815+0000","last_peered":"2026-02-13T03:34:16.920815+0000","last_clean":"2026-02-13T03:34:16.920815+0000","last_became_active":"2026-02-13T03:34:15.126826+0000","last_became_peered":"2026-02-13T03:34:15.126826+0000","last_unstale":"2026-02-13T03:34:16.920815+0000","last_undegraded":"2026-02-13T03:34:16.920815+0000","last_fullsized":"2026-02-13T03:34:16.920815+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:07:27.160289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.949262+0000","last_change":"2026-02-13T03:34:15.119834+0000","last_active":"2026-02-13T03:34:16.949262+0000","last_peered":"2026-02-13T03:34:16.949262+0000","last_clean":"2026-02-13T03:34:16.949262+0000","last_became_active":"2026-02-13T03:34:15.119509+0000","last_became_peered":"2026-02-13T03:34:15.119509+0000","last_unstale":"2026-02-13T03:34:16.949262+0000","last_undegraded":"2026-02-13T03:34:16.949262+0000","last_fullsized":"2026-02-13T03:34:16.949262+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:42:38.192170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111254+0000","last_change":"2026-02-13T03:34:15.118027+0000","last_active":"2026-02-13T03:34:16.111254+0000","last_peered":"2026-02-13T03:34:16.111254+0000","last_clean":"2026-02-13T03:34:16.111254+0000","last_became_active":"2026-02-13T03:34:15.117809+0000","last_became_peered":"2026-02-13T03:34:15.117809+0000","last_unstale":"2026-02-13T03:34:16.111254+0000","last_undegraded":"2026-02-13T03:34:16.111254+0000","last_fullsized":"2026-02-13T03:34:16.111254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:45:41.985508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910174+0000","last_change":"2026-02-13T03:34:15.117192+0000","last_active":"2026-02-13T03:34:16.910174+0000","last_peered":"2026-02-13T03:34:16.910174+0000","last_clean":"2026-02-13T03:34:16.910174+0000","last_became_active":"2026-02-13T03:34:15.116925+0000","last_became_peered":"2026-02-13T03:34:15.116925+0000","last_unstale":"2026-02-13T03:34:16.910174+0000","last_undegraded":"2026-02-13T03:34:16.910174+0000","last_fullsized":"2026-02-13T03:34:16.910174+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:02:01.642379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.948882+0000","last_change":"2026-02-13T03:34:15.118668+0000","last_active":"2026-02-13T03:34:16.948882+0000","last_peered":"2026-02-13T03:34:16.948882+0000","last_clean":"2026-02-13T03:34:16.948882+0000","last_became_active":"2026-02-13T03:34:15.118217+0000","last_became_peered":"2026-02-13T03:34:15.118217+0000","last_unstale":"2026-02-13T03:34:16.948882+0000","last_undegraded":"2026-02-13T03:34:16.948882+0000","last_fullsized":"2026-02-13T03:34:16.948882+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:19:35.001241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111259+0000","last_change":"2026-02-13T03:34:15.116906+0000","last_active":"2026-02-13T03:34:16.111259+0000","last_peered":"2026-02-13T03:34:16.111259+0000","last_clean":"2026-02-13T03:34:16.111259+0000","last_became_active":"2026-02-13T03:34:15.116699+0000","last_became_peered":"2026-02-13T03:34:15.116699+0000","last_unstale":"2026-02-13T03:34:16.111259+0000","last_undegraded":"2026-02-13T03:34:16.111259+0000","last_fullsized":"2026-02-13T03:34:16.111259+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:47:23.331768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.920953+0000","last_change":"2026-02-13T03:34:15.127773+0000","last_active":"2026-02-13T03:34:16.920953+0000","last_peered":"2026-02-13T03:34:16.920953+0000","last_clean":"2026-02-13T03:34:16.920953+0000","last_became_active":"2026-02-13T03:34:15.127473+0000","last_became_peered":"2026-02-13T03:34:15.127473+0000","last_unstale":"2026-02-13T03:34:16.920953+0000","last_undegraded":"2026-02-13T03:34:16.920953+0000","last_fullsized":"2026-02-13T03:34:16.920953+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:27:08.244945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.790949+0000","last_change":"2026-02-13T03:34:15.118782+0000","last_active":"2026-02-13T03:34:16.790949+0000","last_peered":"2026-02-13T03:34:16.790949+0000","last_clean":"2026-02-13T03:34:16.790949+0000","last_became_active":"2026-02-13T03:34:15.117896+0000","last_became_peered":"2026-02-13T03:34:15.117896+0000","last_unstale":"2026-02-13T03:34:16.790949+0000","last_undegraded":"2026-02-13T03:34:16.790949+0000","last_fullsized":"2026-02-13T03:34:16.790949+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:21:00.365223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110942+0000","last_change":"2026-02-13T03:34:15.117507+0000","last_active":"2026-02-13T03:34:16.110942+0000","last_peered":"2026-02-13T03:34:16.110942+0000","last_clean":"2026-02-13T03:34:16.110942+0000","last_became_active":"2026-02-13T03:34:15.117084+0000","last_became_peered":"2026-02-13T03:34:15.117084+0000","last_unstale":"2026-02-13T03:34:16.110942+0000","last_undegraded":"2026-02-13T03:34:16.110942+0000","last_fullsized":"2026-02-13T03:34:16.110942+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:08:11.739974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791306+0000","last_change":"2026-02-13T03:34:15.120007+0000","last_active":"2026-02-13T03:34:16.791306+0000","last_peered":"2026-02-13T03:34:16.791306+0000","last_clean":"2026-02-13T03:34:16.791306+0000","last_became_active":"2026-02-13T03:34:15.119271+0000","last_became_peered":"2026-02-13T03:34:15.119271+0000","last_unstale":"2026-02-13T03:34:16.791306+0000","last_undegraded":"2026-02-13T03:34:16.791306+0000","last_fullsized":"2026-02-13T03:34:16.791306+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:40:54.160572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910319+0000","last_change":"2026-02-13T03:34:15.115991+0000","last_active":"2026-02-13T03:34:16.910319+0000","last_peered":"2026-02-13T03:34:16.910319+0000","last_clean":"2026-02-13T03:34:16.910319+0000","last_became_active":"2026-02-13T03:34:15.115795+0000","last_became_peered":"2026-02-13T03:34:15.115795+0000","last_unstale":"2026-02-13T03:34:16.910319+0000","last_undegraded":"2026-02-13T03:34:16.910319+0000","last_fullsized":"2026-02-13T03:34:16.910319+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:08:10.245339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.949096+0000","last_change":"2026-02-13T03:34:15.117921+0000","last_active":"2026-02-13T03:34:16.949096+0000","last_peered":"2026-02-13T03:34:16.949096+0000","last_clean":"2026-02-13T03:34:16.949096+0000","last_became_active":"2026-02-13T03:34:15.117628+0000","last_became_peered":"2026-02-13T03:34:15.117628+0000","last_unstale":"2026-02-13T03:34:16.949096+0000","last_undegraded":"2026-02-13T03:34:16.949096+0000","last_fullsized":"2026-02-13T03:34:16.949096+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:48:11.389400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111141+0000","last_change":"2026-02-13T03:34:15.115046+0000","last_active":"2026-02-13T03:34:16.111141+0000","last_peered":"2026-02-13T03:34:16.111141+0000","last_clean":"2026-02-13T03:34:16.111141+0000","last_became_active":"2026-02-13T03:34:15.114250+0000","last_became_peered":"2026-02-13T03:34:15.114250+0000","last_unstale":"2026-02-13T03:34:16.111141+0000","last_undegraded":"2026-02-13T03:34:16.111141+0000","last_fullsized":"2026-02-13T03:34:16.111141+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:58:56.156972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910188+0000","last_change":"2026-02-13T03:34:15.114493+0000","last_active":"2026-02-13T03:34:16.910188+0000","last_peered":"2026-02-13T03:34:16.910188+0000","last_clean":"2026-02-13T03:34:16.910188+0000","last_became_active":"2026-02-13T03:34:15.114096+0000","last_became_peered":"2026-02-13T03:34:15.114096+0000","last_unstale":"2026-02-13T03:34:16.910188+0000","last_undegraded":"2026-02-13T03:34:16.910188+0000","last_fullsized":"2026-02-13T03:34:16.910188+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:26:07.768976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909836+0000","last_change":"2026-02-13T03:34:15.116564+0000","last_active":"2026-02-13T03:34:16.909836+0000","last_peered":"2026-02-13T03:34:16.909836+0000","last_clean":"2026-02-13T03:34:16.909836+0000","last_became_active":"2026-02-13T03:34:15.116345+0000","last_became_peered":"2026-02-13T03:34:15.116345+0000","last_unstale":"2026-02-13T03:34:16.909836+0000","last_undegraded":"2026-02-13T03:34:16.909836+0000","last_fullsized":"2026-02-13T03:34:16.909836+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:52:47.350389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909938+0000","last_change":"2026-02-13T03:34:15.117449+0000","last_active":"2026-02-13T03:34:16.909938+0000","last_peered":"2026-02-13T03:34:16.909938+0000","last_clean":"2026-02-13T03:34:16.909938+0000","last_became_active":"2026-02-13T03:34:15.117220+0000","last_became_peered":"2026-02-13T03:34:15.117220+0000","last_unstale":"2026-02-13T03:34:16.909938+0000","last_undegraded":"2026-02-13T03:34:16.909938+0000","last_fullsized":"2026-02-13T03:34:16.909938+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:38:43.911384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.948915+0000","last_change":"2026-02-13T03:34:15.118184+0000","last_active":"2026-02-13T03:34:16.948915+0000","last_peered":"2026-02-13T03:34:16.948915+0000","last_clean":"2026-02-13T03:34:16.948915+0000","last_became_active":"2026-02-13T03:34:15.117890+0000","last_became_peered":"2026-02-13T03:34:15.117890+0000","last_unstale":"2026-02-13T03:34:16.948915+0000","last_undegraded":"2026-02-13T03:34:16.948915+0000","last_fullsized":"2026-02-13T03:34:16.948915+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:22:03.620680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909815+0000","last_change":"2026-02-13T03:34:15.116404+0000","last_active":"2026-02-13T03:34:16.909815+0000","last_peered":"2026-02-13T03:34:16.909815+0000","last_clean":"2026-02-13T03:34:16.909815+0000","last_became_active":"2026-02-13T03:34:15.116094+0000","last_became_peered":"2026-02-13T03:34:15.116094+0000","last_unstale":"2026-02-13T03:34:16.909815+0000","last_undegraded":"2026-02-13T03:34:16.909815+0000","last_fullsized":"2026-02-13T03:34:16.909815+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:58:39.719264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"68'6","reported_seq":32,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:25.142155+0000","last_change":"2026-02-13T03:34:14.110943+0000","last_active":"2026-02-13T03:34:25.142155+0000","last_peered":"2026-02-13T03:34:25.142155+0000","last_clean":"2026-02-13T03:34:25.142155+0000","last_became_active":"2026-02-13T03:34:14.110502+0000","last_became_peered":"2026-02-13T03:34:14.110502+0000","last_unstale":"2026-02-13T03:34:25.142155+0000","last_undegraded":"2026-02-13T03:34:25.142155+0000","last_fullsized":"2026-02-13T03:34:25.142155+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:59:08.057823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110955+0000","last_change":"2026-02-13T03:34:15.118165+0000","last_active":"2026-02-13T03:34:16.110955+0000","last_peered":"2026-02-13T03:34:16.110955+0000","last_clean":"2026-02-13T03:34:16.110955+0000","last_became_active":"2026-02-13T03:34:15.117801+0000","last_became_peered":"2026-02-13T03:34:15.117801+0000","last_unstale":"2026-02-13T03:34:16.110955+0000","last_undegraded":"2026-02-13T03:34:16.110955+0000","last_fullsized":"2026-02-13T03:34:16.110955+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:01:06.764674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"68'3","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.147034+0000","last_change":"2026-02-13T03:34:14.119861+0000","last_active":"2026-02-13T03:34:19.147034+0000","last_peered":"2026-02-13T03:34:19.147034+0000","last_clean":"2026-02-13T03:34:19.147034+0000","last_became_active":"2026-02-13T03:34:14.119689+0000","last_became_peered":"2026-02-13T03:34:14.119689+0000","last_unstale":"2026-02-13T03:34:19.147034+0000","last_undegraded":"2026-02-13T03:34:19.147034+0000","last_fullsized":"2026-02-13T03:34:19.147034+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:43:33.601163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"68'2","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.136796+0000","last_change":"2026-02-13T03:34:14.107989+0000","last_active":"2026-02-13T03:34:19.136796+0000","last_peered":"2026-02-13T03:34:19.136796+0000","last_clean":"2026-02-13T03:34:19.136796+0000","last_became_active":"2026-02-13T03:34:14.107837+0000","last_became_peered":"2026-02-13T03:34:14.107837+0000","last_unstale":"2026-02-13T03:34:19.136796+0000","last_undegraded":"2026-02-13T03:34:19.136796+0000","last_fullsized":"2026-02-13T03:34:19.136796+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:20:23.452500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791223+0000","last_change":"2026-02-13T03:34:15.118354+0000","last_active":"2026-02-13T03:34:16.791223+0000","last_peered":"2026-02-13T03:34:16.791223+0000","last_clean":"2026-02-13T03:34:16.791223+0000","last_became_active":"2026-02-13T03:34:15.117486+0000","last_became_peered":"2026-02-13T03:34:15.117486+0000","last_unstale":"2026-02-13T03:34:16.791223+0000","last_undegraded":"2026-02-13T03:34:16.791223+0000","last_fullsized":"2026-02-13T03:34:16.791223+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:19:01.304754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"68'1","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.962330+0000","last_change":"2026-02-13T03:34:14.111386+0000","last_active":"2026-02-13T03:34:16.962330+0000","last_peered":"2026-02-13T03:34:16.962330+0000","last_clean":"2026-02-13T03:34:16.962330+0000","last_became_active":"2026-02-13T03:34:14.110945+0000","last_became_peered":"2026-02-13T03:34:14.110945+0000","last_unstale":"2026-02-13T03:34:16.962330+0000","last_undegraded":"2026-02-13T03:34:16.962330+0000","last_fullsized":"2026-02-13T03:34:16.962330+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:44:31.307711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111198+0000","last_change":"2026-02-13T03:34:15.117944+0000","last_active":"2026-02-13T03:34:16.111198+0000","last_peered":"2026-02-13T03:34:16.111198+0000","last_clean":"2026-02-13T03:34:16.111198+0000","last_became_active":"2026-02-13T03:34:15.117759+0000","last_became_peered":"2026-02-13T03:34:15.117759+0000","last_unstale":"2026-02-13T03:34:16.111198+0000","last_undegraded":"2026-02-13T03:34:16.111198+0000","last_fullsized":"2026-02-13T03:34:16.111198+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:31:00.846376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"68'3","reported_seq":26,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:25.152944+0000","last_change":"2026-02-13T03:34:14.122123+0000","last_active":"2026-02-13T03:34:25.152944+0000","last_peered":"2026-02-13T03:34:25.152944+0000","last_clean":"2026-02-13T03:34:25.152944+0000","last_became_active":"2026-02-13T03:34:14.122016+0000","last_became_peered":"2026-02-13T03:34:14.122016+0000","last_unstale":"2026-02-13T03:34:25.152944+0000","last_undegraded":"2026-02-13T03:34:25.152944+0000","last_fullsized":"2026-02-13T03:34:25.152944+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:38:07.386544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.921138+0000","last_change":"2026-02-13T03:34:15.129944+0000","last_active":"2026-02-13T03:34:16.921138+0000","last_peered":"2026-02-13T03:34:16.921138+0000","last_clean":"2026-02-13T03:34:16.921138+0000","last_became_active":"2026-02-13T03:34:15.129500+0000","last_became_peered":"2026-02-13T03:34:15.129500+0000","last_unstale":"2026-02-13T03:34:16.921138+0000","last_undegraded":"2026-02-13T03:34:16.921138+0000","last_fullsized":"2026-02-13T03:34:16.921138+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:04:46.496972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"68'2","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.142125+0000","last_change":"2026-02-13T03:34:14.120290+0000","last_active":"2026-02-13T03:34:18.142125+0000","last_peered":"2026-02-13T03:34:18.142125+0000","last_clean":"2026-02-13T03:34:18.142125+0000","last_became_active":"2026-02-13T03:34:14.120111+0000","last_became_peered":"2026-02-13T03:34:14.120111+0000","last_unstale":"2026-02-13T03:34:18.142125+0000","last_undegraded":"2026-02-13T03:34:18.142125+0000","last_fullsized":"2026-02-13T03:34:18.142125+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:02:12.116257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910374+0000","last_change":"2026-02-13T03:34:15.118561+0000","last_active":"2026-02-13T03:34:16.910374+0000","last_peered":"2026-02-13T03:34:16.910374+0000","last_clean":"2026-02-13T03:34:16.910374+0000","last_became_active":"2026-02-13T03:34:15.118392+0000","last_became_peered":"2026-02-13T03:34:15.118392+0000","last_unstale":"2026-02-13T03:34:16.910374+0000","last_undegraded":"2026-02-13T03:34:16.910374+0000","last_fullsized":"2026-02-13T03:34:16.910374+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:27:31.164818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"68'4","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.131542+0000","last_change":"2026-02-13T03:34:14.111107+0000","last_active":"2026-02-13T03:34:18.131542+0000","last_peered":"2026-02-13T03:34:18.131542+0000","last_clean":"2026-02-13T03:34:18.131542+0000","last_became_active":"2026-02-13T03:34:14.110113+0000","last_became_peered":"2026-02-13T03:34:14.110113+0000","last_unstale":"2026-02-13T03:34:18.131542+0000","last_undegraded":"2026-02-13T03:34:18.131542+0000","last_fullsized":"2026-02-13T03:34:18.131542+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:34:31.930234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.920945+0000","last_change":"2026-02-13T03:34:15.127705+0000","last_active":"2026-02-13T03:34:16.920945+0000","last_peered":"2026-02-13T03:34:16.920945+0000","last_clean":"2026-02-13T03:34:16.920945+0000","last_became_active":"2026-02-13T03:34:15.127292+0000","last_became_peered":"2026-02-13T03:34:15.127292+0000","last_unstale":"2026-02-13T03:34:16.920945+0000","last_undegraded":"2026-02-13T03:34:16.920945+0000","last_fullsized":"2026-02-13T03:34:16.920945+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:08:59.692931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"68'22","reported_seq":57,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:26.155669+0000","last_change":"2026-02-13T03:34:14.121451+0000","last_active":"2026-02-13T03:34:26.155669+0000","last_peered":"2026-02-13T03:34:26.155669+0000","last_clean":"2026-02-13T03:34:26.155669+0000","last_became_active":"2026-02-13T03:34:14.121350+0000","last_became_peered":"2026-02-13T03:34:14.121350+0000","last_unstale":"2026-02-13T03:34:26.155669+0000","last_undegraded":"2026-02-13T03:34:26.155669+0000","last_fullsized":"2026-02-13T03:34:26.155669+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:36:35.041824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52844,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":61,"num_write":23,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909996+0000","last_change":"2026-02-13T03:34:15.116911+0000","last_active":"2026-02-13T03:34:16.909996+0000","last_peered":"2026-02-13T03:34:16.909996+0000","last_clean":"2026-02-13T03:34:16.909996+0000","last_became_active":"2026-02-13T03:34:15.116542+0000","last_became_peered":"2026-02-13T03:34:15.116542+0000","last_unstale":"2026-02-13T03:34:16.909996+0000","last_undegraded":"2026-02-13T03:34:16.909996+0000","last_fullsized":"2026-02-13T03:34:16.909996+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:51:00.767989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"68'6","reported_seq":23,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.135867+0000","last_change":"2026-02-13T03:34:14.110089+0000","last_active":"2026-02-13T03:34:19.135867+0000","last_peered":"2026-02-13T03:34:19.135867+0000","last_clean":"2026-02-13T03:34:19.135867+0000","last_became_active":"2026-02-13T03:34:14.109857+0000","last_became_peered":"2026-02-13T03:34:14.109857+0000","last_unstale":"2026-02-13T03:34:19.135867+0000","last_undegraded":"2026-02-13T03:34:19.135867+0000","last_fullsized":"2026-02-13T03:34:19.135867+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:28:26.120434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110999+0000","last_change":"2026-02-13T03:34:15.117207+0000","last_active":"2026-02-13T03:34:16.110999+0000","last_peered":"2026-02-13T03:34:16.110999+0000","last_clean":"2026-02-13T03:34:16.110999+0000","last_became_active":"2026-02-13T03:34:15.117080+0000","last_became_peered":"2026-02-13T03:34:15.117080+0000","last_unstale":"2026-02-13T03:34:16.110999+0000","last_undegraded":"2026-02-13T03:34:16.110999+0000","last_fullsized":"2026-02-13T03:34:16.110999+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:10:21.048259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"68'3","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.131713+0000","last_change":"2026-02-13T03:34:14.110249+0000","last_active":"2026-02-13T03:34:18.131713+0000","last_peered":"2026-02-13T03:34:18.131713+0000","last_clean":"2026-02-13T03:34:18.131713+0000","last_became_active":"2026-02-13T03:34:14.109916+0000","last_became_peered":"2026-02-13T03:34:14.109916+0000","last_unstale":"2026-02-13T03:34:18.131713+0000","last_undegraded":"2026-02-13T03:34:18.131713+0000","last_fullsized":"2026-02-13T03:34:18.131713+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:10:50.121909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.178258+0000","last_change":"2026-02-13T03:34:15.128143+0000","last_active":"2026-02-13T03:34:16.178258+0000","last_peered":"2026-02-13T03:34:16.178258+0000","last_clean":"2026-02-13T03:34:16.178258+0000","last_became_active":"2026-02-13T03:34:15.128030+0000","last_became_peered":"2026-02-13T03:34:15.128030+0000","last_unstale":"2026-02-13T03:34:16.178258+0000","last_undegraded":"2026-02-13T03:34:16.178258+0000","last_fullsized":"2026-02-13T03:34:16.178258+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:06:52.963812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"68'3","reported_seq":28,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:25.153781+0000","last_change":"2026-02-13T03:34:14.119064+0000","last_active":"2026-02-13T03:34:25.153781+0000","last_peered":"2026-02-13T03:34:25.153781+0000","last_clean":"2026-02-13T03:34:25.153781+0000","last_became_active":"2026-02-13T03:34:14.118830+0000","last_became_peered":"2026-02-13T03:34:14.118830+0000","last_unstale":"2026-02-13T03:34:25.153781+0000","last_undegraded":"2026-02-13T03:34:25.153781+0000","last_fullsized":"2026-02-13T03:34:25.153781+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:53:25.966883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.177842+0000","last_change":"2026-02-13T03:34:15.129037+0000","last_active":"2026-02-13T03:34:16.177842+0000","last_peered":"2026-02-13T03:34:16.177842+0000","last_clean":"2026-02-13T03:34:16.177842+0000","last_became_active":"2026-02-13T03:34:15.128632+0000","last_became_peered":"2026-02-13T03:34:15.128632+0000","last_unstale":"2026-02-13T03:34:16.177842+0000","last_undegraded":"2026-02-13T03:34:16.177842+0000","last_fullsized":"2026-02-13T03:34:16.177842+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:19:22.180885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"68'15","reported_seq":32,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.136911+0000","last_change":"2026-02-13T03:34:14.110318+0000","last_active":"2026-02-13T03:34:19.136911+0000","last_peered":"2026-02-13T03:34:19.136911+0000","last_clean":"2026-02-13T03:34:19.136911+0000","last_became_active":"2026-02-13T03:34:14.109648+0000","last_became_peered":"2026-02-13T03:34:14.109648+0000","last_unstale":"2026-02-13T03:34:19.136911+0000","last_undegraded":"2026-02-13T03:34:19.136911+0000","last_fullsized":"2026-02-13T03:34:19.136911+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:06:33.574407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110988+0000","last_change":"2026-02-13T03:34:15.116762+0000","last_active":"2026-02-13T03:34:16.110988+0000","last_peered":"2026-02-13T03:34:16.110988+0000","last_clean":"2026-02-13T03:34:16.110988+0000","last_became_active":"2026-02-13T03:34:15.116280+0000","last_became_peered":"2026-02-13T03:34:15.116280+0000","last_unstale":"2026-02-13T03:34:16.110988+0000","last_undegraded":"2026-02-13T03:34:16.110988+0000","last_fullsized":"2026-02-13T03:34:16.110988+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:36:18.141037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"68'2","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:20.137496+0000","last_change":"2026-02-13T03:34:14.110976+0000","last_active":"2026-02-13T03:34:20.137496+0000","last_peered":"2026-02-13T03:34:20.137496+0000","last_clean":"2026-02-13T03:34:20.137496+0000","last_became_active":"2026-02-13T03:34:14.110717+0000","last_became_peered":"2026-02-13T03:34:14.110717+0000","last_unstale":"2026-02-13T03:34:20.137496+0000","last_undegraded":"2026-02-13T03:34:20.137496+0000","last_fullsized":"2026-02-13T03:34:20.137496+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:25:27.336312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.949109+0000","last_change":"2026-02-13T03:34:15.118326+0000","last_active":"2026-02-13T03:34:16.949109+0000","last_peered":"2026-02-13T03:34:16.949109+0000","last_clean":"2026-02-13T03:34:16.949109+0000","last_became_active":"2026-02-13T03:34:15.117977+0000","last_became_peered":"2026-02-13T03:34:15.117977+0000","last_unstale":"2026-02-13T03:34:16.949109+0000","last_undegraded":"2026-02-13T03:34:16.949109+0000","last_fullsized":"2026-02-13T03:34:16.949109+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:43:03.579176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"67'2","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111152+0000","last_change":"2026-02-13T03:34:14.109555+0000","last_active":"2026-02-13T03:34:16.111152+0000","last_peered":"2026-02-13T03:34:16.111152+0000","last_clean":"2026-02-13T03:34:16.111152+0000","last_became_active":"2026-02-13T03:34:14.109369+0000","last_became_peered":"2026-02-13T03:34:14.109369+0000","last_unstale":"2026-02-13T03:34:16.111152+0000","last_undegraded":"2026-02-13T03:34:16.111152+0000","last_fullsized":"2026-02-13T03:34:16.111152+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:16:14.530159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.178325+0000","last_change":"2026-02-13T03:34:15.126930+0000","last_active":"2026-02-13T03:34:16.178325+0000","last_peered":"2026-02-13T03:34:16.178325+0000","last_clean":"2026-02-13T03:34:16.178325+0000","last_became_active":"2026-02-13T03:34:15.126768+0000","last_became_peered":"2026-02-13T03:34:15.126768+0000","last_unstale":"2026-02-13T03:34:16.178325+0000","last_undegraded":"2026-02-13T03:34:16.178325+0000","last_fullsized":"2026-02-13T03:34:16.178325+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:15:08.856303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"67'1","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.962366+0000","last_change":"2026-02-13T03:34:14.110533+0000","last_active":"2026-02-13T03:34:16.962366+0000","last_peered":"2026-02-13T03:34:16.962366+0000","last_clean":"2026-02-13T03:34:16.962366+0000","last_became_active":"2026-02-13T03:34:14.109851+0000","last_became_peered":"2026-02-13T03:34:14.109851+0000","last_unstale":"2026-02-13T03:34:16.962366+0000","last_undegraded":"2026-02-13T03:34:16.962366+0000","last_fullsized":"2026-02-13T03:34:16.962366+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:30:58.184043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"68'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:17.182704+0000","last_change":"2026-02-13T03:34:15.128728+0000","last_active":"2026-02-13T03:34:17.182704+0000","last_peered":"2026-02-13T03:34:17.182704+0000","last_clean":"2026-02-13T03:34:17.182704+0000","last_became_active":"2026-02-13T03:34:15.128579+0000","last_became_peered":"2026-02-13T03:34:15.128579+0000","last_unstale":"2026-02-13T03:34:17.182704+0000","last_undegraded":"2026-02-13T03:34:17.182704+0000","last_fullsized":"2026-02-13T03:34:17.182704+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:05:25.697309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"68'3","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.136336+0000","last_change":"2026-02-13T03:34:14.112417+0000","last_active":"2026-02-13T03:34:19.136336+0000","last_peered":"2026-02-13T03:34:19.136336+0000","last_clean":"2026-02-13T03:34:19.136336+0000","last_became_active":"2026-02-13T03:34:14.112282+0000","last_became_peered":"2026-02-13T03:34:14.112282+0000","last_unstale":"2026-02-13T03:34:19.136336+0000","last_undegraded":"2026-02-13T03:34:19.136336+0000","last_fullsized":"2026-02-13T03:34:19.136336+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:54:26.443931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.178303+0000","last_change":"2026-02-13T03:34:15.128773+0000","last_active":"2026-02-13T03:34:16.178303+0000","last_peered":"2026-02-13T03:34:16.178303+0000","last_clean":"2026-02-13T03:34:16.178303+0000","last_became_active":"2026-02-13T03:34:15.128614+0000","last_became_peered":"2026-02-13T03:34:15.128614+0000","last_unstale":"2026-02-13T03:34:16.178303+0000","last_undegraded":"2026-02-13T03:34:16.178303+0000","last_fullsized":"2026-02-13T03:34:16.178303+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:21:12.460740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'152","reported_seq":335,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.177697+0000","last_change":"2026-02-13T03:33:53.689186+0000","last_active":"2026-02-13T03:34:16.177697+0000","last_peered":"2026-02-13T03:34:16.177697+0000","last_clean":"2026-02-13T03:34:16.177697+0000","last_became_active":"2026-02-13T03:33:53.689016+0000","last_became_peered":"2026-02-13T03:33:53.689016+0000","last_unstale":"2026-02-13T03:34:16.177697+0000","last_undegraded":"2026-02-13T03:34:16.177697+0000","last_fullsized":"2026-02-13T03:34:16.177697+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:32:51.335478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:32:51.335478+0000","last_clean_scrub_stamp":"2026-02-13T03:32:51.335478+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:46:12.228415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"68'3","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:20.148489+0000","last_change":"2026-02-13T03:34:14.118073+0000","last_active":"2026-02-13T03:34:20.148489+0000","last_peered":"2026-02-13T03:34:20.148489+0000","last_clean":"2026-02-13T03:34:20.148489+0000","last_became_active":"2026-02-13T03:34:14.117930+0000","last_became_peered":"2026-02-13T03:34:14.117930+0000","last_unstale":"2026-02-13T03:34:20.148489+0000","last_undegraded":"2026-02-13T03:34:20.148489+0000","last_fullsized":"2026-02-13T03:34:20.148489+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:31:04.815698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791157+0000","last_change":"2026-02-13T03:34:15.120789+0000","last_active":"2026-02-13T03:34:16.791157+0000","last_peered":"2026-02-13T03:34:16.791157+0000","last_clean":"2026-02-13T03:34:16.791157+0000","last_became_active":"2026-02-13T03:34:15.120102+0000","last_became_peered":"2026-02-13T03:34:15.120102+0000","last_unstale":"2026-02-13T03:34:16.791157+0000","last_undegraded":"2026-02-13T03:34:16.791157+0000","last_fullsized":"2026-02-13T03:34:16.791157+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:10:29.422050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"68'3","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.147121+0000","last_change":"2026-02-13T03:34:14.119784+0000","last_active":"2026-02-13T03:34:19.147121+0000","last_peered":"2026-02-13T03:34:19.147121+0000","last_clean":"2026-02-13T03:34:19.147121+0000","last_became_active":"2026-02-13T03:34:14.119642+0000","last_became_peered":"2026-02-13T03:34:14.119642+0000","last_unstale":"2026-02-13T03:34:19.147121+0000","last_undegraded":"2026-02-13T03:34:19.147121+0000","last_fullsized":"2026-02-13T03:34:19.147121+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:15:09.988019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110957+0000","last_change":"2026-02-13T03:34:15.113490+0000","last_active":"2026-02-13T03:34:16.110957+0000","last_peered":"2026-02-13T03:34:16.110957+0000","last_clean":"2026-02-13T03:34:16.110957+0000","last_became_active":"2026-02-13T03:34:15.113119+0000","last_became_peered":"2026-02-13T03:34:15.113119+0000","last_unstale":"2026-02-13T03:34:16.110957+0000","last_undegraded":"2026-02-13T03:34:16.110957+0000","last_fullsized":"2026-02-13T03:34:16.110957+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:26:12.918710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"68'4","reported_seq":27,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:25.142855+0000","last_change":"2026-02-13T03:34:14.107155+0000","last_active":"2026-02-13T03:34:25.142855+0000","last_peered":"2026-02-13T03:34:25.142855+0000","last_clean":"2026-02-13T03:34:25.142855+0000","last_became_active":"2026-02-13T03:34:14.106966+0000","last_became_peered":"2026-02-13T03:34:14.106966+0000","last_unstale":"2026-02-13T03:34:25.142855+0000","last_undegraded":"2026-02-13T03:34:25.142855+0000","last_fullsized":"2026-02-13T03:34:25.142855+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:23:06.193832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110886+0000","last_change":"2026-02-13T03:34:15.116852+0000","last_active":"2026-02-13T03:34:16.110886+0000","last_peered":"2026-02-13T03:34:16.110886+0000","last_clean":"2026-02-13T03:34:16.110886+0000","last_became_active":"2026-02-13T03:34:15.116610+0000","last_became_peered":"2026-02-13T03:34:15.116610+0000","last_unstale":"2026-02-13T03:34:16.110886+0000","last_undegraded":"2026-02-13T03:34:16.110886+0000","last_fullsized":"2026-02-13T03:34:16.110886+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:13:33.504269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"68'1","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:17.182694+0000","last_change":"2026-02-13T03:34:14.118389+0000","last_active":"2026-02-13T03:34:17.182694+0000","last_peered":"2026-02-13T03:34:17.182694+0000","last_clean":"2026-02-13T03:34:17.182694+0000","last_became_active":"2026-02-13T03:34:14.118111+0000","last_became_peered":"2026-02-13T03:34:14.118111+0000","last_unstale":"2026-02-13T03:34:17.182694+0000","last_undegraded":"2026-02-13T03:34:17.182694+0000","last_fullsized":"2026-02-13T03:34:17.182694+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:26:09.727990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.912869+0000","last_change":"2026-02-13T03:34:15.129069+0000","last_active":"2026-02-13T03:34:16.912869+0000","last_peered":"2026-02-13T03:34:16.912869+0000","last_clean":"2026-02-13T03:34:16.912869+0000","last_became_active":"2026-02-13T03:34:15.128801+0000","last_became_peered":"2026-02-13T03:34:15.128801+0000","last_unstale":"2026-02-13T03:34:16.912869+0000","last_undegraded":"2026-02-13T03:34:16.912869+0000","last_fullsized":"2026-02-13T03:34:16.912869+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:05:14.500513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111153+0000","last_change":"2026-02-13T03:34:14.110643+0000","last_active":"2026-02-13T03:34:16.111153+0000","last_peered":"2026-02-13T03:34:16.111153+0000","last_clean":"2026-02-13T03:34:16.111153+0000","last_became_active":"2026-02-13T03:34:14.110456+0000","last_became_peered":"2026-02-13T03:34:14.110456+0000","last_unstale":"2026-02-13T03:34:16.111153+0000","last_undegraded":"2026-02-13T03:34:16.111153+0000","last_fullsized":"2026-02-13T03:34:16.111153+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:22:20.313197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"68'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.912905+0000","last_change":"2026-02-13T03:34:15.129233+0000","last_active":"2026-02-13T03:34:16.912905+0000","last_peered":"2026-02-13T03:34:16.912905+0000","last_clean":"2026-02-13T03:34:16.912905+0000","last_became_active":"2026-02-13T03:34:15.128972+0000","last_became_peered":"2026-02-13T03:34:15.128972+0000","last_unstale":"2026-02-13T03:34:16.912905+0000","last_undegraded":"2026-02-13T03:34:16.912905+0000","last_fullsized":"2026-02-13T03:34:16.912905+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:38:10.731668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"68'1","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.131327+0000","last_change":"2026-02-13T03:34:14.110025+0000","last_active":"2026-02-13T03:34:18.131327+0000","last_peered":"2026-02-13T03:34:18.131327+0000","last_clean":"2026-02-13T03:34:18.131327+0000","last_became_active":"2026-02-13T03:34:14.109687+0000","last_became_peered":"2026-02-13T03:34:14.109687+0000","last_unstale":"2026-02-13T03:34:18.131327+0000","last_undegraded":"2026-02-13T03:34:18.131327+0000","last_fullsized":"2026-02-13T03:34:18.131327+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:58:00.997107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111247+0000","last_change":"2026-02-13T03:34:15.116452+0000","last_active":"2026-02-13T03:34:16.111247+0000","last_peered":"2026-02-13T03:34:16.111247+0000","last_clean":"2026-02-13T03:34:16.111247+0000","last_became_active":"2026-02-13T03:34:15.116297+0000","last_became_peered":"2026-02-13T03:34:15.116297+0000","last_unstale":"2026-02-13T03:34:16.111247+0000","last_undegraded":"2026-02-13T03:34:16.111247+0000","last_fullsized":"2026-02-13T03:34:16.111247+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:36:12.315236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"68'6","reported_seq":22,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:22.118379+0000","last_change":"2026-02-13T03:34:14.109823+0000","last_active":"2026-02-13T03:34:22.118379+0000","last_peered":"2026-02-13T03:34:22.118379+0000","last_clean":"2026-02-13T03:34:22.118379+0000","last_became_active":"2026-02-13T03:34:14.109688+0000","last_became_peered":"2026-02-13T03:34:14.109688+0000","last_unstale":"2026-02-13T03:34:22.118379+0000","last_undegraded":"2026-02-13T03:34:22.118379+0000","last_fullsized":"2026-02-13T03:34:22.118379+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:29:43.449201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791407+0000","last_change":"2026-02-13T03:34:15.120466+0000","last_active":"2026-02-13T03:34:16.791407+0000","last_peered":"2026-02-13T03:34:16.791407+0000","last_clean":"2026-02-13T03:34:16.791407+0000","last_became_active":"2026-02-13T03:34:15.119177+0000","last_became_peered":"2026-02-13T03:34:15.119177+0000","last_unstale":"2026-02-13T03:34:16.791407+0000","last_undegraded":"2026-02-13T03:34:16.791407+0000","last_fullsized":"2026-02-13T03:34:16.791407+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:38:14.396482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"68'4","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.142036+0000","last_change":"2026-02-13T03:34:14.123372+0000","last_active":"2026-02-13T03:34:18.142036+0000","last_peered":"2026-02-13T03:34:18.142036+0000","last_clean":"2026-02-13T03:34:18.142036+0000","last_became_active":"2026-02-13T03:34:14.123252+0000","last_became_peered":"2026-02-13T03:34:14.123252+0000","last_unstale":"2026-02-13T03:34:18.142036+0000","last_undegraded":"2026-02-13T03:34:18.142036+0000","last_fullsized":"2026-02-13T03:34:18.142036+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:12:44.138856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910239+0000","last_change":"2026-02-13T03:34:15.117238+0000","last_active":"2026-02-13T03:34:16.910239+0000","last_peered":"2026-02-13T03:34:16.910239+0000","last_clean":"2026-02-13T03:34:16.910239+0000","last_became_active":"2026-02-13T03:34:15.116951+0000","last_became_peered":"2026-02-13T03:34:15.116951+0000","last_unstale":"2026-02-13T03:34:16.910239+0000","last_undegraded":"2026-02-13T03:34:16.910239+0000","last_fullsized":"2026-02-13T03:34:16.910239+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:51:53.182871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"68'2","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.142193+0000","last_change":"2026-02-13T03:34:14.121985+0000","last_active":"2026-02-13T03:34:18.142193+0000","last_peered":"2026-02-13T03:34:18.142193+0000","last_clean":"2026-02-13T03:34:18.142193+0000","last_became_active":"2026-02-13T03:34:14.121838+0000","last_became_peered":"2026-02-13T03:34:14.121838+0000","last_unstale":"2026-02-13T03:34:18.142193+0000","last_undegraded":"2026-02-13T03:34:18.142193+0000","last_fullsized":"2026-02-13T03:34:18.142193+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:12:14.538589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909663+0000","last_change":"2026-02-13T03:34:15.117334+0000","last_active":"2026-02-13T03:34:16.909663+0000","last_peered":"2026-02-13T03:34:16.909663+0000","last_clean":"2026-02-13T03:34:16.909663+0000","last_became_active":"2026-02-13T03:34:15.117136+0000","last_became_peered":"2026-02-13T03:34:15.117136+0000","last_unstale":"2026-02-13T03:34:16.909663+0000","last_undegraded":"2026-02-13T03:34:16.909663+0000","last_fullsized":"2026-02-13T03:34:16.909663+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:09:01.863249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"68'3","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.132210+0000","last_change":"2026-02-13T03:34:14.108168+0000","last_active":"2026-02-13T03:34:18.132210+0000","last_peered":"2026-02-13T03:34:18.132210+0000","last_clean":"2026-02-13T03:34:18.132210+0000","last_became_active":"2026-02-13T03:34:14.107598+0000","last_became_peered":"2026-02-13T03:34:14.107598+0000","last_unstale":"2026-02-13T03:34:18.132210+0000","last_undegraded":"2026-02-13T03:34:18.132210+0000","last_fullsized":"2026-02-13T03:34:18.132210+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:50:40.370428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.949003+0000","last_change":"2026-02-13T03:34:15.117553+0000","last_active":"2026-02-13T03:34:16.949003+0000","last_peered":"2026-02-13T03:34:16.949003+0000","last_clean":"2026-02-13T03:34:16.949003+0000","last_became_active":"2026-02-13T03:34:15.117298+0000","last_became_peered":"2026-02-13T03:34:15.117298+0000","last_unstale":"2026-02-13T03:34:16.949003+0000","last_undegraded":"2026-02-13T03:34:16.949003+0000","last_fullsized":"2026-02-13T03:34:16.949003+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:52:30.525618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"68'1","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909868+0000","last_change":"2026-02-13T03:34:14.110063+0000","last_active":"2026-02-13T03:34:16.909868+0000","last_peered":"2026-02-13T03:34:16.909868+0000","last_clean":"2026-02-13T03:34:16.909868+0000","last_became_active":"2026-02-13T03:34:14.109758+0000","last_became_peered":"2026-02-13T03:34:14.109758+0000","last_unstale":"2026-02-13T03:34:16.909868+0000","last_undegraded":"2026-02-13T03:34:16.909868+0000","last_fullsized":"2026-02-13T03:34:16.909868+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:51:44.239059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791368+0000","last_change":"2026-02-13T03:34:15.119669+0000","last_active":"2026-02-13T03:34:16.791368+0000","last_peered":"2026-02-13T03:34:16.791368+0000","last_clean":"2026-02-13T03:34:16.791368+0000","last_became_active":"2026-02-13T03:34:15.118420+0000","last_became_peered":"2026-02-13T03:34:15.118420+0000","last_unstale":"2026-02-13T03:34:16.791368+0000","last_undegraded":"2026-02-13T03:34:16.791368+0000","last_fullsized":"2026-02-13T03:34:16.791368+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:55:45.147665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"68'4","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.131421+0000","last_change":"2026-02-13T03:34:14.110926+0000","last_active":"2026-02-13T03:34:18.131421+0000","last_peered":"2026-02-13T03:34:18.131421+0000","last_clean":"2026-02-13T03:34:18.131421+0000","last_became_active":"2026-02-13T03:34:14.110536+0000","last_became_peered":"2026-02-13T03:34:14.110536+0000","last_unstale":"2026-02-13T03:34:18.131421+0000","last_undegraded":"2026-02-13T03:34:18.131421+0000","last_fullsized":"2026-02-13T03:34:18.131421+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:44:35.738382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.178106+0000","last_change":"2026-02-13T03:34:15.127444+0000","last_active":"2026-02-13T03:34:16.178106+0000","last_peered":"2026-02-13T03:34:16.178106+0000","last_clean":"2026-02-13T03:34:16.178106+0000","last_became_active":"2026-02-13T03:34:15.127294+0000","last_became_peered":"2026-02-13T03:34:15.127294+0000","last_unstale":"2026-02-13T03:34:16.178106+0000","last_undegraded":"2026-02-13T03:34:16.178106+0000","last_fullsized":"2026-02-13T03:34:16.178106+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:17:49.248022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110987+0000","last_change":"2026-02-13T03:34:15.117263+0000","last_active":"2026-02-13T03:34:16.110987+0000","last_peered":"2026-02-13T03:34:16.110987+0000","last_clean":"2026-02-13T03:34:16.110987+0000","last_became_active":"2026-02-13T03:34:15.116892+0000","last_became_peered":"2026-02-13T03:34:15.116892+0000","last_unstale":"2026-02-13T03:34:16.110987+0000","last_undegraded":"2026-02-13T03:34:16.110987+0000","last_fullsized":"2026-02-13T03:34:16.110987+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:06:22.105812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"67'2","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909913+0000","last_change":"2026-02-13T03:34:14.109993+0000","last_active":"2026-02-13T03:34:16.909913+0000","last_peered":"2026-02-13T03:34:16.909913+0000","last_clean":"2026-02-13T03:34:16.909913+0000","last_became_active":"2026-02-13T03:34:14.109138+0000","last_became_peered":"2026-02-13T03:34:14.109138+0000","last_unstale":"2026-02-13T03:34:16.909913+0000","last_undegraded":"2026-02-13T03:34:16.909913+0000","last_fullsized":"2026-02-13T03:34:16.909913+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:17:43.296418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.920946+0000","last_change":"2026-02-13T03:34:15.128408+0000","last_active":"2026-02-13T03:34:16.920946+0000","last_peered":"2026-02-13T03:34:16.920946+0000","last_clean":"2026-02-13T03:34:16.920946+0000","last_became_active":"2026-02-13T03:34:15.128196+0000","last_became_peered":"2026-02-13T03:34:15.128196+0000","last_unstale":"2026-02-13T03:34:16.920946+0000","last_undegraded":"2026-02-13T03:34:16.920946+0000","last_fullsized":"2026-02-13T03:34:16.920946+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:02:00.806973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"68'4","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.135705+0000","last_change":"2026-02-13T03:34:14.110147+0000","last_active":"2026-02-13T03:34:19.135705+0000","last_peered":"2026-02-13T03:34:19.135705+0000","last_clean":"2026-02-13T03:34:19.135705+0000","last_became_active":"2026-02-13T03:34:14.109661+0000","last_became_peered":"2026-02-13T03:34:14.109661+0000","last_unstale":"2026-02-13T03:34:19.135705+0000","last_undegraded":"2026-02-13T03:34:19.135705+0000","last_fullsized":"2026-02-13T03:34:19.135705+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:51:07.074657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910343+0000","last_change":"2026-02-13T03:34:15.116693+0000","last_active":"2026-02-13T03:34:16.910343+0000","last_peered":"2026-02-13T03:34:16.910343+0000","last_clean":"2026-02-13T03:34:16.910343+0000","last_became_active":"2026-02-13T03:34:15.116374+0000","last_became_peered":"2026-02-13T03:34:15.116374+0000","last_unstale":"2026-02-13T03:34:16.910343+0000","last_undegraded":"2026-02-13T03:34:16.910343+0000","last_fullsized":"2026-02-13T03:34:16.910343+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:13:05.738784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"68'2","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:17.784382+0000","last_change":"2026-02-13T03:34:14.110655+0000","last_active":"2026-02-13T03:34:17.784382+0000","last_peered":"2026-02-13T03:34:17.784382+0000","last_clean":"2026-02-13T03:34:17.784382+0000","last_became_active":"2026-02-13T03:34:14.110497+0000","last_became_peered":"2026-02-13T03:34:14.110497+0000","last_unstale":"2026-02-13T03:34:17.784382+0000","last_undegraded":"2026-02-13T03:34:17.784382+0000","last_fullsized":"2026-02-13T03:34:17.784382+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:31:10.990787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791316+0000","last_change":"2026-02-13T03:34:15.120370+0000","last_active":"2026-02-13T03:34:16.791316+0000","last_peered":"2026-02-13T03:34:16.791316+0000","last_clean":"2026-02-13T03:34:16.791316+0000","last_became_active":"2026-02-13T03:34:15.119060+0000","last_became_peered":"2026-02-13T03:34:15.119060+0000","last_unstale":"2026-02-13T03:34:16.791316+0000","last_undegraded":"2026-02-13T03:34:16.791316+0000","last_fullsized":"2026-02-13T03:34:16.791316+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:53:52.717845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"68'9","reported_seq":26,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.136718+0000","last_change":"2026-02-13T03:34:14.109926+0000","last_active":"2026-02-13T03:34:19.136718+0000","last_peered":"2026-02-13T03:34:19.136718+0000","last_clean":"2026-02-13T03:34:19.136718+0000","last_became_active":"2026-02-13T03:34:14.109787+0000","last_became_peered":"2026-02-13T03:34:14.109787+0000","last_unstale":"2026-02-13T03:34:19.136718+0000","last_undegraded":"2026-02-13T03:34:19.136718+0000","last_fullsized":"2026-02-13T03:34:19.136718+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:32:55.723731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56930,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":66,"num_read_kb":94,"num_write":146,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":170790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":109788,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":299994,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":63,"seq":270582939656,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27680,"kb_used_data":716,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":733975520,"statfs":{"total":751619276800,"available":751590932480,"internally_reserved":0,"allocated":733184,"data_stored":354254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8106,"internal_metadata":27582550},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":56,"seq":240518168585,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27820,"kb_used_data":856,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":733975380,"statfs":{"total":751619276800,"available":751590789120,"internally_reserved":0,"allocated":876544,"data_stored":998579,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":26469,"internal_metadata":27564187},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":53,"seq":227633266699,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27696,"kb_used_data":732,"kb_used_omap":23,"kb_used_meta":26920,"kb_avail":733975504,"statfs":{"total":751619276800,"available":751590916096,"internally_reserved":0,"allocated":749568,"data_stored":354490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24029,"internal_metadata":27566627},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":46,"seq":197568495628,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27696,"kb_used_data":732,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":733975504,"statfs":{"total":751619276800,"available":751590916096,"internally_reserved":0,"allocated":749568,"data_stored":354410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28593,"internal_metadata":27562063},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":39,"seq":167503724558,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27744,"kb_used_data":780,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975456,"statfs":{"total":751619276800,"available":751590866944,"internally_reserved":0,"allocated":798720,"data_stored":946359,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":31919,"internal_metadata":27558737},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":36,"seq":154618822671,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27684,"kb_used_data":720,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733975516,"statfs":{"total":751619276800,"available":751590928384,"internally_reserved":0,"allocated":737280,"data_stored":353857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25134,"internal_metadata":27565522},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":29,"seq":124554051601,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27756,"kb_used_data":792,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":733975444,"statfs":{"total":751619276800,"available":751590854656,"internally_reserved":0,"allocated":811008,"data_stored":946043,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":30094,"internal_metadata":27560562},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":26,"seq":111669149714,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27688,"kb_used_data":724,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975512,"statfs":{"total":751619276800,"available":751590924288,"internally_reserved":0,"allocated":741376,"data_stored":354294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36858,"internal_metadata":27553798},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":19,"seq":81604378645,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27700,"kb_used_data":736,"kb_used_omap":42,"kb_used_meta":26901,"kb_avail":733975500,"statfs":{"total":751619276800,"available":751590912000,"internally_reserved":0,"allocated":753664,"data_stored":354168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43728,"internal_metadata":27546928},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":54,"kb_used_meta":26889,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":408276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55449,"internal_metadata":27535207},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672983,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27736,"kb_used_data":772,"kb_used_omap":38,"kb_used_meta":26905,"kb_avail":733975464,"statfs":{"total":751619276800,"available":751590875136,"internally_reserved":0,"allocated":790528,"data_stored":406494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39111,"internal_metadata":27551545},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771097,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27704,"kb_used_data":740,"kb_used_omap":42,"kb_used_meta":26901,"kb_avail":733975496,"statfs":{"total":751619276800,"available":751590907904,"internally_reserved":0,"allocated":757760,"data_stored":355172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43396,"internal_metadata":27547260},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36468,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36468,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36468,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1713,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":52844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1713,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":54626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24053,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15766,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6449,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1018,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":916,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5514,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16478,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10902,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":54444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23394,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1872,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T03:34:28.785 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T03:34:28.933 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:29.048 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.043+0000 7fdbb9cbc6c0 1 -- 10.20.193.96:0/1171595467 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdbb410f230 msgr2=0x7fdbb410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:29.049 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.043+0000 7fdbb9cbc6c0 1 --2- 10.20.193.96:0/1171595467 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdbb410f230 0x7fdbb410f600 secure :-1 s=READY pgs=321 gs=1 cs=0 l=1 c_cookie=9471220963334577272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdba00099a0 tx=0x7fdba002ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:29.049 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.043+0000 7fdbb9cbc6c0 1 -- 10.20.193.96:0/1171595467 shutdown_connections 2026-02-13T03:34:29.049 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.043+0000 7fdbb9cbc6c0 1 --2- 10.20.193.96:0/1171595467 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fdbb4115440 0x7fdbb4175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:29.049 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.043+0000 7fdbb9cbc6c0 1 --2- 10.20.193.96:0/1171595467 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fdbb410fc20 0x7fdbb4114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:29.049 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.043+0000 7fdbb9cbc6c0 1 --2- 10.20.193.96:0/1171595467 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdbb410f230 0x7fdbb410f600 unknown :-1 s=CLOSED pgs=321 gs=1 cs=0 l=1 c_cookie=9471220963334577272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:29.049 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.043+0000 7fdbb9cbc6c0 1 -- 10.20.193.96:0/1171595467 >> 10.20.193.96:0/1171595467 conn(0x7fdbb40ecb30 msgr2=0x7fdbb410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:29.049 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.043+0000 7fdbb9cbc6c0 1 -- 10.20.193.96:0/1171595467 shutdown_connections 2026-02-13T03:34:29.049 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.043+0000 7fdbb9cbc6c0 1 -- 10.20.193.96:0/1171595467 wait complete. 2026-02-13T03:34:29.049 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.044+0000 7fdbb9cbc6c0 1 Processor -- start 2026-02-13T03:34:29.049 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.044+0000 7fdbb9cbc6c0 1 -- start start 2026-02-13T03:34:29.050 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.044+0000 7fdbb9cbc6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdbb410f230 0x7fdbb4066730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:29.050 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.044+0000 7fdbb9cbc6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fdbb4115440 0x7fdbb4062990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:29.050 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.044+0000 7fdbb9cbc6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fdbb4062f70 0x7fdbb4063410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:29.050 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.044+0000 7fdbb9cbc6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb4167bd0 con 0x7fdbb410f230 2026-02-13T03:34:29.050 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.044+0000 7fdbb9cbc6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb4167d40 con 0x7fdbb4062f70 2026-02-13T03:34:29.050 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.044+0000 7fdbb9cbc6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb4167f00 con 0x7fdbb4115440 2026-02-13T03:34:29.050 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.044+0000 7fdbb37fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdbb410f230 0x7fdbb4066730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:29.050 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.044+0000 7fdbb37fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdbb410f230 0x7fdbb4066730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49566/0 (socket says 10.20.193.96:49566) 2026-02-13T03:34:29.050 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.044+0000 7fdbb37fe6c0 1 -- 10.20.193.96:0/4274986224 learned_addr learned my addr 10.20.193.96:0/4274986224 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:29.050 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.044+0000 7fdbb2ffd6c0 1 --2- 10.20.193.96:0/4274986224 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fdbb4115440 0x7fdbb4062990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:29.050 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.044+0000 7fdbb37fe6c0 1 -- 10.20.193.96:0/4274986224 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fdbb4115440 msgr2=0x7fdbb4062990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:29.051 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.044+0000 7fdbb37fe6c0 1 --2- 10.20.193.96:0/4274986224 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fdbb4115440 0x7fdbb4062990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:29.051 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.044+0000 7fdbb37fe6c0 1 -- 10.20.193.96:0/4274986224 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fdbb4062f70 msgr2=0x7fdbb4063410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:29.051 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.044+0000 7fdbb3fff6c0 1 --2- 10.20.193.96:0/4274986224 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fdbb4062f70 0x7fdbb4063410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:29.051 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.044+0000 7fdbb37fe6c0 1 --2- 10.20.193.96:0/4274986224 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fdbb4062f70 0x7fdbb4063410 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:29.051 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.044+0000 7fdbb37fe6c0 1 -- 10.20.193.96:0/4274986224 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba0009590 con 0x7fdbb410f230 2026-02-13T03:34:29.051 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.044+0000 7fdbb37fe6c0 1 --2- 10.20.193.96:0/4274986224 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdbb410f230 0x7fdbb4066730 secure :-1 s=READY pgs=322 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdba00098c0 tx=0x7fdba00047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:29.051 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.044+0000 7fdbb0ff96c0 1 -- 10.20.193.96:0/4274986224 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdba0002ae0 con 0x7fdbb410f230 2026-02-13T03:34:29.051 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.044+0000 7fdbb0ff96c0 1 -- 10.20.193.96:0/4274986224 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fdba0002c40 con 0x7fdbb410f230 2026-02-13T03:34:29.051 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.044+0000 7fdbb0ff96c0 1 -- 10.20.193.96:0/4274986224 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdba00372f0 con 0x7fdbb410f230 2026-02-13T03:34:29.051 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.044+0000 7fdbb9cbc6c0 1 -- 10.20.193.96:0/4274986224 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbb4168180 con 0x7fdbb410f230 2026-02-13T03:34:29.051 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.044+0000 7fdbb9cbc6c0 1 -- 10.20.193.96:0/4274986224 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbb4168600 con 0x7fdbb410f230 2026-02-13T03:34:29.051 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.045+0000 7fdbb9cbc6c0 1 -- 10.20.193.96:0/4274986224 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbb4110500 con 0x7fdbb410f230 2026-02-13T03:34:29.052 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.046+0000 7fdbb0ff96c0 1 -- 10.20.193.96:0/4274986224 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fdba0007960 con 0x7fdbb410f230 2026-02-13T03:34:29.052 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.046+0000 7fdbb0ff96c0 1 --2- 10.20.193.96:0/4274986224 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fdb880b5690 0x7fdb880d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:29.053 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.047+0000 7fdbb0ff96c0 1 -- 10.20.193.96:0/4274986224 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7fdba0107c90 con 0x7fdbb410f230 2026-02-13T03:34:29.053 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.047+0000 7fdbb2ffd6c0 1 --2- 10.20.193.96:0/4274986224 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fdb880b5690 0x7fdb880d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:29.053 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.047+0000 7fdbb2ffd6c0 1 --2- 10.20.193.96:0/4274986224 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fdb880b5690 0x7fdb880d5b40 secure :-1 s=READY pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdba4005980 tx=0x7fdba4005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:29.053 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.047+0000 7fdbb0ff96c0 1 -- 10.20.193.96:0/4274986224 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdba00ca6f0 con 0x7fdbb410f230 2026-02-13T03:34:29.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.137+0000 7fdbb9cbc6c0 1 -- 10.20.193.96:0/4274986224 --> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdbb4063cf0 con 0x7fdb880b5690 2026-02-13T03:34:29.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.139+0000 7fdbb0ff96c0 1 -- 10.20.193.96:0/4274986224 <== mgr.14116 v2:10.20.193.96:6800/1736050816 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258970 (secure 0 0 0) 0x7fdbb4063cf0 con 0x7fdb880b5690 2026-02-13T03:34:29.145 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:29.147 INFO:teuthology.orchestra.run.trial096.stderr:dumped all 2026-02-13T03:34:29.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.140+0000 7fdbb9cbc6c0 1 -- 10.20.193.96:0/4274986224 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fdb880b5690 msgr2=0x7fdb880d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:29.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.140+0000 7fdbb9cbc6c0 1 --2- 10.20.193.96:0/4274986224 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fdb880b5690 0x7fdb880d5b40 secure :-1 s=READY pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdba4005980 tx=0x7fdba4005910 comp rx=0 tx=0).stop 2026-02-13T03:34:29.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.140+0000 7fdbb9cbc6c0 1 -- 10.20.193.96:0/4274986224 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdbb410f230 msgr2=0x7fdbb4066730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:29.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.140+0000 7fdbb9cbc6c0 1 --2- 10.20.193.96:0/4274986224 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdbb410f230 0x7fdbb4066730 secure :-1 s=READY pgs=322 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdba00098c0 tx=0x7fdba00047f0 comp rx=0 tx=0).stop 2026-02-13T03:34:29.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.140+0000 7fdbb9cbc6c0 1 -- 10.20.193.96:0/4274986224 shutdown_connections 2026-02-13T03:34:29.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.140+0000 7fdbb9cbc6c0 1 --2- 10.20.193.96:0/4274986224 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fdb880b5690 0x7fdb880d5b40 unknown :-1 s=CLOSED pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:29.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.140+0000 7fdbb9cbc6c0 1 --2- 10.20.193.96:0/4274986224 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fdbb4062f70 0x7fdbb4063410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:29.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.140+0000 7fdbb9cbc6c0 1 --2- 10.20.193.96:0/4274986224 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fdbb4115440 0x7fdbb4062990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:29.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.140+0000 7fdbb9cbc6c0 1 --2- 10.20.193.96:0/4274986224 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdbb410f230 0x7fdbb4066730 unknown :-1 s=CLOSED pgs=322 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:29.150 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.140+0000 7fdbb9cbc6c0 1 -- 10.20.193.96:0/4274986224 >> 10.20.193.96:0/4274986224 conn(0x7fdbb40ecb30 msgr2=0x7fdbb410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:29.150 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.140+0000 7fdbb9cbc6c0 1 -- 10.20.193.96:0/4274986224 shutdown_connections 2026-02-13T03:34:29.150 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.140+0000 7fdbb9cbc6c0 1 -- 10.20.193.96:0/4274986224 wait complete. 2026-02-13T03:34:29.182 INFO:teuthology.orchestra.run.trial096.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2026-02-13T03:34:28.580047+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647532,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":172,"num_read_kb":185,"num_write":337,"num_write_kb":3822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":281,"ondisk_log_size":281,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":332664,"kb_used_data":9096,"kb_used_omap":383,"kb_used_meta":322944,"kb_avail":8807705736,"statfs":{"total":9019431321600,"available":9019090673664,"internally_reserved":0,"allocated":9314304,"data_stored":6186396,"data_compressed":114354,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":392886,"internal_metadata":330694986},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":57130,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":66,"num_read_kb":94,"num_write":142,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002557"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.949202+0000","last_change":"2026-02-13T03:34:15.119248+0000","last_active":"2026-02-13T03:34:16.949202+0000","last_peered":"2026-02-13T03:34:16.949202+0000","last_clean":"2026-02-13T03:34:16.949202+0000","last_became_active":"2026-02-13T03:34:15.118886+0000","last_became_peered":"2026-02-13T03:34:15.118886+0000","last_unstale":"2026-02-13T03:34:16.949202+0000","last_undegraded":"2026-02-13T03:34:16.949202+0000","last_fullsized":"2026-02-13T03:34:16.949202+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:56:49.614786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910225+0000","last_change":"2026-02-13T03:34:15.118140+0000","last_active":"2026-02-13T03:34:16.910225+0000","last_peered":"2026-02-13T03:34:16.910225+0000","last_clean":"2026-02-13T03:34:16.910225+0000","last_became_active":"2026-02-13T03:34:15.117796+0000","last_became_peered":"2026-02-13T03:34:15.117796+0000","last_unstale":"2026-02-13T03:34:16.910225+0000","last_undegraded":"2026-02-13T03:34:16.910225+0000","last_fullsized":"2026-02-13T03:34:16.910225+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:08:34.780460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910178+0000","last_change":"2026-02-13T03:34:15.116927+0000","last_active":"2026-02-13T03:34:16.910178+0000","last_peered":"2026-02-13T03:34:16.910178+0000","last_clean":"2026-02-13T03:34:16.910178+0000","last_became_active":"2026-02-13T03:34:15.116646+0000","last_became_peered":"2026-02-13T03:34:15.116646+0000","last_unstale":"2026-02-13T03:34:16.910178+0000","last_undegraded":"2026-02-13T03:34:16.910178+0000","last_fullsized":"2026-02-13T03:34:16.910178+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:24:45.374886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.122075+0000","last_change":"2026-02-13T03:34:15.127414+0000","last_active":"2026-02-13T03:34:16.122075+0000","last_peered":"2026-02-13T03:34:16.122075+0000","last_clean":"2026-02-13T03:34:16.122075+0000","last_became_active":"2026-02-13T03:34:15.127284+0000","last_became_peered":"2026-02-13T03:34:15.127284+0000","last_unstale":"2026-02-13T03:34:16.122075+0000","last_undegraded":"2026-02-13T03:34:16.122075+0000","last_fullsized":"2026-02-13T03:34:16.122075+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:10:58.233447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909667+0000","last_change":"2026-02-13T03:34:15.117815+0000","last_active":"2026-02-13T03:34:16.909667+0000","last_peered":"2026-02-13T03:34:16.909667+0000","last_clean":"2026-02-13T03:34:16.909667+0000","last_became_active":"2026-02-13T03:34:15.117642+0000","last_became_peered":"2026-02-13T03:34:15.117642+0000","last_unstale":"2026-02-13T03:34:16.909667+0000","last_undegraded":"2026-02-13T03:34:16.909667+0000","last_fullsized":"2026-02-13T03:34:16.909667+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:06:59.379987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.912593+0000","last_change":"2026-02-13T03:34:15.127838+0000","last_active":"2026-02-13T03:34:16.912593+0000","last_peered":"2026-02-13T03:34:16.912593+0000","last_clean":"2026-02-13T03:34:16.912593+0000","last_became_active":"2026-02-13T03:34:15.127492+0000","last_became_peered":"2026-02-13T03:34:15.127492+0000","last_unstale":"2026-02-13T03:34:16.912593+0000","last_undegraded":"2026-02-13T03:34:16.912593+0000","last_fullsized":"2026-02-13T03:34:16.912593+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:10:44.948452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.177724+0000","last_change":"2026-02-13T03:34:15.128751+0000","last_active":"2026-02-13T03:34:16.177724+0000","last_peered":"2026-02-13T03:34:16.177724+0000","last_clean":"2026-02-13T03:34:16.177724+0000","last_became_active":"2026-02-13T03:34:15.128588+0000","last_became_peered":"2026-02-13T03:34:15.128588+0000","last_unstale":"2026-02-13T03:34:16.177724+0000","last_undegraded":"2026-02-13T03:34:16.177724+0000","last_fullsized":"2026-02-13T03:34:16.177724+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:46:50.929612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.790967+0000","last_change":"2026-02-13T03:34:15.119765+0000","last_active":"2026-02-13T03:34:16.790967+0000","last_peered":"2026-02-13T03:34:16.790967+0000","last_clean":"2026-02-13T03:34:16.790967+0000","last_became_active":"2026-02-13T03:34:15.118656+0000","last_became_peered":"2026-02-13T03:34:15.118656+0000","last_unstale":"2026-02-13T03:34:16.790967+0000","last_undegraded":"2026-02-13T03:34:16.790967+0000","last_fullsized":"2026-02-13T03:34:16.790967+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:32:01.369279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.921188+0000","last_change":"2026-02-13T03:34:15.129750+0000","last_active":"2026-02-13T03:34:16.921188+0000","last_peered":"2026-02-13T03:34:16.921188+0000","last_clean":"2026-02-13T03:34:16.921188+0000","last_became_active":"2026-02-13T03:34:15.129277+0000","last_became_peered":"2026-02-13T03:34:15.129277+0000","last_unstale":"2026-02-13T03:34:16.921188+0000","last_undegraded":"2026-02-13T03:34:16.921188+0000","last_fullsized":"2026-02-13T03:34:16.921188+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:54:36.873732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.912899+0000","last_change":"2026-02-13T03:34:15.127742+0000","last_active":"2026-02-13T03:34:16.912899+0000","last_peered":"2026-02-13T03:34:16.912899+0000","last_clean":"2026-02-13T03:34:16.912899+0000","last_became_active":"2026-02-13T03:34:15.127189+0000","last_became_peered":"2026-02-13T03:34:15.127189+0000","last_unstale":"2026-02-13T03:34:16.912899+0000","last_undegraded":"2026-02-13T03:34:16.912899+0000","last_fullsized":"2026-02-13T03:34:16.912899+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:55:52.004058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.178276+0000","last_change":"2026-02-13T03:34:15.127809+0000","last_active":"2026-02-13T03:34:16.178276+0000","last_peered":"2026-02-13T03:34:16.178276+0000","last_clean":"2026-02-13T03:34:16.178276+0000","last_became_active":"2026-02-13T03:34:15.127680+0000","last_became_peered":"2026-02-13T03:34:15.127680+0000","last_unstale":"2026-02-13T03:34:16.178276+0000","last_undegraded":"2026-02-13T03:34:16.178276+0000","last_fullsized":"2026-02-13T03:34:16.178276+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:22:18.420199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.122122+0000","last_change":"2026-02-13T03:34:15.127680+0000","last_active":"2026-02-13T03:34:16.122122+0000","last_peered":"2026-02-13T03:34:16.122122+0000","last_clean":"2026-02-13T03:34:16.122122+0000","last_became_active":"2026-02-13T03:34:15.127508+0000","last_became_peered":"2026-02-13T03:34:15.127508+0000","last_unstale":"2026-02-13T03:34:16.122122+0000","last_undegraded":"2026-02-13T03:34:16.122122+0000","last_fullsized":"2026-02-13T03:34:16.122122+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:22:12.516766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111152+0000","last_change":"2026-02-13T03:34:15.117625+0000","last_active":"2026-02-13T03:34:16.111152+0000","last_peered":"2026-02-13T03:34:16.111152+0000","last_clean":"2026-02-13T03:34:16.111152+0000","last_became_active":"2026-02-13T03:34:15.117420+0000","last_became_peered":"2026-02-13T03:34:15.117420+0000","last_unstale":"2026-02-13T03:34:16.111152+0000","last_undegraded":"2026-02-13T03:34:16.111152+0000","last_fullsized":"2026-02-13T03:34:16.111152+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:53:17.688410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910011+0000","last_change":"2026-02-13T03:34:15.117960+0000","last_active":"2026-02-13T03:34:16.910011+0000","last_peered":"2026-02-13T03:34:16.910011+0000","last_clean":"2026-02-13T03:34:16.910011+0000","last_became_active":"2026-02-13T03:34:15.117819+0000","last_became_peered":"2026-02-13T03:34:15.117819+0000","last_unstale":"2026-02-13T03:34:16.910011+0000","last_undegraded":"2026-02-13T03:34:16.910011+0000","last_fullsized":"2026-02-13T03:34:16.910011+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:53:45.980536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909998+0000","last_change":"2026-02-13T03:34:15.113255+0000","last_active":"2026-02-13T03:34:16.909998+0000","last_peered":"2026-02-13T03:34:16.909998+0000","last_clean":"2026-02-13T03:34:16.909998+0000","last_became_active":"2026-02-13T03:34:15.112672+0000","last_became_peered":"2026-02-13T03:34:15.112672+0000","last_unstale":"2026-02-13T03:34:16.909998+0000","last_undegraded":"2026-02-13T03:34:16.909998+0000","last_fullsized":"2026-02-13T03:34:16.909998+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:28:34.724819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.920815+0000","last_change":"2026-02-13T03:34:15.127054+0000","last_active":"2026-02-13T03:34:16.920815+0000","last_peered":"2026-02-13T03:34:16.920815+0000","last_clean":"2026-02-13T03:34:16.920815+0000","last_became_active":"2026-02-13T03:34:15.126826+0000","last_became_peered":"2026-02-13T03:34:15.126826+0000","last_unstale":"2026-02-13T03:34:16.920815+0000","last_undegraded":"2026-02-13T03:34:16.920815+0000","last_fullsized":"2026-02-13T03:34:16.920815+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:07:27.160289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.949262+0000","last_change":"2026-02-13T03:34:15.119834+0000","last_active":"2026-02-13T03:34:16.949262+0000","last_peered":"2026-02-13T03:34:16.949262+0000","last_clean":"2026-02-13T03:34:16.949262+0000","last_became_active":"2026-02-13T03:34:15.119509+0000","last_became_peered":"2026-02-13T03:34:15.119509+0000","last_unstale":"2026-02-13T03:34:16.949262+0000","last_undegraded":"2026-02-13T03:34:16.949262+0000","last_fullsized":"2026-02-13T03:34:16.949262+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:42:38.192170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111254+0000","last_change":"2026-02-13T03:34:15.118027+0000","last_active":"2026-02-13T03:34:16.111254+0000","last_peered":"2026-02-13T03:34:16.111254+0000","last_clean":"2026-02-13T03:34:16.111254+0000","last_became_active":"2026-02-13T03:34:15.117809+0000","last_became_peered":"2026-02-13T03:34:15.117809+0000","last_unstale":"2026-02-13T03:34:16.111254+0000","last_undegraded":"2026-02-13T03:34:16.111254+0000","last_fullsized":"2026-02-13T03:34:16.111254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:45:41.985508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910174+0000","last_change":"2026-02-13T03:34:15.117192+0000","last_active":"2026-02-13T03:34:16.910174+0000","last_peered":"2026-02-13T03:34:16.910174+0000","last_clean":"2026-02-13T03:34:16.910174+0000","last_became_active":"2026-02-13T03:34:15.116925+0000","last_became_peered":"2026-02-13T03:34:15.116925+0000","last_unstale":"2026-02-13T03:34:16.910174+0000","last_undegraded":"2026-02-13T03:34:16.910174+0000","last_fullsized":"2026-02-13T03:34:16.910174+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:02:01.642379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.948882+0000","last_change":"2026-02-13T03:34:15.118668+0000","last_active":"2026-02-13T03:34:16.948882+0000","last_peered":"2026-02-13T03:34:16.948882+0000","last_clean":"2026-02-13T03:34:16.948882+0000","last_became_active":"2026-02-13T03:34:15.118217+0000","last_became_peered":"2026-02-13T03:34:15.118217+0000","last_unstale":"2026-02-13T03:34:16.948882+0000","last_undegraded":"2026-02-13T03:34:16.948882+0000","last_fullsized":"2026-02-13T03:34:16.948882+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:19:35.001241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111259+0000","last_change":"2026-02-13T03:34:15.116906+0000","last_active":"2026-02-13T03:34:16.111259+0000","last_peered":"2026-02-13T03:34:16.111259+0000","last_clean":"2026-02-13T03:34:16.111259+0000","last_became_active":"2026-02-13T03:34:15.116699+0000","last_became_peered":"2026-02-13T03:34:15.116699+0000","last_unstale":"2026-02-13T03:34:16.111259+0000","last_undegraded":"2026-02-13T03:34:16.111259+0000","last_fullsized":"2026-02-13T03:34:16.111259+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:47:23.331768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.920953+0000","last_change":"2026-02-13T03:34:15.127773+0000","last_active":"2026-02-13T03:34:16.920953+0000","last_peered":"2026-02-13T03:34:16.920953+0000","last_clean":"2026-02-13T03:34:16.920953+0000","last_became_active":"2026-02-13T03:34:15.127473+0000","last_became_peered":"2026-02-13T03:34:15.127473+0000","last_unstale":"2026-02-13T03:34:16.920953+0000","last_undegraded":"2026-02-13T03:34:16.920953+0000","last_fullsized":"2026-02-13T03:34:16.920953+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:27:08.244945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.790949+0000","last_change":"2026-02-13T03:34:15.118782+0000","last_active":"2026-02-13T03:34:16.790949+0000","last_peered":"2026-02-13T03:34:16.790949+0000","last_clean":"2026-02-13T03:34:16.790949+0000","last_became_active":"2026-02-13T03:34:15.117896+0000","last_became_peered":"2026-02-13T03:34:15.117896+0000","last_unstale":"2026-02-13T03:34:16.790949+0000","last_undegraded":"2026-02-13T03:34:16.790949+0000","last_fullsized":"2026-02-13T03:34:16.790949+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:21:00.365223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110942+0000","last_change":"2026-02-13T03:34:15.117507+0000","last_active":"2026-02-13T03:34:16.110942+0000","last_peered":"2026-02-13T03:34:16.110942+0000","last_clean":"2026-02-13T03:34:16.110942+0000","last_became_active":"2026-02-13T03:34:15.117084+0000","last_became_peered":"2026-02-13T03:34:15.117084+0000","last_unstale":"2026-02-13T03:34:16.110942+0000","last_undegraded":"2026-02-13T03:34:16.110942+0000","last_fullsized":"2026-02-13T03:34:16.110942+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:08:11.739974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791306+0000","last_change":"2026-02-13T03:34:15.120007+0000","last_active":"2026-02-13T03:34:16.791306+0000","last_peered":"2026-02-13T03:34:16.791306+0000","last_clean":"2026-02-13T03:34:16.791306+0000","last_became_active":"2026-02-13T03:34:15.119271+0000","last_became_peered":"2026-02-13T03:34:15.119271+0000","last_unstale":"2026-02-13T03:34:16.791306+0000","last_undegraded":"2026-02-13T03:34:16.791306+0000","last_fullsized":"2026-02-13T03:34:16.791306+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:40:54.160572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910319+0000","last_change":"2026-02-13T03:34:15.115991+0000","last_active":"2026-02-13T03:34:16.910319+0000","last_peered":"2026-02-13T03:34:16.910319+0000","last_clean":"2026-02-13T03:34:16.910319+0000","last_became_active":"2026-02-13T03:34:15.115795+0000","last_became_peered":"2026-02-13T03:34:15.115795+0000","last_unstale":"2026-02-13T03:34:16.910319+0000","last_undegraded":"2026-02-13T03:34:16.910319+0000","last_fullsized":"2026-02-13T03:34:16.910319+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:08:10.245339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.949096+0000","last_change":"2026-02-13T03:34:15.117921+0000","last_active":"2026-02-13T03:34:16.949096+0000","last_peered":"2026-02-13T03:34:16.949096+0000","last_clean":"2026-02-13T03:34:16.949096+0000","last_became_active":"2026-02-13T03:34:15.117628+0000","last_became_peered":"2026-02-13T03:34:15.117628+0000","last_unstale":"2026-02-13T03:34:16.949096+0000","last_undegraded":"2026-02-13T03:34:16.949096+0000","last_fullsized":"2026-02-13T03:34:16.949096+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:48:11.389400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111141+0000","last_change":"2026-02-13T03:34:15.115046+0000","last_active":"2026-02-13T03:34:16.111141+0000","last_peered":"2026-02-13T03:34:16.111141+0000","last_clean":"2026-02-13T03:34:16.111141+0000","last_became_active":"2026-02-13T03:34:15.114250+0000","last_became_peered":"2026-02-13T03:34:15.114250+0000","last_unstale":"2026-02-13T03:34:16.111141+0000","last_undegraded":"2026-02-13T03:34:16.111141+0000","last_fullsized":"2026-02-13T03:34:16.111141+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:58:56.156972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910188+0000","last_change":"2026-02-13T03:34:15.114493+0000","last_active":"2026-02-13T03:34:16.910188+0000","last_peered":"2026-02-13T03:34:16.910188+0000","last_clean":"2026-02-13T03:34:16.910188+0000","last_became_active":"2026-02-13T03:34:15.114096+0000","last_became_peered":"2026-02-13T03:34:15.114096+0000","last_unstale":"2026-02-13T03:34:16.910188+0000","last_undegraded":"2026-02-13T03:34:16.910188+0000","last_fullsized":"2026-02-13T03:34:16.910188+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:26:07.768976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909836+0000","last_change":"2026-02-13T03:34:15.116564+0000","last_active":"2026-02-13T03:34:16.909836+0000","last_peered":"2026-02-13T03:34:16.909836+0000","last_clean":"2026-02-13T03:34:16.909836+0000","last_became_active":"2026-02-13T03:34:15.116345+0000","last_became_peered":"2026-02-13T03:34:15.116345+0000","last_unstale":"2026-02-13T03:34:16.909836+0000","last_undegraded":"2026-02-13T03:34:16.909836+0000","last_fullsized":"2026-02-13T03:34:16.909836+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:52:47.350389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909938+0000","last_change":"2026-02-13T03:34:15.117449+0000","last_active":"2026-02-13T03:34:16.909938+0000","last_peered":"2026-02-13T03:34:16.909938+0000","last_clean":"2026-02-13T03:34:16.909938+0000","last_became_active":"2026-02-13T03:34:15.117220+0000","last_became_peered":"2026-02-13T03:34:15.117220+0000","last_unstale":"2026-02-13T03:34:16.909938+0000","last_undegraded":"2026-02-13T03:34:16.909938+0000","last_fullsized":"2026-02-13T03:34:16.909938+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:38:43.911384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.948915+0000","last_change":"2026-02-13T03:34:15.118184+0000","last_active":"2026-02-13T03:34:16.948915+0000","last_peered":"2026-02-13T03:34:16.948915+0000","last_clean":"2026-02-13T03:34:16.948915+0000","last_became_active":"2026-02-13T03:34:15.117890+0000","last_became_peered":"2026-02-13T03:34:15.117890+0000","last_unstale":"2026-02-13T03:34:16.948915+0000","last_undegraded":"2026-02-13T03:34:16.948915+0000","last_fullsized":"2026-02-13T03:34:16.948915+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:22:03.620680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909815+0000","last_change":"2026-02-13T03:34:15.116404+0000","last_active":"2026-02-13T03:34:16.909815+0000","last_peered":"2026-02-13T03:34:16.909815+0000","last_clean":"2026-02-13T03:34:16.909815+0000","last_became_active":"2026-02-13T03:34:15.116094+0000","last_became_peered":"2026-02-13T03:34:15.116094+0000","last_unstale":"2026-02-13T03:34:16.909815+0000","last_undegraded":"2026-02-13T03:34:16.909815+0000","last_fullsized":"2026-02-13T03:34:16.909815+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:58:39.719264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"68'6","reported_seq":32,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:25.142155+0000","last_change":"2026-02-13T03:34:14.110943+0000","last_active":"2026-02-13T03:34:25.142155+0000","last_peered":"2026-02-13T03:34:25.142155+0000","last_clean":"2026-02-13T03:34:25.142155+0000","last_became_active":"2026-02-13T03:34:14.110502+0000","last_became_peered":"2026-02-13T03:34:14.110502+0000","last_unstale":"2026-02-13T03:34:25.142155+0000","last_undegraded":"2026-02-13T03:34:25.142155+0000","last_fullsized":"2026-02-13T03:34:25.142155+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:59:08.057823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110955+0000","last_change":"2026-02-13T03:34:15.118165+0000","last_active":"2026-02-13T03:34:16.110955+0000","last_peered":"2026-02-13T03:34:16.110955+0000","last_clean":"2026-02-13T03:34:16.110955+0000","last_became_active":"2026-02-13T03:34:15.117801+0000","last_became_peered":"2026-02-13T03:34:15.117801+0000","last_unstale":"2026-02-13T03:34:16.110955+0000","last_undegraded":"2026-02-13T03:34:16.110955+0000","last_fullsized":"2026-02-13T03:34:16.110955+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:01:06.764674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"68'3","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.147034+0000","last_change":"2026-02-13T03:34:14.119861+0000","last_active":"2026-02-13T03:34:19.147034+0000","last_peered":"2026-02-13T03:34:19.147034+0000","last_clean":"2026-02-13T03:34:19.147034+0000","last_became_active":"2026-02-13T03:34:14.119689+0000","last_became_peered":"2026-02-13T03:34:14.119689+0000","last_unstale":"2026-02-13T03:34:19.147034+0000","last_undegraded":"2026-02-13T03:34:19.147034+0000","last_fullsized":"2026-02-13T03:34:19.147034+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:43:33.601163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"68'2","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.136796+0000","last_change":"2026-02-13T03:34:14.107989+0000","last_active":"2026-02-13T03:34:19.136796+0000","last_peered":"2026-02-13T03:34:19.136796+0000","last_clean":"2026-02-13T03:34:19.136796+0000","last_became_active":"2026-02-13T03:34:14.107837+0000","last_became_peered":"2026-02-13T03:34:14.107837+0000","last_unstale":"2026-02-13T03:34:19.136796+0000","last_undegraded":"2026-02-13T03:34:19.136796+0000","last_fullsized":"2026-02-13T03:34:19.136796+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:20:23.452500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791223+0000","last_change":"2026-02-13T03:34:15.118354+0000","last_active":"2026-02-13T03:34:16.791223+0000","last_peered":"2026-02-13T03:34:16.791223+0000","last_clean":"2026-02-13T03:34:16.791223+0000","last_became_active":"2026-02-13T03:34:15.117486+0000","last_became_peered":"2026-02-13T03:34:15.117486+0000","last_unstale":"2026-02-13T03:34:16.791223+0000","last_undegraded":"2026-02-13T03:34:16.791223+0000","last_fullsized":"2026-02-13T03:34:16.791223+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:19:01.304754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"68'1","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.962330+0000","last_change":"2026-02-13T03:34:14.111386+0000","last_active":"2026-02-13T03:34:16.962330+0000","last_peered":"2026-02-13T03:34:16.962330+0000","last_clean":"2026-02-13T03:34:16.962330+0000","last_became_active":"2026-02-13T03:34:14.110945+0000","last_became_peered":"2026-02-13T03:34:14.110945+0000","last_unstale":"2026-02-13T03:34:16.962330+0000","last_undegraded":"2026-02-13T03:34:16.962330+0000","last_fullsized":"2026-02-13T03:34:16.962330+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:44:31.307711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111198+0000","last_change":"2026-02-13T03:34:15.117944+0000","last_active":"2026-02-13T03:34:16.111198+0000","last_peered":"2026-02-13T03:34:16.111198+0000","last_clean":"2026-02-13T03:34:16.111198+0000","last_became_active":"2026-02-13T03:34:15.117759+0000","last_became_peered":"2026-02-13T03:34:15.117759+0000","last_unstale":"2026-02-13T03:34:16.111198+0000","last_undegraded":"2026-02-13T03:34:16.111198+0000","last_fullsized":"2026-02-13T03:34:16.111198+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:31:00.846376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"68'3","reported_seq":26,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:25.152944+0000","last_change":"2026-02-13T03:34:14.122123+0000","last_active":"2026-02-13T03:34:25.152944+0000","last_peered":"2026-02-13T03:34:25.152944+0000","last_clean":"2026-02-13T03:34:25.152944+0000","last_became_active":"2026-02-13T03:34:14.122016+0000","last_became_peered":"2026-02-13T03:34:14.122016+0000","last_unstale":"2026-02-13T03:34:25.152944+0000","last_undegraded":"2026-02-13T03:34:25.152944+0000","last_fullsized":"2026-02-13T03:34:25.152944+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:38:07.386544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.921138+0000","last_change":"2026-02-13T03:34:15.129944+0000","last_active":"2026-02-13T03:34:16.921138+0000","last_peered":"2026-02-13T03:34:16.921138+0000","last_clean":"2026-02-13T03:34:16.921138+0000","last_became_active":"2026-02-13T03:34:15.129500+0000","last_became_peered":"2026-02-13T03:34:15.129500+0000","last_unstale":"2026-02-13T03:34:16.921138+0000","last_undegraded":"2026-02-13T03:34:16.921138+0000","last_fullsized":"2026-02-13T03:34:16.921138+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:04:46.496972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"68'2","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.142125+0000","last_change":"2026-02-13T03:34:14.120290+0000","last_active":"2026-02-13T03:34:18.142125+0000","last_peered":"2026-02-13T03:34:18.142125+0000","last_clean":"2026-02-13T03:34:18.142125+0000","last_became_active":"2026-02-13T03:34:14.120111+0000","last_became_peered":"2026-02-13T03:34:14.120111+0000","last_unstale":"2026-02-13T03:34:18.142125+0000","last_undegraded":"2026-02-13T03:34:18.142125+0000","last_fullsized":"2026-02-13T03:34:18.142125+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:02:12.116257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910374+0000","last_change":"2026-02-13T03:34:15.118561+0000","last_active":"2026-02-13T03:34:16.910374+0000","last_peered":"2026-02-13T03:34:16.910374+0000","last_clean":"2026-02-13T03:34:16.910374+0000","last_became_active":"2026-02-13T03:34:15.118392+0000","last_became_peered":"2026-02-13T03:34:15.118392+0000","last_unstale":"2026-02-13T03:34:16.910374+0000","last_undegraded":"2026-02-13T03:34:16.910374+0000","last_fullsized":"2026-02-13T03:34:16.910374+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:27:31.164818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"68'4","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.131542+0000","last_change":"2026-02-13T03:34:14.111107+0000","last_active":"2026-02-13T03:34:18.131542+0000","last_peered":"2026-02-13T03:34:18.131542+0000","last_clean":"2026-02-13T03:34:18.131542+0000","last_became_active":"2026-02-13T03:34:14.110113+0000","last_became_peered":"2026-02-13T03:34:14.110113+0000","last_unstale":"2026-02-13T03:34:18.131542+0000","last_undegraded":"2026-02-13T03:34:18.131542+0000","last_fullsized":"2026-02-13T03:34:18.131542+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:34:31.930234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.920945+0000","last_change":"2026-02-13T03:34:15.127705+0000","last_active":"2026-02-13T03:34:16.920945+0000","last_peered":"2026-02-13T03:34:16.920945+0000","last_clean":"2026-02-13T03:34:16.920945+0000","last_became_active":"2026-02-13T03:34:15.127292+0000","last_became_peered":"2026-02-13T03:34:15.127292+0000","last_unstale":"2026-02-13T03:34:16.920945+0000","last_undegraded":"2026-02-13T03:34:16.920945+0000","last_fullsized":"2026-02-13T03:34:16.920945+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:08:59.692931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"68'22","reported_seq":57,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:26.155669+0000","last_change":"2026-02-13T03:34:14.121451+0000","last_active":"2026-02-13T03:34:26.155669+0000","last_peered":"2026-02-13T03:34:26.155669+0000","last_clean":"2026-02-13T03:34:26.155669+0000","last_became_active":"2026-02-13T03:34:14.121350+0000","last_became_peered":"2026-02-13T03:34:14.121350+0000","last_unstale":"2026-02-13T03:34:26.155669+0000","last_undegraded":"2026-02-13T03:34:26.155669+0000","last_fullsized":"2026-02-13T03:34:26.155669+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:36:35.041824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52844,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":61,"num_write":23,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909996+0000","last_change":"2026-02-13T03:34:15.116911+0000","last_active":"2026-02-13T03:34:16.909996+0000","last_peered":"2026-02-13T03:34:16.909996+0000","last_clean":"2026-02-13T03:34:16.909996+0000","last_became_active":"2026-02-13T03:34:15.116542+0000","last_became_peered":"2026-02-13T03:34:15.116542+0000","last_unstale":"2026-02-13T03:34:16.909996+0000","last_undegraded":"2026-02-13T03:34:16.909996+0000","last_fullsized":"2026-02-13T03:34:16.909996+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:51:00.767989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"68'6","reported_seq":23,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.135867+0000","last_change":"2026-02-13T03:34:14.110089+0000","last_active":"2026-02-13T03:34:19.135867+0000","last_peered":"2026-02-13T03:34:19.135867+0000","last_clean":"2026-02-13T03:34:19.135867+0000","last_became_active":"2026-02-13T03:34:14.109857+0000","last_became_peered":"2026-02-13T03:34:14.109857+0000","last_unstale":"2026-02-13T03:34:19.135867+0000","last_undegraded":"2026-02-13T03:34:19.135867+0000","last_fullsized":"2026-02-13T03:34:19.135867+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:28:26.120434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110999+0000","last_change":"2026-02-13T03:34:15.117207+0000","last_active":"2026-02-13T03:34:16.110999+0000","last_peered":"2026-02-13T03:34:16.110999+0000","last_clean":"2026-02-13T03:34:16.110999+0000","last_became_active":"2026-02-13T03:34:15.117080+0000","last_became_peered":"2026-02-13T03:34:15.117080+0000","last_unstale":"2026-02-13T03:34:16.110999+0000","last_undegraded":"2026-02-13T03:34:16.110999+0000","last_fullsized":"2026-02-13T03:34:16.110999+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:10:21.048259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"68'3","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.131713+0000","last_change":"2026-02-13T03:34:14.110249+0000","last_active":"2026-02-13T03:34:18.131713+0000","last_peered":"2026-02-13T03:34:18.131713+0000","last_clean":"2026-02-13T03:34:18.131713+0000","last_became_active":"2026-02-13T03:34:14.109916+0000","last_became_peered":"2026-02-13T03:34:14.109916+0000","last_unstale":"2026-02-13T03:34:18.131713+0000","last_undegraded":"2026-02-13T03:34:18.131713+0000","last_fullsized":"2026-02-13T03:34:18.131713+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:10:50.121909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.178258+0000","last_change":"2026-02-13T03:34:15.128143+0000","last_active":"2026-02-13T03:34:16.178258+0000","last_peered":"2026-02-13T03:34:16.178258+0000","last_clean":"2026-02-13T03:34:16.178258+0000","last_became_active":"2026-02-13T03:34:15.128030+0000","last_became_peered":"2026-02-13T03:34:15.128030+0000","last_unstale":"2026-02-13T03:34:16.178258+0000","last_undegraded":"2026-02-13T03:34:16.178258+0000","last_fullsized":"2026-02-13T03:34:16.178258+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:06:52.963812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"68'3","reported_seq":28,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:25.153781+0000","last_change":"2026-02-13T03:34:14.119064+0000","last_active":"2026-02-13T03:34:25.153781+0000","last_peered":"2026-02-13T03:34:25.153781+0000","last_clean":"2026-02-13T03:34:25.153781+0000","last_became_active":"2026-02-13T03:34:14.118830+0000","last_became_peered":"2026-02-13T03:34:14.118830+0000","last_unstale":"2026-02-13T03:34:25.153781+0000","last_undegraded":"2026-02-13T03:34:25.153781+0000","last_fullsized":"2026-02-13T03:34:25.153781+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:53:25.966883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.177842+0000","last_change":"2026-02-13T03:34:15.129037+0000","last_active":"2026-02-13T03:34:16.177842+0000","last_peered":"2026-02-13T03:34:16.177842+0000","last_clean":"2026-02-13T03:34:16.177842+0000","last_became_active":"2026-02-13T03:34:15.128632+0000","last_became_peered":"2026-02-13T03:34:15.128632+0000","last_unstale":"2026-02-13T03:34:16.177842+0000","last_undegraded":"2026-02-13T03:34:16.177842+0000","last_fullsized":"2026-02-13T03:34:16.177842+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:19:22.180885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"68'15","reported_seq":32,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.136911+0000","last_change":"2026-02-13T03:34:14.110318+0000","last_active":"2026-02-13T03:34:19.136911+0000","last_peered":"2026-02-13T03:34:19.136911+0000","last_clean":"2026-02-13T03:34:19.136911+0000","last_became_active":"2026-02-13T03:34:14.109648+0000","last_became_peered":"2026-02-13T03:34:14.109648+0000","last_unstale":"2026-02-13T03:34:19.136911+0000","last_undegraded":"2026-02-13T03:34:19.136911+0000","last_fullsized":"2026-02-13T03:34:19.136911+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:06:33.574407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110988+0000","last_change":"2026-02-13T03:34:15.116762+0000","last_active":"2026-02-13T03:34:16.110988+0000","last_peered":"2026-02-13T03:34:16.110988+0000","last_clean":"2026-02-13T03:34:16.110988+0000","last_became_active":"2026-02-13T03:34:15.116280+0000","last_became_peered":"2026-02-13T03:34:15.116280+0000","last_unstale":"2026-02-13T03:34:16.110988+0000","last_undegraded":"2026-02-13T03:34:16.110988+0000","last_fullsized":"2026-02-13T03:34:16.110988+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:36:18.141037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"68'2","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:20.137496+0000","last_change":"2026-02-13T03:34:14.110976+0000","last_active":"2026-02-13T03:34:20.137496+0000","last_peered":"2026-02-13T03:34:20.137496+0000","last_clean":"2026-02-13T03:34:20.137496+0000","last_became_active":"2026-02-13T03:34:14.110717+0000","last_became_peered":"2026-02-13T03:34:14.110717+0000","last_unstale":"2026-02-13T03:34:20.137496+0000","last_undegraded":"2026-02-13T03:34:20.137496+0000","last_fullsized":"2026-02-13T03:34:20.137496+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:25:27.336312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.949109+0000","last_change":"2026-02-13T03:34:15.118326+0000","last_active":"2026-02-13T03:34:16.949109+0000","last_peered":"2026-02-13T03:34:16.949109+0000","last_clean":"2026-02-13T03:34:16.949109+0000","last_became_active":"2026-02-13T03:34:15.117977+0000","last_became_peered":"2026-02-13T03:34:15.117977+0000","last_unstale":"2026-02-13T03:34:16.949109+0000","last_undegraded":"2026-02-13T03:34:16.949109+0000","last_fullsized":"2026-02-13T03:34:16.949109+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:43:03.579176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"67'2","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111152+0000","last_change":"2026-02-13T03:34:14.109555+0000","last_active":"2026-02-13T03:34:16.111152+0000","last_peered":"2026-02-13T03:34:16.111152+0000","last_clean":"2026-02-13T03:34:16.111152+0000","last_became_active":"2026-02-13T03:34:14.109369+0000","last_became_peered":"2026-02-13T03:34:14.109369+0000","last_unstale":"2026-02-13T03:34:16.111152+0000","last_undegraded":"2026-02-13T03:34:16.111152+0000","last_fullsized":"2026-02-13T03:34:16.111152+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:16:14.530159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.178325+0000","last_change":"2026-02-13T03:34:15.126930+0000","last_active":"2026-02-13T03:34:16.178325+0000","last_peered":"2026-02-13T03:34:16.178325+0000","last_clean":"2026-02-13T03:34:16.178325+0000","last_became_active":"2026-02-13T03:34:15.126768+0000","last_became_peered":"2026-02-13T03:34:15.126768+0000","last_unstale":"2026-02-13T03:34:16.178325+0000","last_undegraded":"2026-02-13T03:34:16.178325+0000","last_fullsized":"2026-02-13T03:34:16.178325+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:15:08.856303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"67'1","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.962366+0000","last_change":"2026-02-13T03:34:14.110533+0000","last_active":"2026-02-13T03:34:16.962366+0000","last_peered":"2026-02-13T03:34:16.962366+0000","last_clean":"2026-02-13T03:34:16.962366+0000","last_became_active":"2026-02-13T03:34:14.109851+0000","last_became_peered":"2026-02-13T03:34:14.109851+0000","last_unstale":"2026-02-13T03:34:16.962366+0000","last_undegraded":"2026-02-13T03:34:16.962366+0000","last_fullsized":"2026-02-13T03:34:16.962366+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:30:58.184043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"68'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:17.182704+0000","last_change":"2026-02-13T03:34:15.128728+0000","last_active":"2026-02-13T03:34:17.182704+0000","last_peered":"2026-02-13T03:34:17.182704+0000","last_clean":"2026-02-13T03:34:17.182704+0000","last_became_active":"2026-02-13T03:34:15.128579+0000","last_became_peered":"2026-02-13T03:34:15.128579+0000","last_unstale":"2026-02-13T03:34:17.182704+0000","last_undegraded":"2026-02-13T03:34:17.182704+0000","last_fullsized":"2026-02-13T03:34:17.182704+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:05:25.697309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"68'3","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.136336+0000","last_change":"2026-02-13T03:34:14.112417+0000","last_active":"2026-02-13T03:34:19.136336+0000","last_peered":"2026-02-13T03:34:19.136336+0000","last_clean":"2026-02-13T03:34:19.136336+0000","last_became_active":"2026-02-13T03:34:14.112282+0000","last_became_peered":"2026-02-13T03:34:14.112282+0000","last_unstale":"2026-02-13T03:34:19.136336+0000","last_undegraded":"2026-02-13T03:34:19.136336+0000","last_fullsized":"2026-02-13T03:34:19.136336+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:54:26.443931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.178303+0000","last_change":"2026-02-13T03:34:15.128773+0000","last_active":"2026-02-13T03:34:16.178303+0000","last_peered":"2026-02-13T03:34:16.178303+0000","last_clean":"2026-02-13T03:34:16.178303+0000","last_became_active":"2026-02-13T03:34:15.128614+0000","last_became_peered":"2026-02-13T03:34:15.128614+0000","last_unstale":"2026-02-13T03:34:16.178303+0000","last_undegraded":"2026-02-13T03:34:16.178303+0000","last_fullsized":"2026-02-13T03:34:16.178303+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:21:12.460740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'152","reported_seq":335,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.177697+0000","last_change":"2026-02-13T03:33:53.689186+0000","last_active":"2026-02-13T03:34:16.177697+0000","last_peered":"2026-02-13T03:34:16.177697+0000","last_clean":"2026-02-13T03:34:16.177697+0000","last_became_active":"2026-02-13T03:33:53.689016+0000","last_became_peered":"2026-02-13T03:33:53.689016+0000","last_unstale":"2026-02-13T03:34:16.177697+0000","last_undegraded":"2026-02-13T03:34:16.177697+0000","last_fullsized":"2026-02-13T03:34:16.177697+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:32:51.335478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:32:51.335478+0000","last_clean_scrub_stamp":"2026-02-13T03:32:51.335478+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:46:12.228415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"68'3","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:20.148489+0000","last_change":"2026-02-13T03:34:14.118073+0000","last_active":"2026-02-13T03:34:20.148489+0000","last_peered":"2026-02-13T03:34:20.148489+0000","last_clean":"2026-02-13T03:34:20.148489+0000","last_became_active":"2026-02-13T03:34:14.117930+0000","last_became_peered":"2026-02-13T03:34:14.117930+0000","last_unstale":"2026-02-13T03:34:20.148489+0000","last_undegraded":"2026-02-13T03:34:20.148489+0000","last_fullsized":"2026-02-13T03:34:20.148489+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:31:04.815698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791157+0000","last_change":"2026-02-13T03:34:15.120789+0000","last_active":"2026-02-13T03:34:16.791157+0000","last_peered":"2026-02-13T03:34:16.791157+0000","last_clean":"2026-02-13T03:34:16.791157+0000","last_became_active":"2026-02-13T03:34:15.120102+0000","last_became_peered":"2026-02-13T03:34:15.120102+0000","last_unstale":"2026-02-13T03:34:16.791157+0000","last_undegraded":"2026-02-13T03:34:16.791157+0000","last_fullsized":"2026-02-13T03:34:16.791157+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:10:29.422050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"68'3","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.147121+0000","last_change":"2026-02-13T03:34:14.119784+0000","last_active":"2026-02-13T03:34:19.147121+0000","last_peered":"2026-02-13T03:34:19.147121+0000","last_clean":"2026-02-13T03:34:19.147121+0000","last_became_active":"2026-02-13T03:34:14.119642+0000","last_became_peered":"2026-02-13T03:34:14.119642+0000","last_unstale":"2026-02-13T03:34:19.147121+0000","last_undegraded":"2026-02-13T03:34:19.147121+0000","last_fullsized":"2026-02-13T03:34:19.147121+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:15:09.988019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110957+0000","last_change":"2026-02-13T03:34:15.113490+0000","last_active":"2026-02-13T03:34:16.110957+0000","last_peered":"2026-02-13T03:34:16.110957+0000","last_clean":"2026-02-13T03:34:16.110957+0000","last_became_active":"2026-02-13T03:34:15.113119+0000","last_became_peered":"2026-02-13T03:34:15.113119+0000","last_unstale":"2026-02-13T03:34:16.110957+0000","last_undegraded":"2026-02-13T03:34:16.110957+0000","last_fullsized":"2026-02-13T03:34:16.110957+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:26:12.918710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"68'4","reported_seq":27,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:25.142855+0000","last_change":"2026-02-13T03:34:14.107155+0000","last_active":"2026-02-13T03:34:25.142855+0000","last_peered":"2026-02-13T03:34:25.142855+0000","last_clean":"2026-02-13T03:34:25.142855+0000","last_became_active":"2026-02-13T03:34:14.106966+0000","last_became_peered":"2026-02-13T03:34:14.106966+0000","last_unstale":"2026-02-13T03:34:25.142855+0000","last_undegraded":"2026-02-13T03:34:25.142855+0000","last_fullsized":"2026-02-13T03:34:25.142855+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:23:06.193832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110886+0000","last_change":"2026-02-13T03:34:15.116852+0000","last_active":"2026-02-13T03:34:16.110886+0000","last_peered":"2026-02-13T03:34:16.110886+0000","last_clean":"2026-02-13T03:34:16.110886+0000","last_became_active":"2026-02-13T03:34:15.116610+0000","last_became_peered":"2026-02-13T03:34:15.116610+0000","last_unstale":"2026-02-13T03:34:16.110886+0000","last_undegraded":"2026-02-13T03:34:16.110886+0000","last_fullsized":"2026-02-13T03:34:16.110886+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:13:33.504269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"68'1","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:17.182694+0000","last_change":"2026-02-13T03:34:14.118389+0000","last_active":"2026-02-13T03:34:17.182694+0000","last_peered":"2026-02-13T03:34:17.182694+0000","last_clean":"2026-02-13T03:34:17.182694+0000","last_became_active":"2026-02-13T03:34:14.118111+0000","last_became_peered":"2026-02-13T03:34:14.118111+0000","last_unstale":"2026-02-13T03:34:17.182694+0000","last_undegraded":"2026-02-13T03:34:17.182694+0000","last_fullsized":"2026-02-13T03:34:17.182694+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:26:09.727990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.912869+0000","last_change":"2026-02-13T03:34:15.129069+0000","last_active":"2026-02-13T03:34:16.912869+0000","last_peered":"2026-02-13T03:34:16.912869+0000","last_clean":"2026-02-13T03:34:16.912869+0000","last_became_active":"2026-02-13T03:34:15.128801+0000","last_became_peered":"2026-02-13T03:34:15.128801+0000","last_unstale":"2026-02-13T03:34:16.912869+0000","last_undegraded":"2026-02-13T03:34:16.912869+0000","last_fullsized":"2026-02-13T03:34:16.912869+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:05:14.500513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111153+0000","last_change":"2026-02-13T03:34:14.110643+0000","last_active":"2026-02-13T03:34:16.111153+0000","last_peered":"2026-02-13T03:34:16.111153+0000","last_clean":"2026-02-13T03:34:16.111153+0000","last_became_active":"2026-02-13T03:34:14.110456+0000","last_became_peered":"2026-02-13T03:34:14.110456+0000","last_unstale":"2026-02-13T03:34:16.111153+0000","last_undegraded":"2026-02-13T03:34:16.111153+0000","last_fullsized":"2026-02-13T03:34:16.111153+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:22:20.313197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"68'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.912905+0000","last_change":"2026-02-13T03:34:15.129233+0000","last_active":"2026-02-13T03:34:16.912905+0000","last_peered":"2026-02-13T03:34:16.912905+0000","last_clean":"2026-02-13T03:34:16.912905+0000","last_became_active":"2026-02-13T03:34:15.128972+0000","last_became_peered":"2026-02-13T03:34:15.128972+0000","last_unstale":"2026-02-13T03:34:16.912905+0000","last_undegraded":"2026-02-13T03:34:16.912905+0000","last_fullsized":"2026-02-13T03:34:16.912905+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:38:10.731668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"68'1","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.131327+0000","last_change":"2026-02-13T03:34:14.110025+0000","last_active":"2026-02-13T03:34:18.131327+0000","last_peered":"2026-02-13T03:34:18.131327+0000","last_clean":"2026-02-13T03:34:18.131327+0000","last_became_active":"2026-02-13T03:34:14.109687+0000","last_became_peered":"2026-02-13T03:34:14.109687+0000","last_unstale":"2026-02-13T03:34:18.131327+0000","last_undegraded":"2026-02-13T03:34:18.131327+0000","last_fullsized":"2026-02-13T03:34:18.131327+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:58:00.997107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.111247+0000","last_change":"2026-02-13T03:34:15.116452+0000","last_active":"2026-02-13T03:34:16.111247+0000","last_peered":"2026-02-13T03:34:16.111247+0000","last_clean":"2026-02-13T03:34:16.111247+0000","last_became_active":"2026-02-13T03:34:15.116297+0000","last_became_peered":"2026-02-13T03:34:15.116297+0000","last_unstale":"2026-02-13T03:34:16.111247+0000","last_undegraded":"2026-02-13T03:34:16.111247+0000","last_fullsized":"2026-02-13T03:34:16.111247+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:36:12.315236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"68'6","reported_seq":22,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:22.118379+0000","last_change":"2026-02-13T03:34:14.109823+0000","last_active":"2026-02-13T03:34:22.118379+0000","last_peered":"2026-02-13T03:34:22.118379+0000","last_clean":"2026-02-13T03:34:22.118379+0000","last_became_active":"2026-02-13T03:34:14.109688+0000","last_became_peered":"2026-02-13T03:34:14.109688+0000","last_unstale":"2026-02-13T03:34:22.118379+0000","last_undegraded":"2026-02-13T03:34:22.118379+0000","last_fullsized":"2026-02-13T03:34:22.118379+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:29:43.449201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791407+0000","last_change":"2026-02-13T03:34:15.120466+0000","last_active":"2026-02-13T03:34:16.791407+0000","last_peered":"2026-02-13T03:34:16.791407+0000","last_clean":"2026-02-13T03:34:16.791407+0000","last_became_active":"2026-02-13T03:34:15.119177+0000","last_became_peered":"2026-02-13T03:34:15.119177+0000","last_unstale":"2026-02-13T03:34:16.791407+0000","last_undegraded":"2026-02-13T03:34:16.791407+0000","last_fullsized":"2026-02-13T03:34:16.791407+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:38:14.396482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"68'4","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.142036+0000","last_change":"2026-02-13T03:34:14.123372+0000","last_active":"2026-02-13T03:34:18.142036+0000","last_peered":"2026-02-13T03:34:18.142036+0000","last_clean":"2026-02-13T03:34:18.142036+0000","last_became_active":"2026-02-13T03:34:14.123252+0000","last_became_peered":"2026-02-13T03:34:14.123252+0000","last_unstale":"2026-02-13T03:34:18.142036+0000","last_undegraded":"2026-02-13T03:34:18.142036+0000","last_fullsized":"2026-02-13T03:34:18.142036+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:12:44.138856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910239+0000","last_change":"2026-02-13T03:34:15.117238+0000","last_active":"2026-02-13T03:34:16.910239+0000","last_peered":"2026-02-13T03:34:16.910239+0000","last_clean":"2026-02-13T03:34:16.910239+0000","last_became_active":"2026-02-13T03:34:15.116951+0000","last_became_peered":"2026-02-13T03:34:15.116951+0000","last_unstale":"2026-02-13T03:34:16.910239+0000","last_undegraded":"2026-02-13T03:34:16.910239+0000","last_fullsized":"2026-02-13T03:34:16.910239+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:51:53.182871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"68'2","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.142193+0000","last_change":"2026-02-13T03:34:14.121985+0000","last_active":"2026-02-13T03:34:18.142193+0000","last_peered":"2026-02-13T03:34:18.142193+0000","last_clean":"2026-02-13T03:34:18.142193+0000","last_became_active":"2026-02-13T03:34:14.121838+0000","last_became_peered":"2026-02-13T03:34:14.121838+0000","last_unstale":"2026-02-13T03:34:18.142193+0000","last_undegraded":"2026-02-13T03:34:18.142193+0000","last_fullsized":"2026-02-13T03:34:18.142193+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:12:14.538589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909663+0000","last_change":"2026-02-13T03:34:15.117334+0000","last_active":"2026-02-13T03:34:16.909663+0000","last_peered":"2026-02-13T03:34:16.909663+0000","last_clean":"2026-02-13T03:34:16.909663+0000","last_became_active":"2026-02-13T03:34:15.117136+0000","last_became_peered":"2026-02-13T03:34:15.117136+0000","last_unstale":"2026-02-13T03:34:16.909663+0000","last_undegraded":"2026-02-13T03:34:16.909663+0000","last_fullsized":"2026-02-13T03:34:16.909663+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:09:01.863249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"68'3","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.132210+0000","last_change":"2026-02-13T03:34:14.108168+0000","last_active":"2026-02-13T03:34:18.132210+0000","last_peered":"2026-02-13T03:34:18.132210+0000","last_clean":"2026-02-13T03:34:18.132210+0000","last_became_active":"2026-02-13T03:34:14.107598+0000","last_became_peered":"2026-02-13T03:34:14.107598+0000","last_unstale":"2026-02-13T03:34:18.132210+0000","last_undegraded":"2026-02-13T03:34:18.132210+0000","last_fullsized":"2026-02-13T03:34:18.132210+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:50:40.370428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.949003+0000","last_change":"2026-02-13T03:34:15.117553+0000","last_active":"2026-02-13T03:34:16.949003+0000","last_peered":"2026-02-13T03:34:16.949003+0000","last_clean":"2026-02-13T03:34:16.949003+0000","last_became_active":"2026-02-13T03:34:15.117298+0000","last_became_peered":"2026-02-13T03:34:15.117298+0000","last_unstale":"2026-02-13T03:34:16.949003+0000","last_undegraded":"2026-02-13T03:34:16.949003+0000","last_fullsized":"2026-02-13T03:34:16.949003+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:52:30.525618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"68'1","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909868+0000","last_change":"2026-02-13T03:34:14.110063+0000","last_active":"2026-02-13T03:34:16.909868+0000","last_peered":"2026-02-13T03:34:16.909868+0000","last_clean":"2026-02-13T03:34:16.909868+0000","last_became_active":"2026-02-13T03:34:14.109758+0000","last_became_peered":"2026-02-13T03:34:14.109758+0000","last_unstale":"2026-02-13T03:34:16.909868+0000","last_undegraded":"2026-02-13T03:34:16.909868+0000","last_fullsized":"2026-02-13T03:34:16.909868+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:51:44.239059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791368+0000","last_change":"2026-02-13T03:34:15.119669+0000","last_active":"2026-02-13T03:34:16.791368+0000","last_peered":"2026-02-13T03:34:16.791368+0000","last_clean":"2026-02-13T03:34:16.791368+0000","last_became_active":"2026-02-13T03:34:15.118420+0000","last_became_peered":"2026-02-13T03:34:15.118420+0000","last_unstale":"2026-02-13T03:34:16.791368+0000","last_undegraded":"2026-02-13T03:34:16.791368+0000","last_fullsized":"2026-02-13T03:34:16.791368+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:55:45.147665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"68'4","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:18.131421+0000","last_change":"2026-02-13T03:34:14.110926+0000","last_active":"2026-02-13T03:34:18.131421+0000","last_peered":"2026-02-13T03:34:18.131421+0000","last_clean":"2026-02-13T03:34:18.131421+0000","last_became_active":"2026-02-13T03:34:14.110536+0000","last_became_peered":"2026-02-13T03:34:14.110536+0000","last_unstale":"2026-02-13T03:34:18.131421+0000","last_undegraded":"2026-02-13T03:34:18.131421+0000","last_fullsized":"2026-02-13T03:34:18.131421+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:44:35.738382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.178106+0000","last_change":"2026-02-13T03:34:15.127444+0000","last_active":"2026-02-13T03:34:16.178106+0000","last_peered":"2026-02-13T03:34:16.178106+0000","last_clean":"2026-02-13T03:34:16.178106+0000","last_became_active":"2026-02-13T03:34:15.127294+0000","last_became_peered":"2026-02-13T03:34:15.127294+0000","last_unstale":"2026-02-13T03:34:16.178106+0000","last_undegraded":"2026-02-13T03:34:16.178106+0000","last_fullsized":"2026-02-13T03:34:16.178106+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:17:49.248022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.110987+0000","last_change":"2026-02-13T03:34:15.117263+0000","last_active":"2026-02-13T03:34:16.110987+0000","last_peered":"2026-02-13T03:34:16.110987+0000","last_clean":"2026-02-13T03:34:16.110987+0000","last_became_active":"2026-02-13T03:34:15.116892+0000","last_became_peered":"2026-02-13T03:34:15.116892+0000","last_unstale":"2026-02-13T03:34:16.110987+0000","last_undegraded":"2026-02-13T03:34:16.110987+0000","last_fullsized":"2026-02-13T03:34:16.110987+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:06:22.105812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"67'2","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.909913+0000","last_change":"2026-02-13T03:34:14.109993+0000","last_active":"2026-02-13T03:34:16.909913+0000","last_peered":"2026-02-13T03:34:16.909913+0000","last_clean":"2026-02-13T03:34:16.909913+0000","last_became_active":"2026-02-13T03:34:14.109138+0000","last_became_peered":"2026-02-13T03:34:14.109138+0000","last_unstale":"2026-02-13T03:34:16.909913+0000","last_undegraded":"2026-02-13T03:34:16.909913+0000","last_fullsized":"2026-02-13T03:34:16.909913+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:17:43.296418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.920946+0000","last_change":"2026-02-13T03:34:15.128408+0000","last_active":"2026-02-13T03:34:16.920946+0000","last_peered":"2026-02-13T03:34:16.920946+0000","last_clean":"2026-02-13T03:34:16.920946+0000","last_became_active":"2026-02-13T03:34:15.128196+0000","last_became_peered":"2026-02-13T03:34:15.128196+0000","last_unstale":"2026-02-13T03:34:16.920946+0000","last_undegraded":"2026-02-13T03:34:16.920946+0000","last_fullsized":"2026-02-13T03:34:16.920946+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:02:00.806973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"68'4","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.135705+0000","last_change":"2026-02-13T03:34:14.110147+0000","last_active":"2026-02-13T03:34:19.135705+0000","last_peered":"2026-02-13T03:34:19.135705+0000","last_clean":"2026-02-13T03:34:19.135705+0000","last_became_active":"2026-02-13T03:34:14.109661+0000","last_became_peered":"2026-02-13T03:34:14.109661+0000","last_unstale":"2026-02-13T03:34:19.135705+0000","last_undegraded":"2026-02-13T03:34:19.135705+0000","last_fullsized":"2026-02-13T03:34:19.135705+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:51:07.074657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.910343+0000","last_change":"2026-02-13T03:34:15.116693+0000","last_active":"2026-02-13T03:34:16.910343+0000","last_peered":"2026-02-13T03:34:16.910343+0000","last_clean":"2026-02-13T03:34:16.910343+0000","last_became_active":"2026-02-13T03:34:15.116374+0000","last_became_peered":"2026-02-13T03:34:15.116374+0000","last_unstale":"2026-02-13T03:34:16.910343+0000","last_undegraded":"2026-02-13T03:34:16.910343+0000","last_fullsized":"2026-02-13T03:34:16.910343+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:13:05.738784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"68'2","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:17.784382+0000","last_change":"2026-02-13T03:34:14.110655+0000","last_active":"2026-02-13T03:34:17.784382+0000","last_peered":"2026-02-13T03:34:17.784382+0000","last_clean":"2026-02-13T03:34:17.784382+0000","last_became_active":"2026-02-13T03:34:14.110497+0000","last_became_peered":"2026-02-13T03:34:14.110497+0000","last_unstale":"2026-02-13T03:34:17.784382+0000","last_undegraded":"2026-02-13T03:34:17.784382+0000","last_fullsized":"2026-02-13T03:34:17.784382+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:31:10.990787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:16.791316+0000","last_change":"2026-02-13T03:34:15.120370+0000","last_active":"2026-02-13T03:34:16.791316+0000","last_peered":"2026-02-13T03:34:16.791316+0000","last_clean":"2026-02-13T03:34:16.791316+0000","last_became_active":"2026-02-13T03:34:15.119060+0000","last_became_peered":"2026-02-13T03:34:15.119060+0000","last_unstale":"2026-02-13T03:34:16.791316+0000","last_undegraded":"2026-02-13T03:34:16.791316+0000","last_fullsized":"2026-02-13T03:34:16.791316+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:14.101978+0000","last_clean_scrub_stamp":"2026-02-13T03:34:14.101978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:53:52.717845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"68'9","reported_seq":26,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-13T03:34:19.136718+0000","last_change":"2026-02-13T03:34:14.109926+0000","last_active":"2026-02-13T03:34:19.136718+0000","last_peered":"2026-02-13T03:34:19.136718+0000","last_clean":"2026-02-13T03:34:19.136718+0000","last_became_active":"2026-02-13T03:34:14.109787+0000","last_became_peered":"2026-02-13T03:34:14.109787+0000","last_unstale":"2026-02-13T03:34:19.136718+0000","last_undegraded":"2026-02-13T03:34:19.136718+0000","last_fullsized":"2026-02-13T03:34:19.136718+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:34:13.099494+0000","last_clean_scrub_stamp":"2026-02-13T03:34:13.099494+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:32:55.723731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56930,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":66,"num_read_kb":94,"num_write":146,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":170790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":109788,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":299994,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":63,"seq":270582939656,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27680,"kb_used_data":716,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":733975520,"statfs":{"total":751619276800,"available":751590932480,"internally_reserved":0,"allocated":733184,"data_stored":354254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8106,"internal_metadata":27582550},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":56,"seq":240518168585,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27820,"kb_used_data":856,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":733975380,"statfs":{"total":751619276800,"available":751590789120,"internally_reserved":0,"allocated":876544,"data_stored":998579,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":26469,"internal_metadata":27564187},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":53,"seq":227633266699,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27696,"kb_used_data":732,"kb_used_omap":23,"kb_used_meta":26920,"kb_avail":733975504,"statfs":{"total":751619276800,"available":751590916096,"internally_reserved":0,"allocated":749568,"data_stored":354490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24029,"internal_metadata":27566627},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":46,"seq":197568495628,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27696,"kb_used_data":732,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":733975504,"statfs":{"total":751619276800,"available":751590916096,"internally_reserved":0,"allocated":749568,"data_stored":354410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28593,"internal_metadata":27562063},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":39,"seq":167503724558,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27744,"kb_used_data":780,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975456,"statfs":{"total":751619276800,"available":751590866944,"internally_reserved":0,"allocated":798720,"data_stored":946359,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":31919,"internal_metadata":27558737},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":36,"seq":154618822671,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27684,"kb_used_data":720,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733975516,"statfs":{"total":751619276800,"available":751590928384,"internally_reserved":0,"allocated":737280,"data_stored":353857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25134,"internal_metadata":27565522},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":29,"seq":124554051601,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27756,"kb_used_data":792,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":733975444,"statfs":{"total":751619276800,"available":751590854656,"internally_reserved":0,"allocated":811008,"data_stored":946043,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":30094,"internal_metadata":27560562},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":26,"seq":111669149714,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27688,"kb_used_data":724,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975512,"statfs":{"total":751619276800,"available":751590924288,"internally_reserved":0,"allocated":741376,"data_stored":354294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36858,"internal_metadata":27553798},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":19,"seq":81604378645,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27700,"kb_used_data":736,"kb_used_omap":42,"kb_used_meta":26901,"kb_avail":733975500,"statfs":{"total":751619276800,"available":751590912000,"internally_reserved":0,"allocated":753664,"data_stored":354168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43728,"internal_metadata":27546928},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":54,"kb_used_meta":26889,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":408276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55449,"internal_metadata":27535207},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672983,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27736,"kb_used_data":772,"kb_used_omap":38,"kb_used_meta":26905,"kb_avail":733975464,"statfs":{"total":751619276800,"available":751590875136,"internally_reserved":0,"allocated":790528,"data_stored":406494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39111,"internal_metadata":27551545},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771097,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27704,"kb_used_data":740,"kb_used_omap":42,"kb_used_meta":26901,"kb_avail":733975496,"statfs":{"total":751619276800,"available":751590907904,"internally_reserved":0,"allocated":757760,"data_stored":355172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43396,"internal_metadata":27547260},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36468,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36468,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36468,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1713,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":52844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1713,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":54626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24053,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15766,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6449,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1018,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":916,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5514,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16478,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10902,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":54444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23394,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1872,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T03:34:29.189 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-13T03:34:29.189 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-13T03:34:29.190 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-13T03:34:29.190 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:34:29.340 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:29.390 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:29 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1964130867' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T03:34:29.390 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:29 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1500959647' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T03:34:29.390 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:29 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/805362229' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T03:34:29.390 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:29 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3365246735' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T03:34:29.390 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:29 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3303730510' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T03:34:29.390 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:29 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/451425112' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T03:34:29.390 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:29 trial096 ceph-mon[24671]: pgmap v190: 97 pgs: 97 active+clean; 632 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 8.2 KiB/s wr, 17 op/s 2026-02-13T03:34:29.390 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:29 trial096 ceph-mon[24671]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:34:29.451 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.448+0000 7f2839e5d6c0 1 -- 10.20.193.96:0/1990950953 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f283410fbf0 msgr2=0x7f2834114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:29.451 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.448+0000 7f2839e5d6c0 1 --2- 10.20.193.96:0/1990950953 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f283410fbf0 0x7f2834114c30 secure :-1 s=READY pgs=323 gs=1 cs=0 l=1 c_cookie=16493239873617296406 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28240099a0 tx=0x7f282402ed50 comp rx=0 tx=0).stop 2026-02-13T03:34:29.451 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.448+0000 7f2839e5d6c0 1 -- 10.20.193.96:0/1990950953 shutdown_connections 2026-02-13T03:34:29.451 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.448+0000 7f2839e5d6c0 1 --2- 10.20.193.96:0/1990950953 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2834115410 0x7f2834175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:29.451 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.448+0000 7f2839e5d6c0 1 --2- 10.20.193.96:0/1990950953 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f283410fbf0 0x7f2834114c30 unknown :-1 s=CLOSED pgs=323 gs=1 cs=0 l=1 c_cookie=16493239873617296406 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:29.452 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.448+0000 7f2839e5d6c0 1 --2- 10.20.193.96:0/1990950953 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f283410f200 0x7f283410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:29.452 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.448+0000 7f2839e5d6c0 1 -- 10.20.193.96:0/1990950953 >> 10.20.193.96:0/1990950953 conn(0x7f28340ecb00 msgr2=0x7f283410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:29.452 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.448+0000 7f2839e5d6c0 1 -- 10.20.193.96:0/1990950953 shutdown_connections 2026-02-13T03:34:29.452 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.448+0000 7f2839e5d6c0 1 -- 10.20.193.96:0/1990950953 wait complete. 2026-02-13T03:34:29.452 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.449+0000 7f2839e5d6c0 1 Processor -- start 2026-02-13T03:34:29.452 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.449+0000 7f2839e5d6c0 1 -- start start 2026-02-13T03:34:29.452 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.449+0000 7f2839e5d6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f283410f200 0x7f283411d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:29.452 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.449+0000 7f2839e5d6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2834115410 0x7f283411d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:29.452 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.449+0000 7f2839e5d6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2834122b50 0x7f2834122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:29.452 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.449+0000 7f2839e5d6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2834123530 con 0x7f2834122b50 2026-02-13T03:34:29.452 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.449+0000 7f2839e5d6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f28341236a0 con 0x7f2834115410 2026-02-13T03:34:29.452 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.449+0000 7f2839e5d6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2834123860 con 0x7f283410f200 2026-02-13T03:34:29.452 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.449+0000 7f2833fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2834122b50 0x7f2834122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:29.452 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.449+0000 7f2833fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2834122b50 0x7f2834122ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49588/0 (socket says 10.20.193.96:49588) 2026-02-13T03:34:29.452 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.449+0000 7f2833fff6c0 1 -- 10.20.193.96:0/2156964604 learned_addr learned my addr 10.20.193.96:0/2156964604 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:29.452 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.449+0000 7f2832ffd6c0 1 --2- 10.20.193.96:0/2156964604 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2834115410 0x7f283411d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:29.452 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.449+0000 7f28337fe6c0 1 --2- 10.20.193.96:0/2156964604 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f283410f200 0x7f283411d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:29.452 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.449+0000 7f2833fff6c0 1 -- 10.20.193.96:0/2156964604 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f283410f200 msgr2=0x7f283411d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:29.452 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.449+0000 7f2833fff6c0 1 --2- 10.20.193.96:0/2156964604 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f283410f200 0x7f283411d250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:29.452 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.449+0000 7f2833fff6c0 1 -- 10.20.193.96:0/2156964604 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2834115410 msgr2=0x7f283411d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:29.452 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.449+0000 7f2833fff6c0 1 --2- 10.20.193.96:0/2156964604 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2834115410 0x7f283411d790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:29.453 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.449+0000 7f2833fff6c0 1 -- 10.20.193.96:0/2156964604 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2824009590 con 0x7f2834122b50 2026-02-13T03:34:29.453 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.449+0000 7f2833fff6c0 1 --2- 10.20.193.96:0/2156964604 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2834122b50 0x7f2834122ff0 secure :-1 s=READY pgs=324 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f282800c730 tx=0x7f282800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:29.453 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.449+0000 7f2830ff96c0 1 -- 10.20.193.96:0/2156964604 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2828003c40 con 0x7f2834122b50 2026-02-13T03:34:29.453 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.449+0000 7f2830ff96c0 1 -- 10.20.193.96:0/2156964604 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f282800a070 con 0x7f2834122b50 2026-02-13T03:34:29.453 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.449+0000 7f2839e5d6c0 1 -- 10.20.193.96:0/2156964604 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2834163ce0 con 0x7f2834122b50 2026-02-13T03:34:29.453 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.449+0000 7f2830ff96c0 1 -- 10.20.193.96:0/2156964604 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f282800dcf0 con 0x7f2834122b50 2026-02-13T03:34:29.453 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.449+0000 7f2839e5d6c0 1 -- 10.20.193.96:0/2156964604 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28341641c0 con 0x7f2834122b50 2026-02-13T03:34:29.453 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.450+0000 7f2839e5d6c0 1 -- 10.20.193.96:0/2156964604 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28341104d0 con 0x7f2834122b50 2026-02-13T03:34:29.454 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.451+0000 7f2830ff96c0 1 -- 10.20.193.96:0/2156964604 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f2828005030 con 0x7f2834122b50 2026-02-13T03:34:29.454 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.452+0000 7f2830ff96c0 1 --2- 10.20.193.96:0/2156964604 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f28080b5690 0x7f28080d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:29.454 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.452+0000 7f28337fe6c0 1 --2- 10.20.193.96:0/2156964604 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f28080b5690 0x7f28080d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:29.454 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.452+0000 7f2830ff96c0 1 -- 10.20.193.96:0/2156964604 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f28280e4b80 con 0x7f2834122b50 2026-02-13T03:34:29.455 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.452+0000 7f28337fe6c0 1 --2- 10.20.193.96:0/2156964604 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f28080b5690 0x7f28080d5b40 secure :-1 s=READY pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2820005980 tx=0x7f2820005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:29.455 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.452+0000 7f2830ff96c0 1 -- 10.20.193.96:0/2156964604 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f28280a75a0 con 0x7f2834122b50 2026-02-13T03:34:29.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:29 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1964130867' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T03:34:29.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:29 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1500959647' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T03:34:29.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:29 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/805362229' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T03:34:29.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:29 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3365246735' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T03:34:29.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:29 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3303730510' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T03:34:29.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:29 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/451425112' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T03:34:29.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:29 trial132 ceph-mon[26888]: pgmap v190: 97 pgs: 97 active+clean; 632 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 8.2 KiB/s wr, 17 op/s 2026-02-13T03:34:29.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:29 trial132 ceph-mon[26888]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:34:29.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:29 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1964130867' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T03:34:29.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:29 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1500959647' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T03:34:29.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:29 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/805362229' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T03:34:29.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:29 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3365246735' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T03:34:29.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:29 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3303730510' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T03:34:29.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:29 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/451425112' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T03:34:29.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:29 trial133 ceph-mon[26943]: pgmap v190: 97 pgs: 97 active+clean; 632 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 8.2 KiB/s wr, 17 op/s 2026-02-13T03:34:29.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:29 trial133 ceph-mon[26943]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:34:29.571 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.568+0000 7f2839e5d6c0 1 -- 10.20.193.96:0/2156964604 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f283411e3a0 con 0x7f2834122b50 2026-02-13T03:34:29.571 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.568+0000 7f2830ff96c0 1 -- 10.20.193.96:0/2156964604 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f28280aa750 con 0x7f2834122b50 2026-02-13T03:34:29.571 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:29.571 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:34:29.572 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.569+0000 7f2839e5d6c0 1 -- 10.20.193.96:0/2156964604 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f28080b5690 msgr2=0x7f28080d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:29.572 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.569+0000 7f2839e5d6c0 1 --2- 10.20.193.96:0/2156964604 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f28080b5690 0x7f28080d5b40 secure :-1 s=READY pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2820005980 tx=0x7f2820005910 comp rx=0 tx=0).stop 2026-02-13T03:34:29.572 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.569+0000 7f2839e5d6c0 1 -- 10.20.193.96:0/2156964604 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2834122b50 msgr2=0x7f2834122ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:29.572 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.569+0000 7f2839e5d6c0 1 --2- 10.20.193.96:0/2156964604 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2834122b50 0x7f2834122ff0 secure :-1 s=READY pgs=324 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f282800c730 tx=0x7f282800cc00 comp rx=0 tx=0).stop 2026-02-13T03:34:29.572 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.569+0000 7f2839e5d6c0 1 -- 10.20.193.96:0/2156964604 shutdown_connections 2026-02-13T03:34:29.572 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.569+0000 7f2839e5d6c0 1 --2- 10.20.193.96:0/2156964604 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f28080b5690 0x7f28080d5b40 unknown :-1 s=CLOSED pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:29.572 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.569+0000 7f2839e5d6c0 1 --2- 10.20.193.96:0/2156964604 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2834122b50 0x7f2834122ff0 unknown :-1 s=CLOSED pgs=324 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:29.572 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.569+0000 7f2839e5d6c0 1 --2- 10.20.193.96:0/2156964604 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2834115410 0x7f283411d790 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:29.572 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.569+0000 7f2839e5d6c0 1 --2- 10.20.193.96:0/2156964604 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f283410f200 0x7f283411d250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:29.572 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.569+0000 7f2839e5d6c0 1 -- 10.20.193.96:0/2156964604 >> 10.20.193.96:0/2156964604 conn(0x7f28340ecb00 msgr2=0x7f283410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:29.572 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.569+0000 7f2839e5d6c0 1 -- 10.20.193.96:0/2156964604 shutdown_connections 2026-02-13T03:34:29.572 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:29.569+0000 7f2839e5d6c0 1 -- 10.20.193.96:0/2156964604 wait complete. 2026-02-13T03:34:30.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:30 trial096 ceph-mon[24671]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:34:30.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:30 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2156964604' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:30.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:30 trial132 ceph-mon[26888]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:34:30.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:30 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2156964604' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:30.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:30 trial133 ceph-mon[26943]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:34:30.514 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:30 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2156964604' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:31.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:31 trial096 ceph-mon[24671]: pgmap v191: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 8.6 KiB/s rd, 9.2 KiB/s wr, 18 op/s 2026-02-13T03:34:31.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:31 trial132 ceph-mon[26888]: pgmap v191: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 8.6 KiB/s rd, 9.2 KiB/s wr, 18 op/s 2026-02-13T03:34:31.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:31 trial133 ceph-mon[26943]: pgmap v191: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 8.6 KiB/s rd, 9.2 KiB/s wr, 18 op/s 2026-02-13T03:34:32.612 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:34:32.731 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:32.850 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.848+0000 7fc58f1206c0 1 -- 10.20.193.96:0/3902534345 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc58810fbf0 msgr2=0x7fc588114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:32.850 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.848+0000 7fc58f1206c0 1 --2- 10.20.193.96:0/3902534345 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc58810fbf0 0x7fc588114c30 secure :-1 s=READY pgs=325 gs=1 cs=0 l=1 c_cookie=849608315655900701 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5700099a0 tx=0x7fc57002ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:32.850 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.848+0000 7fc58f1206c0 1 -- 10.20.193.96:0/3902534345 shutdown_connections 2026-02-13T03:34:32.850 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.848+0000 7fc58f1206c0 1 --2- 10.20.193.96:0/3902534345 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fc588115410 0x7fc588175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:32.850 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.848+0000 7fc58f1206c0 1 --2- 10.20.193.96:0/3902534345 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc58810fbf0 0x7fc588114c30 unknown :-1 s=CLOSED pgs=325 gs=1 cs=0 l=1 c_cookie=849608315655900701 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:32.850 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.848+0000 7fc58f1206c0 1 --2- 10.20.193.96:0/3902534345 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc58810f200 0x7fc58810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:32.850 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.848+0000 7fc58f1206c0 1 -- 10.20.193.96:0/3902534345 >> 10.20.193.96:0/3902534345 conn(0x7fc5880ecb00 msgr2=0x7fc58810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:32.850 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.848+0000 7fc58f1206c0 1 -- 10.20.193.96:0/3902534345 shutdown_connections 2026-02-13T03:34:32.850 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.848+0000 7fc58f1206c0 1 -- 10.20.193.96:0/3902534345 wait complete. 2026-02-13T03:34:32.851 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc58f1206c0 1 Processor -- start 2026-02-13T03:34:32.851 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc58f1206c0 1 -- start start 2026-02-13T03:34:32.851 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc58f1206c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fc58810f200 0x7fc5880f4cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:32.851 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc58f1206c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc588115410 0x7fc588175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:32.851 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc58f1206c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc5880f5300 0x7fc5880fa580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:32.851 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc58f1206c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc5880f59f0 con 0x7fc5880f5300 2026-02-13T03:34:32.851 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc58f1206c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc5880faac0 con 0x7fc588115410 2026-02-13T03:34:32.851 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc58f1206c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc5880fac80 con 0x7fc58810f200 2026-02-13T03:34:32.851 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc58d6926c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc5880f5300 0x7fc5880fa580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:32.851 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc58d6926c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc5880f5300 0x7fc5880fa580 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49606/0 (socket says 10.20.193.96:49606) 2026-02-13T03:34:32.851 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc58d6926c0 1 -- 10.20.193.96:0/1234491154 learned_addr learned my addr 10.20.193.96:0/1234491154 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:32.851 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc58ce916c0 1 --2- 10.20.193.96:0/1234491154 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fc58810f200 0x7fc5880f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:32.851 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc57ffff6c0 1 --2- 10.20.193.96:0/1234491154 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc588115410 0x7fc588175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:32.851 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc58d6926c0 1 -- 10.20.193.96:0/1234491154 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fc58810f200 msgr2=0x7fc5880f4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:32.851 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc58d6926c0 1 --2- 10.20.193.96:0/1234491154 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fc58810f200 0x7fc5880f4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:32.851 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc58d6926c0 1 -- 10.20.193.96:0/1234491154 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc588115410 msgr2=0x7fc588175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:32.851 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc58d6926c0 1 --2- 10.20.193.96:0/1234491154 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc588115410 0x7fc588175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:32.851 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc58d6926c0 1 -- 10.20.193.96:0/1234491154 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc570009590 con 0x7fc5880f5300 2026-02-13T03:34:32.851 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc58ce916c0 1 --2- 10.20.193.96:0/1234491154 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fc58810f200 0x7fc5880f4cd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:34:32.851 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc57ffff6c0 1 --2- 10.20.193.96:0/1234491154 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc588115410 0x7fc588175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:34:32.851 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc58d6926c0 1 --2- 10.20.193.96:0/1234491154 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc5880f5300 0x7fc5880fa580 secure :-1 s=READY pgs=326 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc584006ea0 tx=0x7fc58400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:32.851 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc57dffb6c0 1 -- 10.20.193.96:0/1234491154 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc584003a30 con 0x7fc5880f5300 2026-02-13T03:34:32.851 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc58f1206c0 1 -- 10.20.193.96:0/1234491154 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5880faf60 con 0x7fc5880f5300 2026-02-13T03:34:32.852 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc57dffb6c0 1 -- 10.20.193.96:0/1234491154 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fc584005510 con 0x7fc5880f5300 2026-02-13T03:34:32.852 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc57dffb6c0 1 -- 10.20.193.96:0/1234491154 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc58400dd70 con 0x7fc5880f5300 2026-02-13T03:34:32.852 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.849+0000 7fc58f1206c0 1 -- 10.20.193.96:0/1234491154 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5880fb6f0 con 0x7fc5880f5300 2026-02-13T03:34:32.852 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.850+0000 7fc58f1206c0 1 -- 10.20.193.96:0/1234491154 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5880fb440 con 0x7fc5880f5300 2026-02-13T03:34:32.853 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.851+0000 7fc57dffb6c0 1 -- 10.20.193.96:0/1234491154 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fc584003b90 con 0x7fc5880f5300 2026-02-13T03:34:32.853 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.852+0000 7fc57dffb6c0 1 --2- 10.20.193.96:0/1234491154 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fc5640b5690 0x7fc5640d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:32.854 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.852+0000 7fc58ce916c0 1 --2- 10.20.193.96:0/1234491154 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fc5640b5690 0x7fc5640d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:32.854 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.852+0000 7fc57dffb6c0 1 -- 10.20.193.96:0/1234491154 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7fc5840e4ad0 con 0x7fc5880f5300 2026-02-13T03:34:32.854 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.852+0000 7fc57dffb6c0 1 -- 10.20.193.96:0/1234491154 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc5840aaf50 con 0x7fc5880f5300 2026-02-13T03:34:32.854 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.852+0000 7fc58ce916c0 1 --2- 10.20.193.96:0/1234491154 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fc5640b5690 0x7fc5640d5b40 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc578004750 tx=0x7fc578009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:32.969 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.967+0000 7fc58f1206c0 1 -- 10.20.193.96:0/1234491154 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc5881104d0 con 0x7fc5880f5300 2026-02-13T03:34:32.969 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.967+0000 7fc57dffb6c0 1 -- 10.20.193.96:0/1234491154 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fc5840acfc0 con 0x7fc5880f5300 2026-02-13T03:34:32.969 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:32.969 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:34:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.968+0000 7fc58f1206c0 1 -- 10.20.193.96:0/1234491154 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fc5640b5690 msgr2=0x7fc5640d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.968+0000 7fc58f1206c0 1 --2- 10.20.193.96:0/1234491154 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fc5640b5690 0x7fc5640d5b40 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc578004750 tx=0x7fc578009260 comp rx=0 tx=0).stop 2026-02-13T03:34:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.968+0000 7fc58f1206c0 1 -- 10.20.193.96:0/1234491154 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc5880f5300 msgr2=0x7fc5880fa580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.968+0000 7fc58f1206c0 1 --2- 10.20.193.96:0/1234491154 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc5880f5300 0x7fc5880fa580 secure :-1 s=READY pgs=326 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc584006ea0 tx=0x7fc58400cca0 comp rx=0 tx=0).stop 2026-02-13T03:34:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.968+0000 7fc58f1206c0 1 -- 10.20.193.96:0/1234491154 shutdown_connections 2026-02-13T03:34:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.968+0000 7fc58f1206c0 1 --2- 10.20.193.96:0/1234491154 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fc5640b5690 0x7fc5640d5b40 unknown :-1 s=CLOSED pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.968+0000 7fc58f1206c0 1 --2- 10.20.193.96:0/1234491154 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fc5880f5300 0x7fc5880fa580 unknown :-1 s=CLOSED pgs=326 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.968+0000 7fc58f1206c0 1 --2- 10.20.193.96:0/1234491154 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fc588115410 0x7fc588175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.968+0000 7fc58f1206c0 1 --2- 10.20.193.96:0/1234491154 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fc58810f200 0x7fc5880f4cd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.968+0000 7fc58f1206c0 1 -- 10.20.193.96:0/1234491154 >> 10.20.193.96:0/1234491154 conn(0x7fc5880ecb00 msgr2=0x7fc58810d940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.968+0000 7fc58f1206c0 1 -- 10.20.193.96:0/1234491154 shutdown_connections 2026-02-13T03:34:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:32.968+0000 7fc58f1206c0 1 -- 10.20.193.96:0/1234491154 wait complete. 2026-02-13T03:34:33.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:33 trial096 ceph-mon[24671]: pgmap v192: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 7.9 KiB/s rd, 7.2 KiB/s wr, 11 op/s 2026-02-13T03:34:33.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:33 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1234491154' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:33.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:33 trial132 ceph-mon[26888]: pgmap v192: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 7.9 KiB/s rd, 7.2 KiB/s wr, 11 op/s 2026-02-13T03:34:33.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:33 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1234491154' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:34.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:33 trial133 ceph-mon[26943]: pgmap v192: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 7.9 KiB/s rd, 7.2 KiB/s wr, 11 op/s 2026-02-13T03:34:34.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:33 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1234491154' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:35.923 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:35 trial096 ceph-mon[24671]: pgmap v193: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 7.4 KiB/s rd, 6.7 KiB/s wr, 8 op/s 2026-02-13T03:34:35.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:35 trial132 ceph-mon[26888]: pgmap v193: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 7.4 KiB/s rd, 6.7 KiB/s wr, 8 op/s 2026-02-13T03:34:36.011 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:34:36.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:35 trial133 ceph-mon[26943]: pgmap v193: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 7.4 KiB/s rd, 6.7 KiB/s wr, 8 op/s 2026-02-13T03:34:36.129 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:36.247 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.245+0000 7fca927a16c0 1 -- 10.20.193.96:0/2562510807 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fca8c10fc20 msgr2=0x7fca8c114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:36.247 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.245+0000 7fca927a16c0 1 --2- 10.20.193.96:0/2562510807 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fca8c10fc20 0x7fca8c114c60 secure :-1 s=READY pgs=327 gs=1 cs=0 l=1 c_cookie=16952980137904413566 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca7c0099a0 tx=0x7fca7c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:36.247 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.245+0000 7fca927a16c0 1 -- 10.20.193.96:0/2562510807 shutdown_connections 2026-02-13T03:34:36.247 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.245+0000 7fca927a16c0 1 --2- 10.20.193.96:0/2562510807 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fca8c115440 0x7fca8c175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:36.247 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.245+0000 7fca927a16c0 1 --2- 10.20.193.96:0/2562510807 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fca8c10fc20 0x7fca8c114c60 unknown :-1 s=CLOSED pgs=327 gs=1 cs=0 l=1 c_cookie=16952980137904413566 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:36.247 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.245+0000 7fca927a16c0 1 --2- 10.20.193.96:0/2562510807 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fca8c10f230 0x7fca8c10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:36.247 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.245+0000 7fca927a16c0 1 -- 10.20.193.96:0/2562510807 >> 10.20.193.96:0/2562510807 conn(0x7fca8c0ecb30 msgr2=0x7fca8c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:36.247 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.245+0000 7fca927a16c0 1 -- 10.20.193.96:0/2562510807 shutdown_connections 2026-02-13T03:34:36.247 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.245+0000 7fca927a16c0 1 -- 10.20.193.96:0/2562510807 wait complete. 2026-02-13T03:34:36.247 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.245+0000 7fca927a16c0 1 Processor -- start 2026-02-13T03:34:36.247 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.245+0000 7fca927a16c0 1 -- start start 2026-02-13T03:34:36.247 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.245+0000 7fca927a16c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fca8c10f230 0x7fca8c0f4b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:36.247 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.245+0000 7fca927a16c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fca8c115440 0x7fca8c175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:36.247 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.245+0000 7fca927a16c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fca8c0f5190 0x7fca8c0fa460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:36.247 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.245+0000 7fca927a16c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c0f5880 con 0x7fca8c115440 2026-02-13T03:34:36.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.245+0000 7fca927a16c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c0fa9a0 con 0x7fca8c0f5190 2026-02-13T03:34:36.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.245+0000 7fca927a16c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c0fab60 con 0x7fca8c10f230 2026-02-13T03:34:36.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.246+0000 7fca8b7fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fca8c115440 0x7fca8c175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:36.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.246+0000 7fca8b7fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fca8c115440 0x7fca8c175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:54802/0 (socket says 10.20.193.96:54802) 2026-02-13T03:34:36.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.246+0000 7fca8b7fe6c0 1 -- 10.20.193.96:0/1902491475 learned_addr learned my addr 10.20.193.96:0/1902491475 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:36.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.246+0000 7fca90d136c0 1 --2- 10.20.193.96:0/1902491475 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fca8c0f5190 0x7fca8c0fa460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:36.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.246+0000 7fca8bfff6c0 1 --2- 10.20.193.96:0/1902491475 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fca8c10f230 0x7fca8c0f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:36.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.246+0000 7fca8b7fe6c0 1 -- 10.20.193.96:0/1902491475 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fca8c10f230 msgr2=0x7fca8c0f4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:36.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.246+0000 7fca8b7fe6c0 1 --2- 10.20.193.96:0/1902491475 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fca8c10f230 0x7fca8c0f4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:36.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.246+0000 7fca8b7fe6c0 1 -- 10.20.193.96:0/1902491475 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fca8c0f5190 msgr2=0x7fca8c0fa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:36.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.246+0000 7fca8b7fe6c0 1 --2- 10.20.193.96:0/1902491475 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fca8c0f5190 0x7fca8c0fa460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:36.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.246+0000 7fca8b7fe6c0 1 -- 10.20.193.96:0/1902491475 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7c009590 con 0x7fca8c115440 2026-02-13T03:34:36.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.246+0000 7fca8b7fe6c0 1 --2- 10.20.193.96:0/1902491475 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fca8c115440 0x7fca8c175ce0 secure :-1 s=READY pgs=328 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca7c02f230 tx=0x7fca7c02fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:36.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.246+0000 7fca897fa6c0 1 -- 10.20.193.96:0/1902491475 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca7c002ae0 con 0x7fca8c115440 2026-02-13T03:34:36.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.246+0000 7fca897fa6c0 1 -- 10.20.193.96:0/1902491475 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fca7c002c40 con 0x7fca8c115440 2026-02-13T03:34:36.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.246+0000 7fca897fa6c0 1 -- 10.20.193.96:0/1902491475 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca7c0312b0 con 0x7fca8c115440 2026-02-13T03:34:36.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.246+0000 7fca927a16c0 1 -- 10.20.193.96:0/1902491475 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca8c0fade0 con 0x7fca8c115440 2026-02-13T03:34:36.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.246+0000 7fca927a16c0 1 -- 10.20.193.96:0/1902491475 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca8c0fb210 con 0x7fca8c115440 2026-02-13T03:34:36.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.246+0000 7fca927a16c0 1 -- 10.20.193.96:0/1902491475 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca8c110500 con 0x7fca8c115440 2026-02-13T03:34:36.249 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.247+0000 7fca897fa6c0 1 -- 10.20.193.96:0/1902491475 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fca7c007980 con 0x7fca8c115440 2026-02-13T03:34:36.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.248+0000 7fca897fa6c0 1 --2- 10.20.193.96:0/1902491475 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fca600b5710 0x7fca600d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:36.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.248+0000 7fca8bfff6c0 1 --2- 10.20.193.96:0/1902491475 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fca600b5710 0x7fca600d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:36.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.248+0000 7fca897fa6c0 1 -- 10.20.193.96:0/1902491475 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7fca7c107ca0 con 0x7fca8c115440 2026-02-13T03:34:36.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.248+0000 7fca8bfff6c0 1 --2- 10.20.193.96:0/1902491475 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fca600b5710 0x7fca600d5bc0 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca78005980 tx=0x7fca78005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:36.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.249+0000 7fca897fa6c0 1 -- 10.20.193.96:0/1902491475 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fca7c0ca6c0 con 0x7fca8c115440 2026-02-13T03:34:36.366 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.364+0000 7fca927a16c0 1 -- 10.20.193.96:0/1902491475 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fca8c10f600 con 0x7fca8c115440 2026-02-13T03:34:36.367 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.364+0000 7fca897fa6c0 1 -- 10.20.193.96:0/1902491475 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fca7c002db0 con 0x7fca8c115440 2026-02-13T03:34:36.367 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:36.367 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:34:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.366+0000 7fca927a16c0 1 -- 10.20.193.96:0/1902491475 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fca600b5710 msgr2=0x7fca600d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.366+0000 7fca927a16c0 1 --2- 10.20.193.96:0/1902491475 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fca600b5710 0x7fca600d5bc0 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca78005980 tx=0x7fca78005910 comp rx=0 tx=0).stop 2026-02-13T03:34:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.366+0000 7fca927a16c0 1 -- 10.20.193.96:0/1902491475 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fca8c115440 msgr2=0x7fca8c175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.366+0000 7fca927a16c0 1 --2- 10.20.193.96:0/1902491475 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fca8c115440 0x7fca8c175ce0 secure :-1 s=READY pgs=328 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca7c02f230 tx=0x7fca7c02fc60 comp rx=0 tx=0).stop 2026-02-13T03:34:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.366+0000 7fca927a16c0 1 -- 10.20.193.96:0/1902491475 shutdown_connections 2026-02-13T03:34:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.366+0000 7fca927a16c0 1 --2- 10.20.193.96:0/1902491475 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fca600b5710 0x7fca600d5bc0 unknown :-1 s=CLOSED pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:36.369 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.366+0000 7fca927a16c0 1 --2- 10.20.193.96:0/1902491475 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fca8c0f5190 0x7fca8c0fa460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:36.369 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.366+0000 7fca927a16c0 1 --2- 10.20.193.96:0/1902491475 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fca8c115440 0x7fca8c175ce0 unknown :-1 s=CLOSED pgs=328 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:36.369 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.366+0000 7fca927a16c0 1 --2- 10.20.193.96:0/1902491475 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fca8c10f230 0x7fca8c0f4b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:36.369 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.366+0000 7fca927a16c0 1 -- 10.20.193.96:0/1902491475 >> 10.20.193.96:0/1902491475 conn(0x7fca8c0ecb30 msgr2=0x7fca8c10d790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:36.369 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.366+0000 7fca927a16c0 1 -- 10.20.193.96:0/1902491475 shutdown_connections 2026-02-13T03:34:36.369 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:36.366+0000 7fca927a16c0 1 -- 10.20.193.96:0/1902491475 wait complete. 2026-02-13T03:34:36.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:36 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1902491475' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:36.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:36 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1902491475' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:37.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:36 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1902491475' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:37.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:37 trial096 ceph-mon[24671]: pgmap v194: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 6.7 KiB/s wr, 10 op/s 2026-02-13T03:34:37.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:37 trial132 ceph-mon[26888]: pgmap v194: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 6.7 KiB/s wr, 10 op/s 2026-02-13T03:34:38.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:37 trial133 ceph-mon[26943]: pgmap v194: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 6.7 KiB/s wr, 10 op/s 2026-02-13T03:34:39.408 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:34:39.528 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:39.642 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.640+0000 7f3e03d916c0 1 -- 10.20.193.96:0/3579149770 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3dfc10f200 msgr2=0x7f3dfc10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:39.642 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.640+0000 7f3e03d916c0 1 --2- 10.20.193.96:0/3579149770 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3dfc10f200 0x7f3dfc10f5d0 secure :-1 s=READY pgs=329 gs=1 cs=0 l=1 c_cookie=9550474287167361154 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3dec0099a0 tx=0x7f3dec02ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:39.642 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.640+0000 7f3e03d916c0 1 -- 10.20.193.96:0/3579149770 shutdown_connections 2026-02-13T03:34:39.642 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.640+0000 7f3e03d916c0 1 --2- 10.20.193.96:0/3579149770 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3dfc115410 0x7f3dfc175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:39.642 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.640+0000 7f3e03d916c0 1 --2- 10.20.193.96:0/3579149770 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3dfc10fbf0 0x7f3dfc114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:39.642 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.640+0000 7f3e03d916c0 1 --2- 10.20.193.96:0/3579149770 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3dfc10f200 0x7f3dfc10f5d0 unknown :-1 s=CLOSED pgs=329 gs=1 cs=0 l=1 c_cookie=9550474287167361154 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:39.642 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.640+0000 7f3e03d916c0 1 -- 10.20.193.96:0/3579149770 >> 10.20.193.96:0/3579149770 conn(0x7f3dfc0ecb00 msgr2=0x7f3dfc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:39.642 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.640+0000 7f3e03d916c0 1 -- 10.20.193.96:0/3579149770 shutdown_connections 2026-02-13T03:34:39.642 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.640+0000 7f3e03d916c0 1 -- 10.20.193.96:0/3579149770 wait complete. 2026-02-13T03:34:39.642 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.640+0000 7f3e03d916c0 1 Processor -- start 2026-02-13T03:34:39.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.641+0000 7f3e03d916c0 1 -- start start 2026-02-13T03:34:39.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.641+0000 7f3e03d916c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3dfc10f200 0x7f3dfc11d1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:39.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.641+0000 7f3e03d916c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3dfc115410 0x7f3dfc11d710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:39.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.641+0000 7f3e03d916c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3dfc122ad0 0x7f3dfc122f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:39.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.641+0000 7f3e03d916c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc1234e0 con 0x7f3dfc122ad0 2026-02-13T03:34:39.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.641+0000 7f3e03d916c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc123650 con 0x7f3dfc115410 2026-02-13T03:34:39.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.641+0000 7f3e03d916c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc123810 con 0x7f3dfc10f200 2026-02-13T03:34:39.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.641+0000 7f3e023036c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3dfc122ad0 0x7f3dfc122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:39.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.641+0000 7f3e023036c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3dfc122ad0 0x7f3dfc122f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:54828/0 (socket says 10.20.193.96:54828) 2026-02-13T03:34:39.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.641+0000 7f3e023036c0 1 -- 10.20.193.96:0/3985497338 learned_addr learned my addr 10.20.193.96:0/3985497338 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:39.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.641+0000 7f3e01b026c0 1 --2- 10.20.193.96:0/3985497338 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3dfc10f200 0x7f3dfc11d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:39.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.641+0000 7f3e013016c0 1 --2- 10.20.193.96:0/3985497338 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3dfc115410 0x7f3dfc11d710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:39.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.641+0000 7f3e023036c0 1 -- 10.20.193.96:0/3985497338 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3dfc10f200 msgr2=0x7f3dfc11d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:39.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.641+0000 7f3e023036c0 1 --2- 10.20.193.96:0/3985497338 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3dfc10f200 0x7f3dfc11d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:39.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.641+0000 7f3e023036c0 1 -- 10.20.193.96:0/3985497338 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3dfc115410 msgr2=0x7f3dfc11d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:39.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.641+0000 7f3e023036c0 1 --2- 10.20.193.96:0/3985497338 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3dfc115410 0x7f3dfc11d710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:39.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.641+0000 7f3e023036c0 1 -- 10.20.193.96:0/3985497338 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dec009590 con 0x7f3dfc122ad0 2026-02-13T03:34:39.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.641+0000 7f3e013016c0 1 --2- 10.20.193.96:0/3985497338 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3dfc115410 0x7f3dfc11d710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:34:39.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.641+0000 7f3e023036c0 1 --2- 10.20.193.96:0/3985497338 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3dfc122ad0 0x7f3dfc122f70 secure :-1 s=READY pgs=330 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3df800c6c0 tx=0x7f3df800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:39.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.643+0000 7f3deaffd6c0 1 -- 10.20.193.96:0/3985497338 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3df8003c40 con 0x7f3dfc122ad0 2026-02-13T03:34:39.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.643+0000 7f3deaffd6c0 1 -- 10.20.193.96:0/3985497338 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f3df800a030 con 0x7f3dfc122ad0 2026-02-13T03:34:39.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.643+0000 7f3deaffd6c0 1 -- 10.20.193.96:0/3985497338 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3df800dbe0 con 0x7f3dfc122ad0 2026-02-13T03:34:39.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.643+0000 7f3e03d916c0 1 -- 10.20.193.96:0/3985497338 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dfc163cc0 con 0x7f3dfc122ad0 2026-02-13T03:34:39.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.643+0000 7f3e03d916c0 1 -- 10.20.193.96:0/3985497338 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dfc164150 con 0x7f3dfc122ad0 2026-02-13T03:34:39.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.644+0000 7f3e03d916c0 1 -- 10.20.193.96:0/3985497338 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dfc1104d0 con 0x7f3dfc122ad0 2026-02-13T03:34:39.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.645+0000 7f3deaffd6c0 1 -- 10.20.193.96:0/3985497338 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f3df8005030 con 0x7f3dfc122ad0 2026-02-13T03:34:39.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.645+0000 7f3deaffd6c0 1 --2- 10.20.193.96:0/3985497338 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f3dd80b5690 0x7f3dd80d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:39.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.645+0000 7f3deaffd6c0 1 -- 10.20.193.96:0/3985497338 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f3df80e4a40 con 0x7f3dfc122ad0 2026-02-13T03:34:39.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.645+0000 7f3e01b026c0 1 --2- 10.20.193.96:0/3985497338 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f3dd80b5690 0x7f3dd80d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:39.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.646+0000 7f3e01b026c0 1 --2- 10.20.193.96:0/3985497338 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f3dd80b5690 0x7f3dd80d5b40 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3dec0023e0 tx=0x7f3dec005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:39.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.646+0000 7f3deaffd6c0 1 -- 10.20.193.96:0/3985497338 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3df80a7460 con 0x7f3dfc122ad0 2026-02-13T03:34:39.763 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.762+0000 7f3e03d916c0 1 -- 10.20.193.96:0/3985497338 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3dfc11e380 con 0x7f3dfc122ad0 2026-02-13T03:34:39.764 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:39 trial096 ceph-mon[24671]: pgmap v195: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2026-02-13T03:34:39.764 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.762+0000 7f3deaffd6c0 1 -- 10.20.193.96:0/3985497338 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f3df8005310 con 0x7f3dfc122ad0 2026-02-13T03:34:39.764 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:39.764 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:34:39.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.763+0000 7f3e03d916c0 1 -- 10.20.193.96:0/3985497338 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f3dd80b5690 msgr2=0x7f3dd80d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:39.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.763+0000 7f3e03d916c0 1 --2- 10.20.193.96:0/3985497338 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f3dd80b5690 0x7f3dd80d5b40 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3dec0023e0 tx=0x7f3dec005c00 comp rx=0 tx=0).stop 2026-02-13T03:34:39.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.763+0000 7f3e03d916c0 1 -- 10.20.193.96:0/3985497338 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3dfc122ad0 msgr2=0x7f3dfc122f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:39.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.763+0000 7f3e03d916c0 1 --2- 10.20.193.96:0/3985497338 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3dfc122ad0 0x7f3dfc122f70 secure :-1 s=READY pgs=330 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3df800c6c0 tx=0x7f3df800cb90 comp rx=0 tx=0).stop 2026-02-13T03:34:39.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.763+0000 7f3e03d916c0 1 -- 10.20.193.96:0/3985497338 shutdown_connections 2026-02-13T03:34:39.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.763+0000 7f3e03d916c0 1 --2- 10.20.193.96:0/3985497338 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f3dd80b5690 0x7f3dd80d5b40 unknown :-1 s=CLOSED pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:39.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.763+0000 7f3e03d916c0 1 --2- 10.20.193.96:0/3985497338 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3dfc122ad0 0x7f3dfc122f70 unknown :-1 s=CLOSED pgs=330 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:39.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.763+0000 7f3e03d916c0 1 --2- 10.20.193.96:0/3985497338 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3dfc115410 0x7f3dfc11d710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:39.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.763+0000 7f3e03d916c0 1 --2- 10.20.193.96:0/3985497338 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3dfc10f200 0x7f3dfc11d1d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:39.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.763+0000 7f3e03d916c0 1 -- 10.20.193.96:0/3985497338 >> 10.20.193.96:0/3985497338 conn(0x7f3dfc0ecb00 msgr2=0x7f3dfc10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:39.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.763+0000 7f3e03d916c0 1 -- 10.20.193.96:0/3985497338 shutdown_connections 2026-02-13T03:34:39.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:39.763+0000 7f3e03d916c0 1 -- 10.20.193.96:0/3985497338 wait complete. 2026-02-13T03:34:39.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:39 trial132 ceph-mon[26888]: pgmap v195: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2026-02-13T03:34:40.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:39 trial133 ceph-mon[26943]: pgmap v195: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2026-02-13T03:34:40.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:40 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3985497338' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:40.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:40 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3985497338' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:41.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:40 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3985497338' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:41.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:41 trial096 ceph-mon[24671]: pgmap v196: 97 pgs: 97 active+clean; 648 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2026-02-13T03:34:41.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:41 trial132 ceph-mon[26888]: pgmap v196: 97 pgs: 97 active+clean; 648 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2026-02-13T03:34:42.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:41 trial133 ceph-mon[26943]: pgmap v196: 97 pgs: 97 active+clean; 648 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2026-02-13T03:34:42.807 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:34:42.927 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:43.043 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.038+0000 7ffbcd99b6c0 1 -- 10.20.193.96:0/1753006839 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ffbc810fc20 msgr2=0x7ffbc8114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:43.043 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.038+0000 7ffbcd99b6c0 1 --2- 10.20.193.96:0/1753006839 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ffbc810fc20 0x7ffbc8114c60 secure :-1 s=READY pgs=331 gs=1 cs=0 l=1 c_cookie=6141412555171119441 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffbb00099a0 tx=0x7ffbb002ed50 comp rx=0 tx=0).stop 2026-02-13T03:34:43.043 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.038+0000 7ffbcd99b6c0 1 -- 10.20.193.96:0/1753006839 shutdown_connections 2026-02-13T03:34:43.043 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.038+0000 7ffbcd99b6c0 1 --2- 10.20.193.96:0/1753006839 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ffbc8115440 0x7ffbc8175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:43.043 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.038+0000 7ffbcd99b6c0 1 --2- 10.20.193.96:0/1753006839 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ffbc810fc20 0x7ffbc8114c60 unknown :-1 s=CLOSED pgs=331 gs=1 cs=0 l=1 c_cookie=6141412555171119441 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:43.043 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.038+0000 7ffbcd99b6c0 1 --2- 10.20.193.96:0/1753006839 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ffbc810f230 0x7ffbc810f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:43.043 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.038+0000 7ffbcd99b6c0 1 -- 10.20.193.96:0/1753006839 >> 10.20.193.96:0/1753006839 conn(0x7ffbc80ecb30 msgr2=0x7ffbc810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:43.043 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.038+0000 7ffbcd99b6c0 1 -- 10.20.193.96:0/1753006839 shutdown_connections 2026-02-13T03:34:43.044 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.038+0000 7ffbcd99b6c0 1 -- 10.20.193.96:0/1753006839 wait complete. 2026-02-13T03:34:43.044 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.038+0000 7ffbcd99b6c0 1 Processor -- start 2026-02-13T03:34:43.044 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.038+0000 7ffbcd99b6c0 1 -- start start 2026-02-13T03:34:43.044 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.039+0000 7ffbcd99b6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ffbc810f230 0x7ffbc80f4ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:43.044 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.039+0000 7ffbcd99b6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ffbc8115440 0x7ffbc8175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:43.044 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.039+0000 7ffbcd99b6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ffbc80f51d0 0x7ffbc80fa4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:43.044 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.039+0000 7ffbcd99b6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc80f5830 con 0x7ffbc8115440 2026-02-13T03:34:43.044 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.039+0000 7ffbcd99b6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc80fa9e0 con 0x7ffbc80f51d0 2026-02-13T03:34:43.044 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.039+0000 7ffbcd99b6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc80faba0 con 0x7ffbc810f230 2026-02-13T03:34:43.044 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.039+0000 7ffbc67fc6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ffbc8115440 0x7ffbc8175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:43.045 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.039+0000 7ffbc67fc6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ffbc8115440 0x7ffbc8175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:54842/0 (socket says 10.20.193.96:54842) 2026-02-13T03:34:43.045 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.039+0000 7ffbc67fc6c0 1 -- 10.20.193.96:0/1748518190 learned_addr learned my addr 10.20.193.96:0/1748518190 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:43.045 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.039+0000 7ffbc6ffd6c0 1 --2- 10.20.193.96:0/1748518190 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ffbc810f230 0x7ffbc80f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:43.045 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.039+0000 7ffbc77fe6c0 1 --2- 10.20.193.96:0/1748518190 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ffbc80f51d0 0x7ffbc80fa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:43.045 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.039+0000 7ffbc67fc6c0 1 -- 10.20.193.96:0/1748518190 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ffbc810f230 msgr2=0x7ffbc80f4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:43.045 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.039+0000 7ffbc67fc6c0 1 --2- 10.20.193.96:0/1748518190 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ffbc810f230 0x7ffbc80f4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:43.045 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.039+0000 7ffbc67fc6c0 1 -- 10.20.193.96:0/1748518190 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ffbc80f51d0 msgr2=0x7ffbc80fa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:43.045 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.039+0000 7ffbc67fc6c0 1 --2- 10.20.193.96:0/1748518190 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ffbc80f51d0 0x7ffbc80fa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:43.045 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.039+0000 7ffbc67fc6c0 1 -- 10.20.193.96:0/1748518190 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb0009590 con 0x7ffbc8115440 2026-02-13T03:34:43.045 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.039+0000 7ffbc77fe6c0 1 --2- 10.20.193.96:0/1748518190 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ffbc80f51d0 0x7ffbc80fa4a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:34:43.045 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.039+0000 7ffbc67fc6c0 1 --2- 10.20.193.96:0/1748518190 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ffbc8115440 0x7ffbc8175ce0 secure :-1 s=READY pgs=332 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffbb002f260 tx=0x7ffbb00047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:43.046 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.039+0000 7ffbcc9956c0 1 -- 10.20.193.96:0/1748518190 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffbb0002ae0 con 0x7ffbc8115440 2026-02-13T03:34:43.046 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.039+0000 7ffbcc9956c0 1 -- 10.20.193.96:0/1748518190 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7ffbb0002c40 con 0x7ffbc8115440 2026-02-13T03:34:43.046 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.039+0000 7ffbcd99b6c0 1 -- 10.20.193.96:0/1748518190 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc80fadc0 con 0x7ffbc8115440 2026-02-13T03:34:43.046 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.039+0000 7ffbcc9956c0 1 -- 10.20.193.96:0/1748518190 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffbb00372f0 con 0x7ffbc8115440 2026-02-13T03:34:43.046 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.039+0000 7ffbcd99b6c0 1 -- 10.20.193.96:0/1748518190 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc80fb290 con 0x7ffbc8115440 2026-02-13T03:34:43.046 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.039+0000 7ffbcd99b6c0 1 -- 10.20.193.96:0/1748518190 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbc8110500 con 0x7ffbc8115440 2026-02-13T03:34:43.046 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.040+0000 7ffbcc9956c0 1 -- 10.20.193.96:0/1748518190 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7ffbb0007260 con 0x7ffbc8115440 2026-02-13T03:34:43.047 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.041+0000 7ffbcc9956c0 1 --2- 10.20.193.96:0/1748518190 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ffb9c0b5710 0x7ffb9c0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:43.047 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.041+0000 7ffbc6ffd6c0 1 --2- 10.20.193.96:0/1748518190 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ffb9c0b5710 0x7ffb9c0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:43.047 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.041+0000 7ffbcc9956c0 1 -- 10.20.193.96:0/1748518190 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7ffbb0107cc0 con 0x7ffbc8115440 2026-02-13T03:34:43.047 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.042+0000 7ffbcc9956c0 1 -- 10.20.193.96:0/1748518190 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ffbb00ca6e0 con 0x7ffbc8115440 2026-02-13T03:34:43.047 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.042+0000 7ffbc6ffd6c0 1 --2- 10.20.193.96:0/1748518190 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ffb9c0b5710 0x7ffb9c0d5bc0 secure :-1 s=READY pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffbbc004750 tx=0x7ffbbc005e60 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:43.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.158+0000 7ffbcd99b6c0 1 -- 10.20.193.96:0/1748518190 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ffbc810f600 con 0x7ffbc8115440 2026-02-13T03:34:43.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.158+0000 7ffbcc9956c0 1 -- 10.20.193.96:0/1748518190 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ffbb00091e0 con 0x7ffbc8115440 2026-02-13T03:34:43.160 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:43.161 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:34:43.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.159+0000 7ffbcd99b6c0 1 -- 10.20.193.96:0/1748518190 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ffb9c0b5710 msgr2=0x7ffb9c0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:43.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.159+0000 7ffbcd99b6c0 1 --2- 10.20.193.96:0/1748518190 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ffb9c0b5710 0x7ffb9c0d5bc0 secure :-1 s=READY pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffbbc004750 tx=0x7ffbbc005e60 comp rx=0 tx=0).stop 2026-02-13T03:34:43.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.159+0000 7ffbcd99b6c0 1 -- 10.20.193.96:0/1748518190 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ffbc8115440 msgr2=0x7ffbc8175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:43.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.159+0000 7ffbcd99b6c0 1 --2- 10.20.193.96:0/1748518190 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ffbc8115440 0x7ffbc8175ce0 secure :-1 s=READY pgs=332 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffbb002f260 tx=0x7ffbb00047f0 comp rx=0 tx=0).stop 2026-02-13T03:34:43.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.159+0000 7ffbcd99b6c0 1 -- 10.20.193.96:0/1748518190 shutdown_connections 2026-02-13T03:34:43.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.159+0000 7ffbcd99b6c0 1 --2- 10.20.193.96:0/1748518190 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ffb9c0b5710 0x7ffb9c0d5bc0 unknown :-1 s=CLOSED pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:43.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.159+0000 7ffbcd99b6c0 1 --2- 10.20.193.96:0/1748518190 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ffbc80f51d0 0x7ffbc80fa4a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:43.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.159+0000 7ffbcd99b6c0 1 --2- 10.20.193.96:0/1748518190 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ffbc8115440 0x7ffbc8175ce0 unknown :-1 s=CLOSED pgs=332 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:43.163 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.159+0000 7ffbcd99b6c0 1 --2- 10.20.193.96:0/1748518190 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ffbc810f230 0x7ffbc80f4ba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:43.163 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.159+0000 7ffbcd99b6c0 1 -- 10.20.193.96:0/1748518190 >> 10.20.193.96:0/1748518190 conn(0x7ffbc80ecb30 msgr2=0x7ffbc8113c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:43.163 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.159+0000 7ffbcd99b6c0 1 -- 10.20.193.96:0/1748518190 shutdown_connections 2026-02-13T03:34:43.163 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:43.159+0000 7ffbcd99b6c0 1 -- 10.20.193.96:0/1748518190 wait complete. 2026-02-13T03:34:43.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:43 trial096 ceph-mon[24671]: pgmap v197: 97 pgs: 97 active+clean; 648 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-13T03:34:43.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:43 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1748518190' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:43.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:43 trial132 ceph-mon[26888]: pgmap v197: 97 pgs: 97 active+clean; 648 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-13T03:34:43.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:43 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1748518190' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:44.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:43 trial133 ceph-mon[26943]: pgmap v197: 97 pgs: 97 active+clean; 648 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-13T03:34:44.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:43 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1748518190' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:45.923 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:45 trial096 ceph-mon[24671]: pgmap v198: 97 pgs: 97 active+clean; 648 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-13T03:34:45.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:45 trial132 ceph-mon[26888]: pgmap v198: 97 pgs: 97 active+clean; 648 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-13T03:34:46.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:45 trial133 ceph-mon[26943]: pgmap v198: 97 pgs: 97 active+clean; 648 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-13T03:34:46.220 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:34:46.337 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:46.455 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe433c6c0 1 -- 10.20.193.96:0/2572049178 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5fdc10f200 msgr2=0x7f5fdc10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:46.455 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe433c6c0 1 --2- 10.20.193.96:0/2572049178 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5fdc10f200 0x7f5fdc10f5d0 secure :-1 s=READY pgs=333 gs=1 cs=0 l=1 c_cookie=1368476259679196119 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5fcc0099a0 tx=0x7f5fcc02ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:46.455 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe433c6c0 1 -- 10.20.193.96:0/2572049178 shutdown_connections 2026-02-13T03:34:46.455 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe433c6c0 1 --2- 10.20.193.96:0/2572049178 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5fdc115410 0x7f5fdc175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:46.455 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe433c6c0 1 --2- 10.20.193.96:0/2572049178 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5fdc10fbf0 0x7f5fdc114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:46.455 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe433c6c0 1 --2- 10.20.193.96:0/2572049178 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5fdc10f200 0x7f5fdc10f5d0 unknown :-1 s=CLOSED pgs=333 gs=1 cs=0 l=1 c_cookie=1368476259679196119 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:46.455 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe433c6c0 1 -- 10.20.193.96:0/2572049178 >> 10.20.193.96:0/2572049178 conn(0x7f5fdc0ecb00 msgr2=0x7f5fdc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:46.455 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe433c6c0 1 -- 10.20.193.96:0/2572049178 shutdown_connections 2026-02-13T03:34:46.455 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe433c6c0 1 -- 10.20.193.96:0/2572049178 wait complete. 2026-02-13T03:34:46.455 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe433c6c0 1 Processor -- start 2026-02-13T03:34:46.455 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe433c6c0 1 -- start start 2026-02-13T03:34:46.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe433c6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5fdc10f200 0x7f5fdc11d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:46.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe433c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5fdc115410 0x7f5fdc11d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:46.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe433c6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5fdc122b50 0x7f5fdc122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:46.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe433c6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5fdc123560 con 0x7f5fdc115410 2026-02-13T03:34:46.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe433c6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5fdc1236d0 con 0x7f5fdc10f200 2026-02-13T03:34:46.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe433c6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5fdc123890 con 0x7f5fdc122b50 2026-02-13T03:34:46.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe18b06c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5fdc115410 0x7f5fdc11d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:46.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe18b06c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5fdc115410 0x7f5fdc11d790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:54012/0 (socket says 10.20.193.96:54012) 2026-02-13T03:34:46.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe18b06c0 1 -- 10.20.193.96:0/1143538972 learned_addr learned my addr 10.20.193.96:0/1143538972 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:46.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe20b16c0 1 --2- 10.20.193.96:0/1143538972 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5fdc10f200 0x7f5fdc11d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:46.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe28b26c0 1 --2- 10.20.193.96:0/1143538972 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5fdc122b50 0x7f5fdc122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:46.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe18b06c0 1 -- 10.20.193.96:0/1143538972 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5fdc122b50 msgr2=0x7f5fdc122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:46.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe18b06c0 1 --2- 10.20.193.96:0/1143538972 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5fdc122b50 0x7f5fdc122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:46.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe18b06c0 1 -- 10.20.193.96:0/1143538972 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5fdc10f200 msgr2=0x7f5fdc11d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:46.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe18b06c0 1 --2- 10.20.193.96:0/1143538972 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5fdc10f200 0x7f5fdc11d250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:46.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe18b06c0 1 -- 10.20.193.96:0/1143538972 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fcc009590 con 0x7f5fdc115410 2026-02-13T03:34:46.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe28b26c0 1 --2- 10.20.193.96:0/1143538972 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5fdc122b50 0x7f5fdc122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:34:46.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe18b06c0 1 --2- 10.20.193.96:0/1143538972 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5fdc115410 0x7f5fdc11d790 secure :-1 s=READY pgs=334 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5fd000b6c0 tx=0x7f5fd000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:46.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fc37fe6c0 1 -- 10.20.193.96:0/1143538972 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5fd00044a0 con 0x7f5fdc115410 2026-02-13T03:34:46.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fc37fe6c0 1 -- 10.20.193.96:0/1143538972 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f5fd0009030 con 0x7f5fdc115410 2026-02-13T03:34:46.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fe433c6c0 1 -- 10.20.193.96:0/1143538972 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fdc163d40 con 0x7f5fdc115410 2026-02-13T03:34:46.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.453+0000 7f5fc37fe6c0 1 -- 10.20.193.96:0/1143538972 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5fd000cc60 con 0x7f5fdc115410 2026-02-13T03:34:46.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.454+0000 7f5fe433c6c0 1 -- 10.20.193.96:0/1143538972 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fdc164220 con 0x7f5fdc115410 2026-02-13T03:34:46.456 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.454+0000 7f5fe433c6c0 1 -- 10.20.193.96:0/1143538972 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fdc1104d0 con 0x7f5fdc115410 2026-02-13T03:34:46.457 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.455+0000 7f5fc37fe6c0 1 -- 10.20.193.96:0/1143538972 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f5fd0005080 con 0x7f5fdc115410 2026-02-13T03:34:46.457 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.456+0000 7f5fc37fe6c0 1 --2- 10.20.193.96:0/1143538972 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f5fb80b5710 0x7f5fb80d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:46.457 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.456+0000 7f5fe20b16c0 1 --2- 10.20.193.96:0/1143538972 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f5fb80b5710 0x7f5fb80d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:46.457 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.456+0000 7f5fc37fe6c0 1 -- 10.20.193.96:0/1143538972 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f5fd00e3970 con 0x7f5fdc115410 2026-02-13T03:34:46.458 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.456+0000 7f5fe20b16c0 1 --2- 10.20.193.96:0/1143538972 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f5fb80b5710 0x7f5fb80d5bc0 secure :-1 s=READY pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5fcc0023e0 tx=0x7f5fcc009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:46.458 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.456+0000 7f5fc37fe6c0 1 -- 10.20.193.96:0/1143538972 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5fd00a6390 con 0x7f5fdc115410 2026-02-13T03:34:46.574 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.573+0000 7f5fe433c6c0 1 -- 10.20.193.96:0/1143538972 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5fdc11e400 con 0x7f5fdc115410 2026-02-13T03:34:46.574 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.573+0000 7f5fc37fe6c0 1 -- 10.20.193.96:0/1143538972 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f5fd00a9540 con 0x7f5fdc115410 2026-02-13T03:34:46.575 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:46.575 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:34:46.576 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.574+0000 7f5fe433c6c0 1 -- 10.20.193.96:0/1143538972 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f5fb80b5710 msgr2=0x7f5fb80d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:46.576 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.574+0000 7f5fe433c6c0 1 --2- 10.20.193.96:0/1143538972 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f5fb80b5710 0x7f5fb80d5bc0 secure :-1 s=READY pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5fcc0023e0 tx=0x7f5fcc009260 comp rx=0 tx=0).stop 2026-02-13T03:34:46.576 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.574+0000 7f5fe433c6c0 1 -- 10.20.193.96:0/1143538972 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5fdc115410 msgr2=0x7f5fdc11d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:46.576 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.574+0000 7f5fe433c6c0 1 --2- 10.20.193.96:0/1143538972 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5fdc115410 0x7f5fdc11d790 secure :-1 s=READY pgs=334 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5fd000b6c0 tx=0x7f5fd000bb90 comp rx=0 tx=0).stop 2026-02-13T03:34:46.576 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.574+0000 7f5fe433c6c0 1 -- 10.20.193.96:0/1143538972 shutdown_connections 2026-02-13T03:34:46.576 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.574+0000 7f5fe433c6c0 1 --2- 10.20.193.96:0/1143538972 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f5fb80b5710 0x7f5fb80d5bc0 unknown :-1 s=CLOSED pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:46.576 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.574+0000 7f5fe433c6c0 1 --2- 10.20.193.96:0/1143538972 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5fdc122b50 0x7f5fdc122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:46.576 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.574+0000 7f5fe433c6c0 1 --2- 10.20.193.96:0/1143538972 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5fdc115410 0x7f5fdc11d790 unknown :-1 s=CLOSED pgs=334 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:46.576 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.574+0000 7f5fe433c6c0 1 --2- 10.20.193.96:0/1143538972 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5fdc10f200 0x7f5fdc11d250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:46.576 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.574+0000 7f5fe433c6c0 1 -- 10.20.193.96:0/1143538972 >> 10.20.193.96:0/1143538972 conn(0x7f5fdc0ecb00 msgr2=0x7f5fdc10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:46.576 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.574+0000 7f5fe433c6c0 1 -- 10.20.193.96:0/1143538972 shutdown_connections 2026-02-13T03:34:46.576 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:46.574+0000 7f5fe433c6c0 1 -- 10.20.193.96:0/1143538972 wait complete. 2026-02-13T03:34:46.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:46 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1143538972' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:46.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:46 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1143538972' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:47.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:46 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1143538972' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:47.923 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:47 trial096 ceph-mon[24671]: pgmap v199: 97 pgs: 97 active+clean; 648 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-13T03:34:47.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:47 trial132 ceph-mon[26888]: pgmap v199: 97 pgs: 97 active+clean; 648 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-13T03:34:48.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:47 trial133 ceph-mon[26943]: pgmap v199: 97 pgs: 97 active+clean; 648 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-13T03:34:49.616 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:34:49.735 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:49.848 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.846+0000 7f585ae836c0 1 -- 10.20.193.96:0/2974517447 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f585410f200 msgr2=0x7f585410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:49.848 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.846+0000 7f585ae836c0 1 --2- 10.20.193.96:0/2974517447 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f585410f200 0x7f585410f5d0 secure :-1 s=READY pgs=335 gs=1 cs=0 l=1 c_cookie=1402571928951019840 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58440099a0 tx=0x7f584402ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:49.848 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.846+0000 7f585ae836c0 1 -- 10.20.193.96:0/2974517447 shutdown_connections 2026-02-13T03:34:49.848 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.846+0000 7f585ae836c0 1 --2- 10.20.193.96:0/2974517447 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5854115410 0x7f5854175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:49.848 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.846+0000 7f585ae836c0 1 --2- 10.20.193.96:0/2974517447 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f585410fbf0 0x7f5854114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:49.848 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.846+0000 7f585ae836c0 1 --2- 10.20.193.96:0/2974517447 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f585410f200 0x7f585410f5d0 unknown :-1 s=CLOSED pgs=335 gs=1 cs=0 l=1 c_cookie=1402571928951019840 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:49.848 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.846+0000 7f585ae836c0 1 -- 10.20.193.96:0/2974517447 >> 10.20.193.96:0/2974517447 conn(0x7f58540ecb00 msgr2=0x7f585410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:49.848 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.846+0000 7f585ae836c0 1 -- 10.20.193.96:0/2974517447 shutdown_connections 2026-02-13T03:34:49.848 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.846+0000 7f585ae836c0 1 -- 10.20.193.96:0/2974517447 wait complete. 2026-02-13T03:34:49.849 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f585ae836c0 1 Processor -- start 2026-02-13T03:34:49.849 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f585ae836c0 1 -- start start 2026-02-13T03:34:49.849 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f585ae836c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f585410f200 0x7f585411d210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:49.849 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f585ae836c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5854115410 0x7f585411d750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:49.849 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f585ae836c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5854122b10 0x7f5854122fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:49.849 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f585ae836c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5854123520 con 0x7f585410f200 2026-02-13T03:34:49.849 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f585ae836c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5854123690 con 0x7f5854115410 2026-02-13T03:34:49.849 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f585ae836c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5854123850 con 0x7f5854122b10 2026-02-13T03:34:49.849 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f5858bf46c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f585410f200 0x7f585411d210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:49.849 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f5858bf46c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f585410f200 0x7f585411d210 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:54028/0 (socket says 10.20.193.96:54028) 2026-02-13T03:34:49.849 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f5858bf46c0 1 -- 10.20.193.96:0/3637490869 learned_addr learned my addr 10.20.193.96:0/3637490869 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:49.849 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f58593f56c0 1 --2- 10.20.193.96:0/3637490869 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5854122b10 0x7f5854122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:49.849 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f584bfff6c0 1 --2- 10.20.193.96:0/3637490869 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5854115410 0x7f585411d750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:49.849 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f5858bf46c0 1 -- 10.20.193.96:0/3637490869 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5854122b10 msgr2=0x7f5854122fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:49.849 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f5858bf46c0 1 --2- 10.20.193.96:0/3637490869 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5854122b10 0x7f5854122fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:49.849 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f5858bf46c0 1 -- 10.20.193.96:0/3637490869 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5854115410 msgr2=0x7f585411d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:49.849 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f5858bf46c0 1 --2- 10.20.193.96:0/3637490869 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5854115410 0x7f585411d750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:49.849 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f5858bf46c0 1 -- 10.20.193.96:0/3637490869 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5844009590 con 0x7f585410f200 2026-02-13T03:34:49.849 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f58593f56c0 1 --2- 10.20.193.96:0/3637490869 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5854122b10 0x7f5854122fb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:34:49.849 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f584bfff6c0 1 --2- 10.20.193.96:0/3637490869 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5854115410 0x7f585411d750 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:34:49.849 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f5858bf46c0 1 --2- 10.20.193.96:0/3637490869 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f585410f200 0x7f585411d210 secure :-1 s=READY pgs=336 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58440098c0 tx=0x7f58440047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:49.849 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f5849ffb6c0 1 -- 10.20.193.96:0/3637490869 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5844002ae0 con 0x7f585410f200 2026-02-13T03:34:49.850 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f585ae836c0 1 -- 10.20.193.96:0/3637490869 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5854163ca0 con 0x7f585410f200 2026-02-13T03:34:49.850 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f5849ffb6c0 1 -- 10.20.193.96:0/3637490869 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f5844002c40 con 0x7f585410f200 2026-02-13T03:34:49.850 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f5849ffb6c0 1 -- 10.20.193.96:0/3637490869 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58440372f0 con 0x7f585410f200 2026-02-13T03:34:49.850 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.847+0000 7f585ae836c0 1 -- 10.20.193.96:0/3637490869 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58541640d0 con 0x7f585410f200 2026-02-13T03:34:49.850 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.848+0000 7f585ae836c0 1 -- 10.20.193.96:0/3637490869 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58541104d0 con 0x7f585410f200 2026-02-13T03:34:49.851 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.849+0000 7f5849ffb6c0 1 -- 10.20.193.96:0/3637490869 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f5844007960 con 0x7f585410f200 2026-02-13T03:34:49.852 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.850+0000 7f5849ffb6c0 1 --2- 10.20.193.96:0/3637490869 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f58300b5690 0x7f58300d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:49.852 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.850+0000 7f584bfff6c0 1 --2- 10.20.193.96:0/3637490869 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f58300b5690 0x7f58300d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:49.852 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.850+0000 7f5849ffb6c0 1 -- 10.20.193.96:0/3637490869 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7762+0+0 (secure 0 0 0) 0x7f5844107d60 con 0x7f585410f200 2026-02-13T03:34:49.852 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.850+0000 7f584bfff6c0 1 --2- 10.20.193.96:0/3637490869 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f58300b5690 0x7f58300d5b40 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f583c005dc0 tx=0x7f583c005f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:49.852 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.850+0000 7f5849ffb6c0 1 -- 10.20.193.96:0/3637490869 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f58440cd930 con 0x7f585410f200 2026-02-13T03:34:49.923 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:49 trial096 ceph-mon[24671]: pgmap v200: 97 pgs: 97 active+clean; 648 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-13T03:34:49.966 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.965+0000 7f585ae836c0 1 -- 10.20.193.96:0/3637490869 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f585410fbf0 con 0x7f585410f200 2026-02-13T03:34:49.966 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.965+0000 7f5849ffb6c0 1 -- 10.20.193.96:0/3637490869 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f58440cdb10 con 0x7f585410f200 2026-02-13T03:34:49.967 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:49.967 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:34:49.968 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.966+0000 7f585ae836c0 1 -- 10.20.193.96:0/3637490869 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f58300b5690 msgr2=0x7f58300d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:49.968 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.966+0000 7f585ae836c0 1 --2- 10.20.193.96:0/3637490869 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f58300b5690 0x7f58300d5b40 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f583c005dc0 tx=0x7f583c005f90 comp rx=0 tx=0).stop 2026-02-13T03:34:49.968 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.966+0000 7f585ae836c0 1 -- 10.20.193.96:0/3637490869 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f585410f200 msgr2=0x7f585411d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:49.968 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.966+0000 7f585ae836c0 1 --2- 10.20.193.96:0/3637490869 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f585410f200 0x7f585411d210 secure :-1 s=READY pgs=336 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58440098c0 tx=0x7f58440047f0 comp rx=0 tx=0).stop 2026-02-13T03:34:49.968 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.966+0000 7f585ae836c0 1 -- 10.20.193.96:0/3637490869 shutdown_connections 2026-02-13T03:34:49.968 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.966+0000 7f585ae836c0 1 --2- 10.20.193.96:0/3637490869 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f58300b5690 0x7f58300d5b40 unknown :-1 s=CLOSED pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:49.968 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.966+0000 7f585ae836c0 1 --2- 10.20.193.96:0/3637490869 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5854122b10 0x7f5854122fb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:49.968 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.966+0000 7f585ae836c0 1 --2- 10.20.193.96:0/3637490869 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5854115410 0x7f585411d750 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:49.968 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.966+0000 7f585ae836c0 1 --2- 10.20.193.96:0/3637490869 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f585410f200 0x7f585411d210 unknown :-1 s=CLOSED pgs=336 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:49.968 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.966+0000 7f585ae836c0 1 -- 10.20.193.96:0/3637490869 >> 10.20.193.96:0/3637490869 conn(0x7f58540ecb00 msgr2=0x7f585410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:49.968 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.966+0000 7f585ae836c0 1 -- 10.20.193.96:0/3637490869 shutdown_connections 2026-02-13T03:34:49.968 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:49.966+0000 7f585ae836c0 1 -- 10.20.193.96:0/3637490869 wait complete. 2026-02-13T03:34:49.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:49 trial132 ceph-mon[26888]: pgmap v200: 97 pgs: 97 active+clean; 648 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-13T03:34:50.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:49 trial133 ceph-mon[26943]: pgmap v200: 97 pgs: 97 active+clean; 648 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-13T03:34:50.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:50 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3637490869' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:50.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:50 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3637490869' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:51.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:50 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3637490869' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:51.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:51 trial096 ceph-mon[24671]: pgmap v201: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 597 B/s wr, 7 op/s 2026-02-13T03:34:51.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:51 trial132 ceph-mon[26888]: pgmap v201: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 597 B/s wr, 7 op/s 2026-02-13T03:34:52.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:51 trial133 ceph-mon[26943]: pgmap v201: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 597 B/s wr, 7 op/s 2026-02-13T03:34:52.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2026-02-13T03:34:52.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9, 5, 8]} : dispatch 2026-02-13T03:34:52.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]} : dispatch 2026-02-13T03:34:52.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]} : dispatch 2026-02-13T03:34:52.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.26", "id": [1, 9]} : dispatch 2026-02-13T03:34:52.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]} : dispatch 2026-02-13T03:34:52.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]} : dispatch 2026-02-13T03:34:52.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]} : dispatch 2026-02-13T03:34:52.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]} : dispatch 2026-02-13T03:34:52.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2026-02-13T03:34:52.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9, 5, 8]} : dispatch 2026-02-13T03:34:52.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]} : dispatch 2026-02-13T03:34:52.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]} : dispatch 2026-02-13T03:34:52.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.26", "id": [1, 9]} : dispatch 2026-02-13T03:34:52.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]} : dispatch 2026-02-13T03:34:52.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]} : dispatch 2026-02-13T03:34:52.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]} : dispatch 2026-02-13T03:34:52.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]} : dispatch 2026-02-13T03:34:53.010 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:34:53.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2026-02-13T03:34:53.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9, 5, 8]} : dispatch 2026-02-13T03:34:53.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]} : dispatch 2026-02-13T03:34:53.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]} : dispatch 2026-02-13T03:34:53.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.26", "id": [1, 9]} : dispatch 2026-02-13T03:34:53.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]} : dispatch 2026-02-13T03:34:53.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]} : dispatch 2026-02-13T03:34:53.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]} : dispatch 2026-02-13T03:34:53.015 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]} : dispatch 2026-02-13T03:34:53.129 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:53.244 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febba7686c0 1 -- 10.20.193.96:0/28986249 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7febb410f230 msgr2=0x7febb410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:53.244 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febba7686c0 1 --2- 10.20.193.96:0/28986249 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7febb410f230 0x7febb410f600 secure :-1 s=READY pgs=337 gs=1 cs=0 l=1 c_cookie=6846587667663502854 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feba00099a0 tx=0x7feba002ed20 comp rx=0 tx=0).stop 2026-02-13T03:34:53.245 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febba7686c0 1 -- 10.20.193.96:0/28986249 shutdown_connections 2026-02-13T03:34:53.245 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febba7686c0 1 --2- 10.20.193.96:0/28986249 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7febb4115440 0x7febb4175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:53.245 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febba7686c0 1 --2- 10.20.193.96:0/28986249 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7febb410fc20 0x7febb4114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:53.245 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febba7686c0 1 --2- 10.20.193.96:0/28986249 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7febb410f230 0x7febb410f600 unknown :-1 s=CLOSED pgs=337 gs=1 cs=0 l=1 c_cookie=6846587667663502854 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:53.245 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febba7686c0 1 -- 10.20.193.96:0/28986249 >> 10.20.193.96:0/28986249 conn(0x7febb40ecb30 msgr2=0x7febb410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:53.245 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febba7686c0 1 -- 10.20.193.96:0/28986249 shutdown_connections 2026-02-13T03:34:53.245 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febba7686c0 1 -- 10.20.193.96:0/28986249 wait complete. 2026-02-13T03:34:53.245 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febba7686c0 1 Processor -- start 2026-02-13T03:34:53.245 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febba7686c0 1 -- start start 2026-02-13T03:34:53.245 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febba7686c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7febb410f230 0x7febb411d210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:53.245 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febba7686c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7febb4115440 0x7febb411d750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:53.246 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febba7686c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7febb4122b10 0x7febb4122fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:53.246 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febba7686c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7febb4123520 con 0x7febb4115440 2026-02-13T03:34:53.246 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febba7686c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7febb4123690 con 0x7febb410f230 2026-02-13T03:34:53.246 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febba7686c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7febb4123850 con 0x7febb4122b10 2026-02-13T03:34:53.246 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febb37fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7febb4115440 0x7febb411d750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:53.246 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febb37fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7febb4115440 0x7febb411d750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:44720/0 (socket says 10.20.193.96:44720) 2026-02-13T03:34:53.246 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febb37fe6c0 1 -- 10.20.193.96:0/3180935516 learned_addr learned my addr 10.20.193.96:0/3180935516 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:53.246 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febb3fff6c0 1 --2- 10.20.193.96:0/3180935516 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7febb410f230 0x7febb411d210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:53.246 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febb37fe6c0 1 -- 10.20.193.96:0/3180935516 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7febb4122b10 msgr2=0x7febb4122fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:53.246 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febb37fe6c0 1 --2- 10.20.193.96:0/3180935516 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7febb4122b10 0x7febb4122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:53.246 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febb37fe6c0 1 -- 10.20.193.96:0/3180935516 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7febb410f230 msgr2=0x7febb411d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:53.247 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febb37fe6c0 1 --2- 10.20.193.96:0/3180935516 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7febb410f230 0x7febb411d210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:53.247 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febb37fe6c0 1 -- 10.20.193.96:0/3180935516 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba0009590 con 0x7febb4115440 2026-02-13T03:34:53.247 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febb37fe6c0 1 --2- 10.20.193.96:0/3180935516 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7febb4115440 0x7febb411d750 secure :-1 s=READY pgs=338 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feba400b6c0 tx=0x7feba400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:53.247 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febb17fa6c0 1 -- 10.20.193.96:0/3180935516 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feba4004250 con 0x7febb4115440 2026-02-13T03:34:53.247 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febb17fa6c0 1 -- 10.20.193.96:0/3180935516 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7feba4009070 con 0x7febb4115440 2026-02-13T03:34:53.247 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febb17fa6c0 1 -- 10.20.193.96:0/3180935516 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feba400ccd0 con 0x7febb4115440 2026-02-13T03:34:53.247 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.240+0000 7febba7686c0 1 -- 10.20.193.96:0/3180935516 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb4163d00 con 0x7febb4115440 2026-02-13T03:34:53.247 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.241+0000 7febba7686c0 1 -- 10.20.193.96:0/3180935516 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb4164190 con 0x7febb4115440 2026-02-13T03:34:53.247 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.241+0000 7febba7686c0 1 -- 10.20.193.96:0/3180935516 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb4110500 con 0x7febb4115440 2026-02-13T03:34:53.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.242+0000 7febb17fa6c0 1 -- 10.20.193.96:0/3180935516 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7feba40028c0 con 0x7febb4115440 2026-02-13T03:34:53.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.243+0000 7febb17fa6c0 1 --2- 10.20.193.96:0/3180935516 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7feb880b5690 0x7feb880d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:53.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.243+0000 7febb17fa6c0 1 -- 10.20.193.96:0/3180935516 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 8031+0+0 (secure 0 0 0) 0x7feba40e3cc0 con 0x7febb4115440 2026-02-13T03:34:53.249 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.243+0000 7febb3fff6c0 1 --2- 10.20.193.96:0/3180935516 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7feb880b5690 0x7feb880d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:53.249 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.243+0000 7febb17fa6c0 1 -- 10.20.193.96:0/3180935516 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7feba40a65e0 con 0x7febb4115440 2026-02-13T03:34:53.249 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.243+0000 7febb3fff6c0 1 --2- 10.20.193.96:0/3180935516 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7feb880b5690 0x7feb880d5b40 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feba00023e0 tx=0x7feba0005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:53.360 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.357+0000 7febba7686c0 1 -- 10.20.193.96:0/3180935516 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7febb410f600 con 0x7febb4115440 2026-02-13T03:34:53.360 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.357+0000 7febb17fa6c0 1 -- 10.20.193.96:0/3180935516 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7feba40a9790 con 0x7febb4115440 2026-02-13T03:34:53.360 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:53.361 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:34:53.361 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.358+0000 7febba7686c0 1 -- 10.20.193.96:0/3180935516 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7feb880b5690 msgr2=0x7feb880d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:53.362 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.358+0000 7febba7686c0 1 --2- 10.20.193.96:0/3180935516 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7feb880b5690 0x7feb880d5b40 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feba00023e0 tx=0x7feba0005c00 comp rx=0 tx=0).stop 2026-02-13T03:34:53.362 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.358+0000 7febba7686c0 1 -- 10.20.193.96:0/3180935516 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7febb4115440 msgr2=0x7febb411d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:53.362 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.358+0000 7febba7686c0 1 --2- 10.20.193.96:0/3180935516 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7febb4115440 0x7febb411d750 secure :-1 s=READY pgs=338 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feba400b6c0 tx=0x7feba400bb90 comp rx=0 tx=0).stop 2026-02-13T03:34:53.362 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.358+0000 7febba7686c0 1 -- 10.20.193.96:0/3180935516 shutdown_connections 2026-02-13T03:34:53.362 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.358+0000 7febba7686c0 1 --2- 10.20.193.96:0/3180935516 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7feb880b5690 0x7feb880d5b40 unknown :-1 s=CLOSED pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:53.362 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.358+0000 7febba7686c0 1 --2- 10.20.193.96:0/3180935516 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7febb4122b10 0x7febb4122fb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:53.362 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.358+0000 7febba7686c0 1 --2- 10.20.193.96:0/3180935516 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7febb4115440 0x7febb411d750 unknown :-1 s=CLOSED pgs=338 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:53.362 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.358+0000 7febba7686c0 1 --2- 10.20.193.96:0/3180935516 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7febb410f230 0x7febb411d210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:53.362 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.358+0000 7febba7686c0 1 -- 10.20.193.96:0/3180935516 >> 10.20.193.96:0/3180935516 conn(0x7febb40ecb30 msgr2=0x7febb410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:53.362 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.358+0000 7febba7686c0 1 -- 10.20.193.96:0/3180935516 shutdown_connections 2026-02-13T03:34:53.362 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:53.358+0000 7febba7686c0 1 -- 10.20.193.96:0/3180935516 wait complete. 2026-02-13T03:34:53.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:53 trial096 ceph-mon[24671]: pgmap v202: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2026-02-13T03:34:53.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2026-02-13T03:34:53.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9, 5, 8]}]': finished 2026-02-13T03:34:53.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]': finished 2026-02-13T03:34:53.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]': finished 2026-02-13T03:34:53.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.26", "id": [1, 9]}]': finished 2026-02-13T03:34:53.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2026-02-13T03:34:53.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]': finished 2026-02-13T03:34:53.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2026-02-13T03:34:53.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2026-02-13T03:34:53.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:53 trial096 ceph-mon[24671]: osdmap e69: 12 total, 12 up, 12 in 2026-02-13T03:34:53.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:53 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3180935516' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:53.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:53 trial132 ceph-mon[26888]: pgmap v202: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2026-02-13T03:34:53.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2026-02-13T03:34:53.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9, 5, 8]}]': finished 2026-02-13T03:34:53.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]': finished 2026-02-13T03:34:53.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]': finished 2026-02-13T03:34:53.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.26", "id": [1, 9]}]': finished 2026-02-13T03:34:53.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2026-02-13T03:34:53.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]': finished 2026-02-13T03:34:53.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2026-02-13T03:34:53.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2026-02-13T03:34:53.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:53 trial132 ceph-mon[26888]: osdmap e69: 12 total, 12 up, 12 in 2026-02-13T03:34:53.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:53 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3180935516' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:54.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:53 trial133 ceph-mon[26943]: pgmap v202: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2026-02-13T03:34:54.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2026-02-13T03:34:54.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9, 5, 8]}]': finished 2026-02-13T03:34:54.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]': finished 2026-02-13T03:34:54.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]': finished 2026-02-13T03:34:54.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.26", "id": [1, 9]}]': finished 2026-02-13T03:34:54.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2026-02-13T03:34:54.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]': finished 2026-02-13T03:34:54.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2026-02-13T03:34:54.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2026-02-13T03:34:54.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:53 trial133 ceph-mon[26943]: osdmap e69: 12 total, 12 up, 12 in 2026-02-13T03:34:54.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:53 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3180935516' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:54.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:54 trial096 ceph-mon[24671]: osdmap e70: 12 total, 12 up, 12 in 2026-02-13T03:34:54.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:54 trial132 ceph-mon[26888]: osdmap e70: 12 total, 12 up, 12 in 2026-02-13T03:34:55.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:54 trial133 ceph-mon[26943]: osdmap e70: 12 total, 12 up, 12 in 2026-02-13T03:34:55.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:55 trial096 ceph-mon[24671]: pgmap v205: 97 pgs: 2 peering, 95 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.9 KiB/s rd, 255 B/s wr, 4 op/s 2026-02-13T03:34:55.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:55 trial132 ceph-mon[26888]: pgmap v205: 97 pgs: 2 peering, 95 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.9 KiB/s rd, 255 B/s wr, 4 op/s 2026-02-13T03:34:56.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:55 trial133 ceph-mon[26943]: pgmap v205: 97 pgs: 2 peering, 95 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.9 KiB/s rd, 255 B/s wr, 4 op/s 2026-02-13T03:34:56.402 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:34:56.522 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:56.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.637+0000 7ff96e3156c0 1 -- 10.20.193.96:0/4074230469 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff9681131c0 msgr2=0x7ff968173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:56.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.637+0000 7ff96e3156c0 1 --2- 10.20.193.96:0/4074230469 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff9681131c0 0x7ff968173b60 secure :-1 s=READY pgs=339 gs=1 cs=0 l=1 c_cookie=4630757881904205976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff95c00aa70 tx=0x7ff95c02fde0 comp rx=0 tx=0).stop 2026-02-13T03:34:56.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff96e3156c0 1 -- 10.20.193.96:0/4074230469 shutdown_connections 2026-02-13T03:34:56.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff96e3156c0 1 --2- 10.20.193.96:0/4074230469 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff9681131c0 0x7ff968173b60 unknown :-1 s=CLOSED pgs=339 gs=1 cs=0 l=1 c_cookie=4630757881904205976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:56.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff96e3156c0 1 --2- 10.20.193.96:0/4074230469 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff96810d9a0 0x7ff9681129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:56.644 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff96e3156c0 1 --2- 10.20.193.96:0/4074230469 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff96810cfb0 0x7ff96810d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:56.644 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff96e3156c0 1 -- 10.20.193.96:0/4074230469 >> 10.20.193.96:0/4074230469 conn(0x7ff9680ea8b0 msgr2=0x7ff96810acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:56.644 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff96e3156c0 1 -- 10.20.193.96:0/4074230469 shutdown_connections 2026-02-13T03:34:56.644 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff96e3156c0 1 -- 10.20.193.96:0/4074230469 wait complete. 2026-02-13T03:34:56.644 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff96e3156c0 1 Processor -- start 2026-02-13T03:34:56.644 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff96e3156c0 1 -- start start 2026-02-13T03:34:56.644 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff96e3156c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff96810cfb0 0x7ff9680f4af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:56.644 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff96e3156c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff9681131c0 0x7ff968173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:56.644 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff96e3156c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff9680f5120 0x7ff9680fa3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:56.644 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff96e3156c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff9680f5810 con 0x7ff96810cfb0 2026-02-13T03:34:56.644 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff96e3156c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff9680fa930 con 0x7ff9681131c0 2026-02-13T03:34:56.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff96e3156c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff9680faaf0 con 0x7ff9680f5120 2026-02-13T03:34:56.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff967fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff96810cfb0 0x7ff9680f4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:56.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff967fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff96810cfb0 0x7ff9680f4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:44740/0 (socket says 10.20.193.96:44740) 2026-02-13T03:34:56.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff967fff6c0 1 -- 10.20.193.96:0/4061936342 learned_addr learned my addr 10.20.193.96:0/4061936342 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:34:56.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff96c8876c0 1 --2- 10.20.193.96:0/4061936342 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff9680f5120 0x7ff9680fa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:56.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff9677fe6c0 1 --2- 10.20.193.96:0/4061936342 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff9681131c0 0x7ff968173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:56.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff967fff6c0 1 -- 10.20.193.96:0/4061936342 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff9680f5120 msgr2=0x7ff9680fa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:56.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff967fff6c0 1 --2- 10.20.193.96:0/4061936342 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff9680f5120 0x7ff9680fa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:56.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff967fff6c0 1 -- 10.20.193.96:0/4061936342 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff9681131c0 msgr2=0x7ff968173a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:56.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff967fff6c0 1 --2- 10.20.193.96:0/4061936342 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff9681131c0 0x7ff968173a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:56.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff967fff6c0 1 -- 10.20.193.96:0/4061936342 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff95c00a660 con 0x7ff96810cfb0 2026-02-13T03:34:56.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff96c8876c0 1 --2- 10.20.193.96:0/4061936342 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff9680f5120 0x7ff9680fa3f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:34:56.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.638+0000 7ff967fff6c0 1 --2- 10.20.193.96:0/4061936342 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff96810cfb0 0x7ff9680f4af0 secure :-1 s=READY pgs=340 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff95400b710 tx=0x7ff95400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:56.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.639+0000 7ff9657fa6c0 1 -- 10.20.193.96:0/4061936342 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff954004250 con 0x7ff96810cfb0 2026-02-13T03:34:56.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.639+0000 7ff9657fa6c0 1 -- 10.20.193.96:0/4061936342 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7ff954002da0 con 0x7ff96810cfb0 2026-02-13T03:34:56.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.639+0000 7ff96e3156c0 1 -- 10.20.193.96:0/4061936342 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9680fadd0 con 0x7ff96810cfb0 2026-02-13T03:34:56.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.639+0000 7ff9657fa6c0 1 -- 10.20.193.96:0/4061936342 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff95400ce50 con 0x7ff96810cfb0 2026-02-13T03:34:56.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.639+0000 7ff96e3156c0 1 -- 10.20.193.96:0/4061936342 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9680fb560 con 0x7ff96810cfb0 2026-02-13T03:34:56.646 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.639+0000 7ff96e3156c0 1 -- 10.20.193.96:0/4061936342 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff96810e280 con 0x7ff96810cfb0 2026-02-13T03:34:56.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.640+0000 7ff9657fa6c0 1 -- 10.20.193.96:0/4061936342 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7ff9540043b0 con 0x7ff96810cfb0 2026-02-13T03:34:56.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.641+0000 7ff9657fa6c0 1 --2- 10.20.193.96:0/4061936342 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff93c0b5680 0x7ff93c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:34:56.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.641+0000 7ff9657fa6c0 1 -- 10.20.193.96:0/4061936342 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8031+0+0 (secure 0 0 0) 0x7ff9540e3bd0 con 0x7ff96810cfb0 2026-02-13T03:34:56.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.641+0000 7ff9677fe6c0 1 --2- 10.20.193.96:0/4061936342 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff93c0b5680 0x7ff93c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:34:56.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.641+0000 7ff9677fe6c0 1 --2- 10.20.193.96:0/4061936342 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff93c0b5680 0x7ff93c0d5b30 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9680fb480 tx=0x7ff958009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:34:56.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.641+0000 7ff9657fa6c0 1 -- 10.20.193.96:0/4061936342 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff9540a6530 con 0x7ff96810cfb0 2026-02-13T03:34:56.759 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.756+0000 7ff96e3156c0 1 -- 10.20.193.96:0/4061936342 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff9680f5c40 con 0x7ff96810cfb0 2026-02-13T03:34:56.759 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.756+0000 7ff9657fa6c0 1 -- 10.20.193.96:0/4061936342 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff9540a96e0 con 0x7ff96810cfb0 2026-02-13T03:34:56.760 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:34:56.760 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:34:56.761 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.757+0000 7ff96e3156c0 1 -- 10.20.193.96:0/4061936342 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff93c0b5680 msgr2=0x7ff93c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:56.761 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.757+0000 7ff96e3156c0 1 --2- 10.20.193.96:0/4061936342 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff93c0b5680 0x7ff93c0d5b30 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9680fb480 tx=0x7ff958009260 comp rx=0 tx=0).stop 2026-02-13T03:34:56.761 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.757+0000 7ff96e3156c0 1 -- 10.20.193.96:0/4061936342 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff96810cfb0 msgr2=0x7ff9680f4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:34:56.761 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.757+0000 7ff96e3156c0 1 --2- 10.20.193.96:0/4061936342 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff96810cfb0 0x7ff9680f4af0 secure :-1 s=READY pgs=340 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff95400b710 tx=0x7ff95400bbe0 comp rx=0 tx=0).stop 2026-02-13T03:34:56.761 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.757+0000 7ff96e3156c0 1 -- 10.20.193.96:0/4061936342 shutdown_connections 2026-02-13T03:34:56.761 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.757+0000 7ff96e3156c0 1 --2- 10.20.193.96:0/4061936342 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff93c0b5680 0x7ff93c0d5b30 unknown :-1 s=CLOSED pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:56.761 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.757+0000 7ff96e3156c0 1 --2- 10.20.193.96:0/4061936342 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff9680f5120 0x7ff9680fa3f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:56.762 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.757+0000 7ff96e3156c0 1 --2- 10.20.193.96:0/4061936342 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff9681131c0 0x7ff968173a60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:56.762 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.757+0000 7ff96e3156c0 1 --2- 10.20.193.96:0/4061936342 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff96810cfb0 0x7ff9680f4af0 unknown :-1 s=CLOSED pgs=340 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:34:56.762 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.757+0000 7ff96e3156c0 1 -- 10.20.193.96:0/4061936342 >> 10.20.193.96:0/4061936342 conn(0x7ff9680ea8b0 msgr2=0x7ff96810e770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:34:56.762 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.757+0000 7ff96e3156c0 1 -- 10.20.193.96:0/4061936342 shutdown_connections 2026-02-13T03:34:56.762 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:34:56.757+0000 7ff96e3156c0 1 -- 10.20.193.96:0/4061936342 wait complete. 2026-02-13T03:34:57.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:57 trial096 ceph-mon[24671]: pgmap v206: 97 pgs: 2 peering, 95 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-13T03:34:57.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:57 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/4061936342' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:57.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:57 trial132 ceph-mon[26888]: pgmap v206: 97 pgs: 2 peering, 95 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-13T03:34:57.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:57 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/4061936342' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:58.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:57 trial133 ceph-mon[26943]: pgmap v206: 97 pgs: 2 peering, 95 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-13T03:34:58.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:57 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/4061936342' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:34:59.802 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:34:59.918 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:34:59.941 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:34:59 trial096 ceph-mon[24671]: pgmap v207: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.1 KiB/s rd, 4 op/s; 18 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T03:34:59.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:34:59 trial132 ceph-mon[26888]: pgmap v207: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.1 KiB/s rd, 4 op/s; 18 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T03:35:00.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:34:59 trial133 ceph-mon[26943]: pgmap v207: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.1 KiB/s rd, 4 op/s; 18 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T03:35:00.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459ffc76c0 1 -- 10.20.193.96:0/704721745 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f459810fc20 msgr2=0x7f4598114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:00.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459ffc76c0 1 --2- 10.20.193.96:0/704721745 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f459810fc20 0x7f4598114c60 secure :-1 s=READY pgs=341 gs=1 cs=0 l=1 c_cookie=3902666731946435174 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f458c0099a0 tx=0x7f458c02ed50 comp rx=0 tx=0).stop 2026-02-13T03:35:00.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459ffc76c0 1 -- 10.20.193.96:0/704721745 shutdown_connections 2026-02-13T03:35:00.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459ffc76c0 1 --2- 10.20.193.96:0/704721745 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4598115440 0x7f4598175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:00.041 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459ffc76c0 1 --2- 10.20.193.96:0/704721745 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f459810fc20 0x7f4598114c60 unknown :-1 s=CLOSED pgs=341 gs=1 cs=0 l=1 c_cookie=3902666731946435174 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:00.041 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459ffc76c0 1 --2- 10.20.193.96:0/704721745 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f459810f230 0x7f459810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:00.041 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459ffc76c0 1 -- 10.20.193.96:0/704721745 >> 10.20.193.96:0/704721745 conn(0x7f45980ecb30 msgr2=0x7f459810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:00.041 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459ffc76c0 1 -- 10.20.193.96:0/704721745 shutdown_connections 2026-02-13T03:35:00.041 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459ffc76c0 1 -- 10.20.193.96:0/704721745 wait complete. 2026-02-13T03:35:00.041 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459ffc76c0 1 Processor -- start 2026-02-13T03:35:00.041 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459ffc76c0 1 -- start start 2026-02-13T03:35:00.041 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459ffc76c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f459810f230 0x7f459811d2a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:00.041 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459ffc76c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4598115440 0x7f459811d7e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:00.041 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459ffc76c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4598122ba0 0x7f4598123040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:00.041 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459ffc76c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4598123580 con 0x7f4598115440 2026-02-13T03:35:00.042 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459ffc76c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f45981236f0 con 0x7f459810f230 2026-02-13T03:35:00.042 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459ffc76c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f45981238b0 con 0x7f4598122ba0 2026-02-13T03:35:00.042 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459d5376c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4598115440 0x7f459811d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:00.042 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459d5376c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4598115440 0x7f459811d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:44754/0 (socket says 10.20.193.96:44754) 2026-02-13T03:35:00.042 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459d5376c0 1 -- 10.20.193.96:0/3505805334 learned_addr learned my addr 10.20.193.96:0/3505805334 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:35:00.042 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459d5376c0 1 -- 10.20.193.96:0/3505805334 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4598122ba0 msgr2=0x7f4598123040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:00.042 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459d5376c0 1 --2- 10.20.193.96:0/3505805334 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4598122ba0 0x7f4598123040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:00.042 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459d5376c0 1 -- 10.20.193.96:0/3505805334 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f459810f230 msgr2=0x7f459811d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:00.042 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459dd386c0 1 --2- 10.20.193.96:0/3505805334 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f459810f230 0x7f459811d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:00.042 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459d5376c0 1 --2- 10.20.193.96:0/3505805334 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f459810f230 0x7f459811d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:00.042 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459d5376c0 1 -- 10.20.193.96:0/3505805334 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f458c009590 con 0x7f4598115440 2026-02-13T03:35:00.043 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.035+0000 7f459dd386c0 1 --2- 10.20.193.96:0/3505805334 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f459810f230 0x7f459811d2a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:35:00.043 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.036+0000 7f459d5376c0 1 --2- 10.20.193.96:0/3505805334 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4598115440 0x7f459811d7e0 secure :-1 s=READY pgs=342 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f458c02f260 tx=0x7f458c0047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:00.043 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.036+0000 7f4586ffd6c0 1 -- 10.20.193.96:0/3505805334 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f458c002ae0 con 0x7f4598115440 2026-02-13T03:35:00.043 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.036+0000 7f4586ffd6c0 1 -- 10.20.193.96:0/3505805334 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f458c002c40 con 0x7f4598115440 2026-02-13T03:35:00.043 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.036+0000 7f459ffc76c0 1 -- 10.20.193.96:0/3505805334 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4598163d30 con 0x7f4598115440 2026-02-13T03:35:00.043 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.036+0000 7f4586ffd6c0 1 -- 10.20.193.96:0/3505805334 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f458c0372f0 con 0x7f4598115440 2026-02-13T03:35:00.043 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.036+0000 7f459ffc76c0 1 -- 10.20.193.96:0/3505805334 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4598164200 con 0x7f4598115440 2026-02-13T03:35:00.043 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.036+0000 7f459ffc76c0 1 -- 10.20.193.96:0/3505805334 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4598110500 con 0x7f4598115440 2026-02-13T03:35:00.043 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.037+0000 7f4586ffd6c0 1 -- 10.20.193.96:0/3505805334 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f458c007260 con 0x7f4598115440 2026-02-13T03:35:00.044 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.038+0000 7f4586ffd6c0 1 --2- 10.20.193.96:0/3505805334 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f45740b5710 0x7f45740d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:00.044 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.038+0000 7f459dd386c0 1 --2- 10.20.193.96:0/3505805334 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f45740b5710 0x7f45740d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:00.044 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.038+0000 7f4586ffd6c0 1 -- 10.20.193.96:0/3505805334 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8031+0+0 (secure 0 0 0) 0x7f458c107e40 con 0x7f4598115440 2026-02-13T03:35:00.044 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.038+0000 7f459dd386c0 1 --2- 10.20.193.96:0/3505805334 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f45740b5710 0x7f45740d5bc0 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4588004750 tx=0x7f4588005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:00.045 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.038+0000 7f4586ffd6c0 1 -- 10.20.193.96:0/3505805334 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f458c0ca760 con 0x7f4598115440 2026-02-13T03:35:00.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.153+0000 7f459ffc76c0 1 -- 10.20.193.96:0/3505805334 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f459811e3f0 con 0x7f4598115440 2026-02-13T03:35:00.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.154+0000 7f4586ffd6c0 1 -- 10.20.193.96:0/3505805334 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f458c0cd910 con 0x7f4598115440 2026-02-13T03:35:00.157 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:35:00.157 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:35:00.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.155+0000 7f459ffc76c0 1 -- 10.20.193.96:0/3505805334 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f45740b5710 msgr2=0x7f45740d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:00.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.155+0000 7f459ffc76c0 1 --2- 10.20.193.96:0/3505805334 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f45740b5710 0x7f45740d5bc0 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4588004750 tx=0x7f4588005f10 comp rx=0 tx=0).stop 2026-02-13T03:35:00.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.155+0000 7f459ffc76c0 1 -- 10.20.193.96:0/3505805334 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4598115440 msgr2=0x7f459811d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:00.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.155+0000 7f459ffc76c0 1 --2- 10.20.193.96:0/3505805334 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4598115440 0x7f459811d7e0 secure :-1 s=READY pgs=342 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f458c02f260 tx=0x7f458c0047f0 comp rx=0 tx=0).stop 2026-02-13T03:35:00.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.155+0000 7f459ffc76c0 1 -- 10.20.193.96:0/3505805334 shutdown_connections 2026-02-13T03:35:00.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.155+0000 7f459ffc76c0 1 --2- 10.20.193.96:0/3505805334 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f45740b5710 0x7f45740d5bc0 unknown :-1 s=CLOSED pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:00.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.155+0000 7f459ffc76c0 1 --2- 10.20.193.96:0/3505805334 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4598122ba0 0x7f4598123040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:00.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.155+0000 7f459ffc76c0 1 --2- 10.20.193.96:0/3505805334 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4598115440 0x7f459811d7e0 unknown :-1 s=CLOSED pgs=342 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:00.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.155+0000 7f459ffc76c0 1 --2- 10.20.193.96:0/3505805334 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f459810f230 0x7f459811d2a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:00.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.155+0000 7f459ffc76c0 1 -- 10.20.193.96:0/3505805334 >> 10.20.193.96:0/3505805334 conn(0x7f45980ecb30 msgr2=0x7f459810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:00.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.155+0000 7f459ffc76c0 1 -- 10.20.193.96:0/3505805334 shutdown_connections 2026-02-13T03:35:00.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:00.155+0000 7f459ffc76c0 1 -- 10.20.193.96:0/3505805334 wait complete. 2026-02-13T03:35:00.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:00 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3505805334' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:01.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:00 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3505805334' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:01.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:00 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3505805334' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:01.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:01 trial132 ceph-mon[26888]: pgmap v208: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 6 op/s; 18 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T03:35:02.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:01 trial133 ceph-mon[26943]: pgmap v208: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 6 op/s; 18 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T03:35:02.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:01 trial096 ceph-mon[24671]: pgmap v208: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 6 op/s; 18 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T03:35:03.199 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:35:03.318 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:35:03.428 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.422+0000 7fe571dc36c0 1 -- 10.20.193.96:0/1515089673 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe56c10fbf0 msgr2=0x7fe56c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:03.428 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.422+0000 7fe571dc36c0 1 --2- 10.20.193.96:0/1515089673 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe56c10fbf0 0x7fe56c114c30 secure :-1 s=READY pgs=343 gs=1 cs=0 l=1 c_cookie=17741559381217899460 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe55c0099a0 tx=0x7fe55c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:35:03.428 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.422+0000 7fe571dc36c0 1 -- 10.20.193.96:0/1515089673 shutdown_connections 2026-02-13T03:35:03.428 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.422+0000 7fe571dc36c0 1 --2- 10.20.193.96:0/1515089673 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe56c115410 0x7fe56c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:03.428 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.422+0000 7fe571dc36c0 1 --2- 10.20.193.96:0/1515089673 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe56c10fbf0 0x7fe56c114c30 unknown :-1 s=CLOSED pgs=343 gs=1 cs=0 l=1 c_cookie=17741559381217899460 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:03.428 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.422+0000 7fe571dc36c0 1 --2- 10.20.193.96:0/1515089673 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe56c10f200 0x7fe56c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:03.429 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.422+0000 7fe571dc36c0 1 -- 10.20.193.96:0/1515089673 >> 10.20.193.96:0/1515089673 conn(0x7fe56c0ecb00 msgr2=0x7fe56c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:03.429 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.423+0000 7fe571dc36c0 1 -- 10.20.193.96:0/1515089673 shutdown_connections 2026-02-13T03:35:03.429 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.423+0000 7fe571dc36c0 1 -- 10.20.193.96:0/1515089673 wait complete. 2026-02-13T03:35:03.429 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.423+0000 7fe571dc36c0 1 Processor -- start 2026-02-13T03:35:03.429 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.423+0000 7fe571dc36c0 1 -- start start 2026-02-13T03:35:03.429 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.423+0000 7fe571dc36c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe56c10f200 0x7fe56c0f4cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:03.429 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.423+0000 7fe571dc36c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe56c115410 0x7fe56c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:03.429 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.423+0000 7fe571dc36c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe56c0f5300 0x7fe56c0fa580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:03.429 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.423+0000 7fe571dc36c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe56c0f59f0 con 0x7fe56c10f200 2026-02-13T03:35:03.429 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.423+0000 7fe571dc36c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe56c0faac0 con 0x7fe56c115410 2026-02-13T03:35:03.429 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.423+0000 7fe571dc36c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe56c0fac80 con 0x7fe56c0f5300 2026-02-13T03:35:03.429 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.423+0000 7fe56b7fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe56c10f200 0x7fe56c0f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:03.430 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.423+0000 7fe56b7fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe56c10f200 0x7fe56c0f4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:46056/0 (socket says 10.20.193.96:46056) 2026-02-13T03:35:03.430 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.423+0000 7fe56b7fe6c0 1 -- 10.20.193.96:0/2121500400 learned_addr learned my addr 10.20.193.96:0/2121500400 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:35:03.430 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.423+0000 7fe56affd6c0 1 --2- 10.20.193.96:0/2121500400 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe56c115410 0x7fe56c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:03.430 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.423+0000 7fe56bfff6c0 1 --2- 10.20.193.96:0/2121500400 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe56c0f5300 0x7fe56c0fa580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:03.430 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.423+0000 7fe56b7fe6c0 1 -- 10.20.193.96:0/2121500400 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe56c0f5300 msgr2=0x7fe56c0fa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:03.430 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.423+0000 7fe56b7fe6c0 1 --2- 10.20.193.96:0/2121500400 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe56c0f5300 0x7fe56c0fa580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:03.430 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.423+0000 7fe56b7fe6c0 1 -- 10.20.193.96:0/2121500400 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe56c115410 msgr2=0x7fe56c175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:03.430 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.423+0000 7fe56b7fe6c0 1 --2- 10.20.193.96:0/2121500400 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe56c115410 0x7fe56c175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:03.430 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.423+0000 7fe56b7fe6c0 1 -- 10.20.193.96:0/2121500400 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55c009590 con 0x7fe56c10f200 2026-02-13T03:35:03.430 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.423+0000 7fe56affd6c0 1 --2- 10.20.193.96:0/2121500400 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe56c115410 0x7fe56c175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:35:03.430 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.423+0000 7fe56b7fe6c0 1 --2- 10.20.193.96:0/2121500400 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe56c10f200 0x7fe56c0f4cd0 secure :-1 s=READY pgs=344 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe55800b710 tx=0x7fe55800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:03.430 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.423+0000 7fe568ff96c0 1 -- 10.20.193.96:0/2121500400 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe558004250 con 0x7fe56c10f200 2026-02-13T03:35:03.431 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.424+0000 7fe571dc36c0 1 -- 10.20.193.96:0/2121500400 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe56c0faf60 con 0x7fe56c10f200 2026-02-13T03:35:03.431 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.424+0000 7fe568ff96c0 1 -- 10.20.193.96:0/2121500400 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fe558002da0 con 0x7fe56c10f200 2026-02-13T03:35:03.431 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.424+0000 7fe568ff96c0 1 -- 10.20.193.96:0/2121500400 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe55800ce50 con 0x7fe56c10f200 2026-02-13T03:35:03.431 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.424+0000 7fe571dc36c0 1 -- 10.20.193.96:0/2121500400 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe56c0fb6f0 con 0x7fe56c10f200 2026-02-13T03:35:03.431 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.424+0000 7fe571dc36c0 1 -- 10.20.193.96:0/2121500400 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe56c1104d0 con 0x7fe56c10f200 2026-02-13T03:35:03.432 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.425+0000 7fe568ff96c0 1 -- 10.20.193.96:0/2121500400 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fe5580043b0 con 0x7fe56c10f200 2026-02-13T03:35:03.432 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.426+0000 7fe568ff96c0 1 --2- 10.20.193.96:0/2121500400 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe5400b5680 0x7fe5400d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:03.432 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.426+0000 7fe568ff96c0 1 -- 10.20.193.96:0/2121500400 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8031+0+0 (secure 0 0 0) 0x7fe5580e3ce0 con 0x7fe56c10f200 2026-02-13T03:35:03.432 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.426+0000 7fe56affd6c0 1 --2- 10.20.193.96:0/2121500400 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe5400b5680 0x7fe5400d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:03.432 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.426+0000 7fe568ff96c0 1 -- 10.20.193.96:0/2121500400 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe5580aa060 con 0x7fe56c10f200 2026-02-13T03:35:03.432 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.426+0000 7fe56affd6c0 1 --2- 10.20.193.96:0/2121500400 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe5400b5680 0x7fe5400d5b30 secure :-1 s=READY pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe55c0023e0 tx=0x7fe55c0092a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:03.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.544+0000 7fe571dc36c0 1 -- 10.20.193.96:0/2121500400 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe56c0f5dd0 con 0x7fe56c10f200 2026-02-13T03:35:03.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.544+0000 7fe568ff96c0 1 -- 10.20.193.96:0/2121500400 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe5580a97b0 con 0x7fe56c10f200 2026-02-13T03:35:03.547 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:35:03.548 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:35:03.550 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.546+0000 7fe571dc36c0 1 -- 10.20.193.96:0/2121500400 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe5400b5680 msgr2=0x7fe5400d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:03.550 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.546+0000 7fe571dc36c0 1 --2- 10.20.193.96:0/2121500400 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe5400b5680 0x7fe5400d5b30 secure :-1 s=READY pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe55c0023e0 tx=0x7fe55c0092a0 comp rx=0 tx=0).stop 2026-02-13T03:35:03.550 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.546+0000 7fe571dc36c0 1 -- 10.20.193.96:0/2121500400 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe56c10f200 msgr2=0x7fe56c0f4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:03.550 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.546+0000 7fe571dc36c0 1 --2- 10.20.193.96:0/2121500400 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe56c10f200 0x7fe56c0f4cd0 secure :-1 s=READY pgs=344 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe55800b710 tx=0x7fe55800bbe0 comp rx=0 tx=0).stop 2026-02-13T03:35:03.550 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.546+0000 7fe571dc36c0 1 -- 10.20.193.96:0/2121500400 shutdown_connections 2026-02-13T03:35:03.550 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.546+0000 7fe571dc36c0 1 --2- 10.20.193.96:0/2121500400 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe5400b5680 0x7fe5400d5b30 unknown :-1 s=CLOSED pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:03.550 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.546+0000 7fe571dc36c0 1 --2- 10.20.193.96:0/2121500400 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe56c0f5300 0x7fe56c0fa580 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:03.550 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.546+0000 7fe571dc36c0 1 --2- 10.20.193.96:0/2121500400 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe56c115410 0x7fe56c175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:03.550 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.546+0000 7fe571dc36c0 1 --2- 10.20.193.96:0/2121500400 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe56c10f200 0x7fe56c0f4cd0 unknown :-1 s=CLOSED pgs=344 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:03.551 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.546+0000 7fe571dc36c0 1 -- 10.20.193.96:0/2121500400 >> 10.20.193.96:0/2121500400 conn(0x7fe56c0ecb00 msgr2=0x7fe56c10d940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:03.551 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.547+0000 7fe571dc36c0 1 -- 10.20.193.96:0/2121500400 shutdown_connections 2026-02-13T03:35:03.551 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:03.547+0000 7fe571dc36c0 1 -- 10.20.193.96:0/2121500400 wait complete. 2026-02-13T03:35:03.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:03 trial096 ceph-mon[24671]: pgmap v209: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s; 15 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T03:35:03.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:03 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2121500400' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:03.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:03 trial132 ceph-mon[26888]: pgmap v209: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s; 15 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T03:35:03.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:03 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2121500400' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:04.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:03 trial133 ceph-mon[26943]: pgmap v209: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s; 15 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T03:35:04.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:03 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2121500400' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:05.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:05 trial132 ceph-mon[26888]: pgmap v210: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s; 13 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T03:35:06.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:05 trial133 ceph-mon[26943]: pgmap v210: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s; 13 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T03:35:06.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:05 trial096 ceph-mon[24671]: pgmap v210: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s; 13 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T03:35:06.592 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:35:06.710 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:35:06.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.823+0000 7f74295246c0 1 -- 10.20.193.96:0/3939584240 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f742410f200 msgr2=0x7f742410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:06.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.823+0000 7f74295246c0 1 --2- 10.20.193.96:0/3939584240 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f742410f200 0x7f742410f5d0 secure :-1 s=READY pgs=345 gs=1 cs=0 l=1 c_cookie=17413323701641309275 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74180099a0 tx=0x7f741802ed20 comp rx=0 tx=0).stop 2026-02-13T03:35:06.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.823+0000 7f74295246c0 1 -- 10.20.193.96:0/3939584240 shutdown_connections 2026-02-13T03:35:06.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.823+0000 7f74295246c0 1 --2- 10.20.193.96:0/3939584240 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7424115410 0x7f7424175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:06.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.823+0000 7f74295246c0 1 --2- 10.20.193.96:0/3939584240 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f742410fbf0 0x7f7424114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:06.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.823+0000 7f74295246c0 1 --2- 10.20.193.96:0/3939584240 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f742410f200 0x7f742410f5d0 unknown :-1 s=CLOSED pgs=345 gs=1 cs=0 l=1 c_cookie=17413323701641309275 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:06.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.823+0000 7f74295246c0 1 -- 10.20.193.96:0/3939584240 >> 10.20.193.96:0/3939584240 conn(0x7f74240ecb00 msgr2=0x7f742410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:06.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.823+0000 7f74295246c0 1 -- 10.20.193.96:0/3939584240 shutdown_connections 2026-02-13T03:35:06.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.823+0000 7f74295246c0 1 -- 10.20.193.96:0/3939584240 wait complete. 2026-02-13T03:35:06.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.823+0000 7f74295246c0 1 Processor -- start 2026-02-13T03:35:06.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.823+0000 7f74295246c0 1 -- start start 2026-02-13T03:35:06.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.823+0000 7f74295246c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f742410f200 0x7f742411d160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:06.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.823+0000 7f74295246c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7424115410 0x7f742411d6a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:06.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.823+0000 7f74295246c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7424122a60 0x7f7424122f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:06.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.823+0000 7f74295246c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7424123470 con 0x7f7424122a60 2026-02-13T03:35:06.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.823+0000 7f74295246c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f74241235e0 con 0x7f7424115410 2026-02-13T03:35:06.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.823+0000 7f74295246c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f74241237a0 con 0x7f742410f200 2026-02-13T03:35:06.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.824+0000 7f74237fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7424122a60 0x7f7424122f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:06.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.824+0000 7f74237fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7424122a60 0x7f7424122f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:46072/0 (socket says 10.20.193.96:46072) 2026-02-13T03:35:06.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.824+0000 7f74237fe6c0 1 -- 10.20.193.96:0/4203170574 learned_addr learned my addr 10.20.193.96:0/4203170574 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:35:06.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.824+0000 7f7422ffd6c0 1 --2- 10.20.193.96:0/4203170574 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f742410f200 0x7f742411d160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:06.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.824+0000 7f74237fe6c0 1 -- 10.20.193.96:0/4203170574 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f742410f200 msgr2=0x7f742411d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:06.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.824+0000 7f74237fe6c0 1 --2- 10.20.193.96:0/4203170574 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f742410f200 0x7f742411d160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:06.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.824+0000 7f74237fe6c0 1 -- 10.20.193.96:0/4203170574 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7424115410 msgr2=0x7f742411d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:06.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.824+0000 7f74237fe6c0 1 --2- 10.20.193.96:0/4203170574 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7424115410 0x7f742411d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:06.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.824+0000 7f74237fe6c0 1 -- 10.20.193.96:0/4203170574 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7418009590 con 0x7f7424122a60 2026-02-13T03:35:06.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.824+0000 7f74237fe6c0 1 --2- 10.20.193.96:0/4203170574 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7424122a60 0x7f7424122f00 secure :-1 s=READY pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f741400c6c0 tx=0x7f741400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:06.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.824+0000 7f7403fff6c0 1 -- 10.20.193.96:0/4203170574 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7414003a30 con 0x7f7424122a60 2026-02-13T03:35:06.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.824+0000 7f74295246c0 1 -- 10.20.193.96:0/4203170574 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7424163c50 con 0x7f7424122a60 2026-02-13T03:35:06.831 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.824+0000 7f7403fff6c0 1 -- 10.20.193.96:0/4203170574 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f7414005500 con 0x7f7424122a60 2026-02-13T03:35:06.831 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.824+0000 7f7403fff6c0 1 -- 10.20.193.96:0/4203170574 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f741400dd80 con 0x7f7424122a60 2026-02-13T03:35:06.831 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.824+0000 7f74295246c0 1 -- 10.20.193.96:0/4203170574 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74241640e0 con 0x7f7424122a60 2026-02-13T03:35:06.831 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.824+0000 7f74295246c0 1 -- 10.20.193.96:0/4203170574 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74241104d0 con 0x7f7424122a60 2026-02-13T03:35:06.832 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.826+0000 7f7403fff6c0 1 -- 10.20.193.96:0/4203170574 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f7414005080 con 0x7f7424122a60 2026-02-13T03:35:06.832 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.826+0000 7f7403fff6c0 1 --2- 10.20.193.96:0/4203170574 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f73f40b5690 0x7f73f40d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:06.832 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.826+0000 7f7403fff6c0 1 -- 10.20.193.96:0/4203170574 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8031+0+0 (secure 0 0 0) 0x7f74140e4b30 con 0x7f7424122a60 2026-02-13T03:35:06.832 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.826+0000 7f7422ffd6c0 1 --2- 10.20.193.96:0/4203170574 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f73f40b5690 0x7f73f40d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:06.832 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.827+0000 7f7422ffd6c0 1 --2- 10.20.193.96:0/4203170574 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f73f40b5690 0x7f73f40d5b40 secure :-1 s=READY pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74180023e0 tx=0x7f7418005c80 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:06.832 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.827+0000 7f7403fff6c0 1 -- 10.20.193.96:0/4203170574 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f74140a7450 con 0x7f7424122a60 2026-02-13T03:35:06.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.948+0000 7f74295246c0 1 -- 10.20.193.96:0/4203170574 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f742411e310 con 0x7f7424122a60 2026-02-13T03:35:06.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.948+0000 7f7403fff6c0 1 -- 10.20.193.96:0/4203170574 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f7414005360 con 0x7f7424122a60 2026-02-13T03:35:06.951 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:35:06.952 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:35:06.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.949+0000 7f74295246c0 1 -- 10.20.193.96:0/4203170574 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f73f40b5690 msgr2=0x7f73f40d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:06.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.949+0000 7f74295246c0 1 --2- 10.20.193.96:0/4203170574 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f73f40b5690 0x7f73f40d5b40 secure :-1 s=READY pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74180023e0 tx=0x7f7418005c80 comp rx=0 tx=0).stop 2026-02-13T03:35:06.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.949+0000 7f74295246c0 1 -- 10.20.193.96:0/4203170574 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7424122a60 msgr2=0x7f7424122f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:06.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.949+0000 7f74295246c0 1 --2- 10.20.193.96:0/4203170574 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7424122a60 0x7f7424122f00 secure :-1 s=READY pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f741400c6c0 tx=0x7f741400cb90 comp rx=0 tx=0).stop 2026-02-13T03:35:06.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.949+0000 7f74295246c0 1 -- 10.20.193.96:0/4203170574 shutdown_connections 2026-02-13T03:35:06.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.949+0000 7f74295246c0 1 --2- 10.20.193.96:0/4203170574 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f73f40b5690 0x7f73f40d5b40 unknown :-1 s=CLOSED pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:06.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.949+0000 7f74295246c0 1 --2- 10.20.193.96:0/4203170574 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7424122a60 0x7f7424122f00 unknown :-1 s=CLOSED pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:06.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.949+0000 7f74295246c0 1 --2- 10.20.193.96:0/4203170574 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7424115410 0x7f742411d6a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:06.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.949+0000 7f74295246c0 1 --2- 10.20.193.96:0/4203170574 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f742410f200 0x7f742411d160 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:06.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.949+0000 7f74295246c0 1 -- 10.20.193.96:0/4203170574 >> 10.20.193.96:0/4203170574 conn(0x7f74240ecb00 msgr2=0x7f742410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:06.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.949+0000 7f74295246c0 1 -- 10.20.193.96:0/4203170574 shutdown_connections 2026-02-13T03:35:06.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:06.949+0000 7f74295246c0 1 -- 10.20.193.96:0/4203170574 wait complete. 2026-02-13T03:35:07.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:07 trial132 ceph-mon[26888]: pgmap v211: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 7 op/s; 12 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T03:35:07.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:07 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/4203170574' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:08.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:07 trial133 ceph-mon[26943]: pgmap v211: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 7 op/s; 12 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T03:35:08.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:07 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/4203170574' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:08.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:07 trial096 ceph-mon[24671]: pgmap v211: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 7 op/s; 12 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T03:35:08.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:07 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/4203170574' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:09.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:09 trial132 ceph-mon[26888]: pgmap v212: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s; 12 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T03:35:09.995 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:35:10.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:09 trial133 ceph-mon[26943]: pgmap v212: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s; 12 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T03:35:10.020 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:09 trial096 ceph-mon[24671]: pgmap v212: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s; 12 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T03:35:10.115 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:35:10.235 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.230+0000 7f12986246c0 1 -- 10.20.193.96:0/1755194201 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f129010f200 msgr2=0x7f129010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:10.235 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.230+0000 7f12986246c0 1 --2- 10.20.193.96:0/1755194201 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f129010f200 0x7f129010f5d0 secure :-1 s=READY pgs=347 gs=1 cs=0 l=1 c_cookie=3664911171414013990 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12800099a0 tx=0x7f128002ed20 comp rx=0 tx=0).stop 2026-02-13T03:35:10.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.230+0000 7f12986246c0 1 -- 10.20.193.96:0/1755194201 shutdown_connections 2026-02-13T03:35:10.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.230+0000 7f12986246c0 1 --2- 10.20.193.96:0/1755194201 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1290115410 0x7f1290175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:10.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.230+0000 7f12986246c0 1 --2- 10.20.193.96:0/1755194201 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f129010fbf0 0x7f1290114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:10.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.230+0000 7f12986246c0 1 --2- 10.20.193.96:0/1755194201 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f129010f200 0x7f129010f5d0 unknown :-1 s=CLOSED pgs=347 gs=1 cs=0 l=1 c_cookie=3664911171414013990 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:10.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.230+0000 7f12986246c0 1 -- 10.20.193.96:0/1755194201 >> 10.20.193.96:0/1755194201 conn(0x7f12900ecb00 msgr2=0x7f129010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:10.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.230+0000 7f12986246c0 1 -- 10.20.193.96:0/1755194201 shutdown_connections 2026-02-13T03:35:10.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.230+0000 7f12986246c0 1 -- 10.20.193.96:0/1755194201 wait complete. 2026-02-13T03:35:10.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.230+0000 7f12986246c0 1 Processor -- start 2026-02-13T03:35:10.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.230+0000 7f12986246c0 1 -- start start 2026-02-13T03:35:10.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.230+0000 7f12986246c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f129010f200 0x7f129011d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:10.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.230+0000 7f12986246c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1290115410 0x7f129011d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:10.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.230+0000 7f12986246c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1290122b50 0x7f1290122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:10.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.230+0000 7f12986246c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1290123560 con 0x7f129010f200 2026-02-13T03:35:10.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.230+0000 7f12986246c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f12901236d0 con 0x7f1290122b50 2026-02-13T03:35:10.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.230+0000 7f12986246c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1290123890 con 0x7f1290115410 2026-02-13T03:35:10.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.231+0000 7f12963956c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f129010f200 0x7f129011d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:10.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.231+0000 7f12963956c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f129010f200 0x7f129011d250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:46090/0 (socket says 10.20.193.96:46090) 2026-02-13T03:35:10.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.231+0000 7f12963956c0 1 -- 10.20.193.96:0/489254724 learned_addr learned my addr 10.20.193.96:0/489254724 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:35:10.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.231+0000 7f1295b946c0 1 --2- 10.20.193.96:0/489254724 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1290115410 0x7f129011d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:10.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.231+0000 7f1296b966c0 1 --2- 10.20.193.96:0/489254724 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1290122b50 0x7f1290122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:10.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.231+0000 7f12963956c0 1 -- 10.20.193.96:0/489254724 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1290115410 msgr2=0x7f129011d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:10.238 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.231+0000 7f12963956c0 1 --2- 10.20.193.96:0/489254724 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1290115410 0x7f129011d790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:10.238 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.231+0000 7f12963956c0 1 -- 10.20.193.96:0/489254724 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1290122b50 msgr2=0x7f1290122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:10.238 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.231+0000 7f12963956c0 1 --2- 10.20.193.96:0/489254724 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1290122b50 0x7f1290122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:10.238 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.231+0000 7f12963956c0 1 -- 10.20.193.96:0/489254724 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1280009590 con 0x7f129010f200 2026-02-13T03:35:10.238 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.231+0000 7f1295b946c0 1 --2- 10.20.193.96:0/489254724 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1290115410 0x7f129011d790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:35:10.238 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.231+0000 7f1296b966c0 1 --2- 10.20.193.96:0/489254724 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1290122b50 0x7f1290122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:35:10.238 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.231+0000 7f12963956c0 1 --2- 10.20.193.96:0/489254724 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f129010f200 0x7f129011d250 secure :-1 s=READY pgs=348 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12800098c0 tx=0x7f12800047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:10.238 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.231+0000 7f12777fe6c0 1 -- 10.20.193.96:0/489254724 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1280002ae0 con 0x7f129010f200 2026-02-13T03:35:10.238 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.231+0000 7f12777fe6c0 1 -- 10.20.193.96:0/489254724 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f1280002c40 con 0x7f129010f200 2026-02-13T03:35:10.238 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.231+0000 7f12986246c0 1 -- 10.20.193.96:0/489254724 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1290163ce0 con 0x7f129010f200 2026-02-13T03:35:10.238 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.231+0000 7f12777fe6c0 1 -- 10.20.193.96:0/489254724 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f12800372f0 con 0x7f129010f200 2026-02-13T03:35:10.238 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.231+0000 7f12986246c0 1 -- 10.20.193.96:0/489254724 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1290164110 con 0x7f129010f200 2026-02-13T03:35:10.239 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.231+0000 7f12986246c0 1 -- 10.20.193.96:0/489254724 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12901104d0 con 0x7f129010f200 2026-02-13T03:35:10.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.233+0000 7f12777fe6c0 1 -- 10.20.193.96:0/489254724 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f1280007960 con 0x7f129010f200 2026-02-13T03:35:10.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.233+0000 7f12777fe6c0 1 --2- 10.20.193.96:0/489254724 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f126c0b5690 0x7f126c0d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:10.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.234+0000 7f12777fe6c0 1 -- 10.20.193.96:0/489254724 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8031+0+0 (secure 0 0 0) 0x7f1280107e70 con 0x7f129010f200 2026-02-13T03:35:10.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.234+0000 7f1295b946c0 1 --2- 10.20.193.96:0/489254724 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f126c0b5690 0x7f126c0d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:10.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.234+0000 7f12777fe6c0 1 -- 10.20.193.96:0/489254724 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f12801082f0 con 0x7f129010f200 2026-02-13T03:35:10.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.234+0000 7f1295b946c0 1 --2- 10.20.193.96:0/489254724 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f126c0b5690 0x7f126c0d5b40 secure :-1 s=READY pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1290123be0 tx=0x7f1284005df0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:10.351 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.348+0000 7f12986246c0 1 -- 10.20.193.96:0/489254724 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f129010f5d0 con 0x7f129010f200 2026-02-13T03:35:10.351 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.348+0000 7f12777fe6c0 1 -- 10.20.193.96:0/489254724 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f12800ca790 con 0x7f129010f200 2026-02-13T03:35:10.351 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:35:10.351 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:35:10.352 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.349+0000 7f12986246c0 1 -- 10.20.193.96:0/489254724 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f126c0b5690 msgr2=0x7f126c0d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:10.352 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.349+0000 7f12986246c0 1 --2- 10.20.193.96:0/489254724 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f126c0b5690 0x7f126c0d5b40 secure :-1 s=READY pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1290123be0 tx=0x7f1284005df0 comp rx=0 tx=0).stop 2026-02-13T03:35:10.352 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.349+0000 7f12986246c0 1 -- 10.20.193.96:0/489254724 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f129010f200 msgr2=0x7f129011d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:10.352 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.349+0000 7f12986246c0 1 --2- 10.20.193.96:0/489254724 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f129010f200 0x7f129011d250 secure :-1 s=READY pgs=348 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12800098c0 tx=0x7f12800047f0 comp rx=0 tx=0).stop 2026-02-13T03:35:10.353 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.349+0000 7f12986246c0 1 -- 10.20.193.96:0/489254724 shutdown_connections 2026-02-13T03:35:10.353 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.349+0000 7f12986246c0 1 --2- 10.20.193.96:0/489254724 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f126c0b5690 0x7f126c0d5b40 unknown :-1 s=CLOSED pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:10.353 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.349+0000 7f12986246c0 1 --2- 10.20.193.96:0/489254724 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1290122b50 0x7f1290122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:10.353 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.349+0000 7f12986246c0 1 --2- 10.20.193.96:0/489254724 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1290115410 0x7f129011d790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:10.353 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.349+0000 7f12986246c0 1 --2- 10.20.193.96:0/489254724 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f129010f200 0x7f129011d250 unknown :-1 s=CLOSED pgs=348 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:10.353 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.349+0000 7f12986246c0 1 -- 10.20.193.96:0/489254724 >> 10.20.193.96:0/489254724 conn(0x7f12900ecb00 msgr2=0x7f129010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:10.353 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.349+0000 7f12986246c0 1 -- 10.20.193.96:0/489254724 shutdown_connections 2026-02-13T03:35:10.353 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:10.349+0000 7f12986246c0 1 -- 10.20.193.96:0/489254724 wait complete. 2026-02-13T03:35:10.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:10 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/489254724' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:11.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:10 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/489254724' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:11.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:10 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/489254724' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:11.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:11 trial132 ceph-mon[26888]: pgmap v213: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-13T03:35:12.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:11 trial133 ceph-mon[26943]: pgmap v213: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-13T03:35:12.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:11 trial096 ceph-mon[24671]: pgmap v213: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-13T03:35:12.981 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:12 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:35:12.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:12 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:35:12.992 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:12 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:35:13.395 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:35:13.514 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:35:13.641 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.635+0000 7fb8527286c0 1 -- 10.20.193.96:0/3734667347 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb84c10c390 msgr2=0x7fb84c155270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:13.641 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.635+0000 7fb8527286c0 1 --2- 10.20.193.96:0/3734667347 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb84c10c390 0x7fb84c155270 secure :-1 s=READY pgs=349 gs=1 cs=0 l=1 c_cookie=14944925464164009281 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb83c009970 tx=0x7fb83c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:35:13.641 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.635+0000 7fb8527286c0 1 -- 10.20.193.96:0/3734667347 shutdown_connections 2026-02-13T03:35:13.641 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.635+0000 7fb8527286c0 1 --2- 10.20.193.96:0/3734667347 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb84c1557b0 0x7fb84c175b90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:13.641 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.635+0000 7fb8527286c0 1 --2- 10.20.193.96:0/3734667347 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb84c10c390 0x7fb84c155270 unknown :-1 s=CLOSED pgs=349 gs=1 cs=0 l=1 c_cookie=14944925464164009281 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:13.641 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.635+0000 7fb8527286c0 1 --2- 10.20.193.96:0/3734667347 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb84c10ba80 0x7fb84c10be50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:13.641 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.635+0000 7fb8527286c0 1 -- 10.20.193.96:0/3734667347 >> 10.20.193.96:0/3734667347 conn(0x7fb84c0e9700 msgr2=0x7fb84c109b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:13.641 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.635+0000 7fb8527286c0 1 -- 10.20.193.96:0/3734667347 shutdown_connections 2026-02-13T03:35:13.642 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.635+0000 7fb8527286c0 1 -- 10.20.193.96:0/3734667347 wait complete. 2026-02-13T03:35:13.642 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.636+0000 7fb8527286c0 1 Processor -- start 2026-02-13T03:35:13.642 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.636+0000 7fb8527286c0 1 -- start start 2026-02-13T03:35:13.642 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.636+0000 7fb8527286c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb84c10ba80 0x7fb84c160570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:13.642 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.636+0000 7fb8527286c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb84c10c390 0x7fb84c160ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:13.642 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.636+0000 7fb8527286c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb84c1557b0 0x7fb84c165e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:13.642 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.636+0000 7fb8527286c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb84c1664c0 con 0x7fb84c10c390 2026-02-13T03:35:13.642 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.636+0000 7fb8527286c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb84c166630 con 0x7fb84c1557b0 2026-02-13T03:35:13.642 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.636+0000 7fb8527286c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb84c1667f0 con 0x7fb84c10ba80 2026-02-13T03:35:13.642 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.636+0000 7fb84b7fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb84c10c390 0x7fb84c160ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:13.642 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.636+0000 7fb84b7fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb84c10c390 0x7fb84c160ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49254/0 (socket says 10.20.193.96:49254) 2026-02-13T03:35:13.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.636+0000 7fb84b7fe6c0 1 -- 10.20.193.96:0/4244205903 learned_addr learned my addr 10.20.193.96:0/4244205903 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:35:13.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.636+0000 7fb850c9a6c0 1 --2- 10.20.193.96:0/4244205903 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb84c1557b0 0x7fb84c165e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:13.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.636+0000 7fb84b7fe6c0 1 -- 10.20.193.96:0/4244205903 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb84c10ba80 msgr2=0x7fb84c160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:13.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.636+0000 7fb84b7fe6c0 1 --2- 10.20.193.96:0/4244205903 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb84c10ba80 0x7fb84c160570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:13.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.636+0000 7fb84b7fe6c0 1 -- 10.20.193.96:0/4244205903 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb84c1557b0 msgr2=0x7fb84c165e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:13.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.636+0000 7fb84b7fe6c0 1 --2- 10.20.193.96:0/4244205903 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb84c1557b0 0x7fb84c165e70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:13.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.636+0000 7fb84b7fe6c0 1 -- 10.20.193.96:0/4244205903 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb83c009590 con 0x7fb84c10c390 2026-02-13T03:35:13.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.636+0000 7fb84b7fe6c0 1 --2- 10.20.193.96:0/4244205903 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb84c10c390 0x7fb84c160ab0 secure :-1 s=READY pgs=350 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb83c0098c0 tx=0x7fb83c0047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:13.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.636+0000 7fb8497fa6c0 1 -- 10.20.193.96:0/4244205903 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb83c002ae0 con 0x7fb84c10c390 2026-02-13T03:35:13.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.636+0000 7fb8527286c0 1 -- 10.20.193.96:0/4244205903 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb84c166a70 con 0x7fb84c10c390 2026-02-13T03:35:13.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.636+0000 7fb8497fa6c0 1 -- 10.20.193.96:0/4244205903 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fb83c007740 con 0x7fb84c10c390 2026-02-13T03:35:13.643 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.636+0000 7fb8497fa6c0 1 -- 10.20.193.96:0/4244205903 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb83c031520 con 0x7fb84c10c390 2026-02-13T03:35:13.644 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.636+0000 7fb8527286c0 1 -- 10.20.193.96:0/4244205903 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb84c1523f0 con 0x7fb84c10c390 2026-02-13T03:35:13.644 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.637+0000 7fb8527286c0 1 -- 10.20.193.96:0/4244205903 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb84c05fb10 con 0x7fb84c10c390 2026-02-13T03:35:13.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.638+0000 7fb8497fa6c0 1 -- 10.20.193.96:0/4244205903 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fb83c002ca0 con 0x7fb84c10c390 2026-02-13T03:35:13.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.639+0000 7fb8497fa6c0 1 --2- 10.20.193.96:0/4244205903 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb8200b5690 0x7fb8200d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:13.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.639+0000 7fb8497fa6c0 1 -- 10.20.193.96:0/4244205903 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8031+0+0 (secure 0 0 0) 0x7fb83c107f40 con 0x7fb84c10c390 2026-02-13T03:35:13.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.639+0000 7fb84bfff6c0 1 --2- 10.20.193.96:0/4244205903 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb8200b5690 0x7fb8200d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:13.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.639+0000 7fb84bfff6c0 1 --2- 10.20.193.96:0/4244205903 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb8200b5690 0x7fb8200d5b40 secure :-1 s=READY pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb838005980 tx=0x7fb838005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:13.645 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.639+0000 7fb8497fa6c0 1 -- 10.20.193.96:0/4244205903 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb83c0ca860 con 0x7fb84c10c390 2026-02-13T03:35:13.759 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.756+0000 7fb8527286c0 1 -- 10.20.193.96:0/4244205903 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb84c166c00 con 0x7fb84c10c390 2026-02-13T03:35:13.759 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.756+0000 7fb8497fa6c0 1 -- 10.20.193.96:0/4244205903 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb83c0cda10 con 0x7fb84c10c390 2026-02-13T03:35:13.759 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:35:13.760 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:35:13.761 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.757+0000 7fb8527286c0 1 -- 10.20.193.96:0/4244205903 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb8200b5690 msgr2=0x7fb8200d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:13.761 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.758+0000 7fb8527286c0 1 --2- 10.20.193.96:0/4244205903 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb8200b5690 0x7fb8200d5b40 secure :-1 s=READY pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb838005980 tx=0x7fb838005910 comp rx=0 tx=0).stop 2026-02-13T03:35:13.761 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.758+0000 7fb8527286c0 1 -- 10.20.193.96:0/4244205903 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb84c10c390 msgr2=0x7fb84c160ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:13.761 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.758+0000 7fb8527286c0 1 --2- 10.20.193.96:0/4244205903 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb84c10c390 0x7fb84c160ab0 secure :-1 s=READY pgs=350 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb83c0098c0 tx=0x7fb83c0047f0 comp rx=0 tx=0).stop 2026-02-13T03:35:13.761 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.758+0000 7fb8527286c0 1 -- 10.20.193.96:0/4244205903 shutdown_connections 2026-02-13T03:35:13.761 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.758+0000 7fb8527286c0 1 --2- 10.20.193.96:0/4244205903 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb8200b5690 0x7fb8200d5b40 unknown :-1 s=CLOSED pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:13.761 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.758+0000 7fb8527286c0 1 --2- 10.20.193.96:0/4244205903 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb84c1557b0 0x7fb84c165e70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:13.762 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.758+0000 7fb8527286c0 1 --2- 10.20.193.96:0/4244205903 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb84c10c390 0x7fb84c160ab0 unknown :-1 s=CLOSED pgs=350 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:13.762 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.758+0000 7fb8527286c0 1 --2- 10.20.193.96:0/4244205903 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb84c10ba80 0x7fb84c160570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:13.762 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.758+0000 7fb8527286c0 1 -- 10.20.193.96:0/4244205903 >> 10.20.193.96:0/4244205903 conn(0x7fb84c0e9700 msgr2=0x7fb84c109ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:13.762 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.758+0000 7fb8527286c0 1 -- 10.20.193.96:0/4244205903 shutdown_connections 2026-02-13T03:35:13.762 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:13.758+0000 7fb8527286c0 1 -- 10.20.193.96:0/4244205903 wait complete. 2026-02-13T03:35:13.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:13 trial132 ceph-mon[26888]: pgmap v214: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:35:13.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:13 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:35:13.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:13 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:35:13.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:13 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:35:13.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:13 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:35:13.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:13 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:35:13.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:13 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:35:14.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:13 trial133 ceph-mon[26943]: pgmap v214: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:35:14.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:35:14.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:35:14.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:35:14.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:35:14.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:35:14.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:13 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:35:14.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:13 trial096 ceph-mon[24671]: pgmap v214: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:35:14.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:35:14.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:35:14.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:35:14.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:35:14.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:35:14.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:13 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:35:14.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:14 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/4244205903' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:14.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:14 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:35:14.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:14 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:35:14.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:14 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:35:14.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:14 trial132 ceph-mon[26888]: pgmap v215: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 5 op/s 2026-02-13T03:35:14.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:14 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:35:14.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:14 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:35:14.983 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:14 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:35:15.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:14 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/4244205903' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:15.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:14 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:35:15.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:14 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:35:15.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:14 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:35:15.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:14 trial133 ceph-mon[26943]: pgmap v215: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 5 op/s 2026-02-13T03:35:15.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:14 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:35:15.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:14 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:35:15.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:14 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:35:15.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:14 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/4244205903' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:15.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:14 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:35:15.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:14 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:35:15.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:14 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:35:15.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:14 trial096 ceph-mon[24671]: pgmap v215: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 5 op/s 2026-02-13T03:35:15.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:14 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:35:15.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:14 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:35:15.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:14 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:35:16.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:15 trial096 ceph-mon[24671]: pgmap v216: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:35:16.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:15 trial132 ceph-mon[26888]: pgmap v216: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:35:16.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:15 trial133 ceph-mon[26943]: pgmap v216: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:35:16.801 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:35:16.919 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:35:17.036 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.031+0000 7fd795cf46c0 1 -- 10.20.193.96:0/3752985376 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd79010cfb0 msgr2=0x7fd79010d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:17.036 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.031+0000 7fd795cf46c0 1 --2- 10.20.193.96:0/3752985376 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd79010cfb0 0x7fd79010d380 secure :-1 s=READY pgs=351 gs=1 cs=0 l=1 c_cookie=7904936270089476950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd77c0099a0 tx=0x7fd77c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:35:17.036 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.031+0000 7fd795cf46c0 1 -- 10.20.193.96:0/3752985376 shutdown_connections 2026-02-13T03:35:17.036 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.031+0000 7fd795cf46c0 1 --2- 10.20.193.96:0/3752985376 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd7901131c0 0x7fd790173b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:17.036 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.031+0000 7fd795cf46c0 1 --2- 10.20.193.96:0/3752985376 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd79010d9a0 0x7fd7901129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:17.036 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.031+0000 7fd795cf46c0 1 --2- 10.20.193.96:0/3752985376 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd79010cfb0 0x7fd79010d380 unknown :-1 s=CLOSED pgs=351 gs=1 cs=0 l=1 c_cookie=7904936270089476950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:17.036 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.031+0000 7fd795cf46c0 1 -- 10.20.193.96:0/3752985376 >> 10.20.193.96:0/3752985376 conn(0x7fd7900ea8b0 msgr2=0x7fd79010acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:17.036 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.031+0000 7fd795cf46c0 1 -- 10.20.193.96:0/3752985376 shutdown_connections 2026-02-13T03:35:17.036 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.031+0000 7fd795cf46c0 1 -- 10.20.193.96:0/3752985376 wait complete. 2026-02-13T03:35:17.037 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd795cf46c0 1 Processor -- start 2026-02-13T03:35:17.037 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd795cf46c0 1 -- start start 2026-02-13T03:35:17.037 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd795cf46c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd79010cfb0 0x7fd79011b010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:17.037 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd795cf46c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd7901131c0 0x7fd79011b550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:17.037 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd795cf46c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd790120910 0x7fd790120db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:17.037 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd795cf46c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd790121320 con 0x7fd79010cfb0 2026-02-13T03:35:17.037 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd795cf46c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd790121490 con 0x7fd790120910 2026-02-13T03:35:17.037 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd795cf46c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd790121650 con 0x7fd7901131c0 2026-02-13T03:35:17.037 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd78f7fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd79010cfb0 0x7fd79011b010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:17.037 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd78f7fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd79010cfb0 0x7fd79011b010 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49272/0 (socket says 10.20.193.96:49272) 2026-02-13T03:35:17.037 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd78f7fe6c0 1 -- 10.20.193.96:0/1914799691 learned_addr learned my addr 10.20.193.96:0/1914799691 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:35:17.038 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd78ffff6c0 1 --2- 10.20.193.96:0/1914799691 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd790120910 0x7fd790120db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:17.038 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd78effd6c0 1 --2- 10.20.193.96:0/1914799691 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd7901131c0 0x7fd79011b550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:17.038 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd78f7fe6c0 1 -- 10.20.193.96:0/1914799691 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd7901131c0 msgr2=0x7fd79011b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:17.038 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd78f7fe6c0 1 --2- 10.20.193.96:0/1914799691 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd7901131c0 0x7fd79011b550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:17.038 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd78f7fe6c0 1 -- 10.20.193.96:0/1914799691 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd790120910 msgr2=0x7fd790120db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:17.038 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd78f7fe6c0 1 --2- 10.20.193.96:0/1914799691 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd790120910 0x7fd790120db0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:17.038 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd78f7fe6c0 1 -- 10.20.193.96:0/1914799691 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd77c009590 con 0x7fd79010cfb0 2026-02-13T03:35:17.038 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd78ffff6c0 1 --2- 10.20.193.96:0/1914799691 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd790120910 0x7fd790120db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:35:17.038 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd78f7fe6c0 1 --2- 10.20.193.96:0/1914799691 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd79010cfb0 0x7fd79011b010 secure :-1 s=READY pgs=352 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd77c0098c0 tx=0x7fd77c0047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:17.038 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd78cff96c0 1 -- 10.20.193.96:0/1914799691 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd77c002ae0 con 0x7fd79010cfb0 2026-02-13T03:35:17.038 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd78cff96c0 1 -- 10.20.193.96:0/1914799691 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fd77c002c40 con 0x7fd79010cfb0 2026-02-13T03:35:17.038 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd795cf46c0 1 -- 10.20.193.96:0/1914799691 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd790161aa0 con 0x7fd79010cfb0 2026-02-13T03:35:17.038 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd78cff96c0 1 -- 10.20.193.96:0/1914799691 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd77c0362f0 con 0x7fd79010cfb0 2026-02-13T03:35:17.039 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.032+0000 7fd795cf46c0 1 -- 10.20.193.96:0/1914799691 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd790161f20 con 0x7fd79010cfb0 2026-02-13T03:35:17.039 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.033+0000 7fd795cf46c0 1 -- 10.20.193.96:0/1914799691 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd79010e280 con 0x7fd79010cfb0 2026-02-13T03:35:17.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.034+0000 7fd78cff96c0 1 -- 10.20.193.96:0/1914799691 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fd77c007960 con 0x7fd79010cfb0 2026-02-13T03:35:17.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.035+0000 7fd78cff96c0 1 --2- 10.20.193.96:0/1914799691 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd7640b5710 0x7fd7640d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:17.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.035+0000 7fd78cff96c0 1 -- 10.20.193.96:0/1914799691 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8031+0+0 (secure 0 0 0) 0x7fd77c107de0 con 0x7fd79010cfb0 2026-02-13T03:35:17.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.035+0000 7fd78effd6c0 1 --2- 10.20.193.96:0/1914799691 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd7640b5710 0x7fd7640d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:17.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.035+0000 7fd78cff96c0 1 -- 10.20.193.96:0/1914799691 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd77c0ca700 con 0x7fd79010cfb0 2026-02-13T03:35:17.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.035+0000 7fd78effd6c0 1 --2- 10.20.193.96:0/1914799691 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd7640b5710 0x7fd7640d5bc0 secure :-1 s=READY pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd780005980 tx=0x7fd780005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:17.151 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.149+0000 7fd795cf46c0 1 -- 10.20.193.96:0/1914799691 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd79010d380 con 0x7fd79010cfb0 2026-02-13T03:35:17.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.149+0000 7fd78cff96c0 1 -- 10.20.193.96:0/1914799691 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd77c002db0 con 0x7fd79010cfb0 2026-02-13T03:35:17.152 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:35:17.152 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:35:17.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.150+0000 7fd795cf46c0 1 -- 10.20.193.96:0/1914799691 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd7640b5710 msgr2=0x7fd7640d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:17.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.150+0000 7fd795cf46c0 1 --2- 10.20.193.96:0/1914799691 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd7640b5710 0x7fd7640d5bc0 secure :-1 s=READY pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd780005980 tx=0x7fd780005910 comp rx=0 tx=0).stop 2026-02-13T03:35:17.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.150+0000 7fd795cf46c0 1 -- 10.20.193.96:0/1914799691 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd79010cfb0 msgr2=0x7fd79011b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:17.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.150+0000 7fd795cf46c0 1 --2- 10.20.193.96:0/1914799691 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd79010cfb0 0x7fd79011b010 secure :-1 s=READY pgs=352 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd77c0098c0 tx=0x7fd77c0047f0 comp rx=0 tx=0).stop 2026-02-13T03:35:17.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.150+0000 7fd795cf46c0 1 -- 10.20.193.96:0/1914799691 shutdown_connections 2026-02-13T03:35:17.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.150+0000 7fd795cf46c0 1 --2- 10.20.193.96:0/1914799691 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd7640b5710 0x7fd7640d5bc0 unknown :-1 s=CLOSED pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:17.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.150+0000 7fd795cf46c0 1 --2- 10.20.193.96:0/1914799691 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd790120910 0x7fd790120db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:17.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.150+0000 7fd795cf46c0 1 --2- 10.20.193.96:0/1914799691 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd7901131c0 0x7fd79011b550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:17.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.150+0000 7fd795cf46c0 1 --2- 10.20.193.96:0/1914799691 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd79010cfb0 0x7fd79011b010 unknown :-1 s=CLOSED pgs=352 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:17.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.150+0000 7fd795cf46c0 1 -- 10.20.193.96:0/1914799691 >> 10.20.193.96:0/1914799691 conn(0x7fd7900ea8b0 msgr2=0x7fd79010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:17.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.150+0000 7fd795cf46c0 1 -- 10.20.193.96:0/1914799691 shutdown_connections 2026-02-13T03:35:17.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:17.150+0000 7fd795cf46c0 1 -- 10.20.193.96:0/1914799691 wait complete. 2026-02-13T03:35:18.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:17 trial096 ceph-mon[24671]: pgmap v217: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:35:18.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:17 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1914799691' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:18.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:17 trial132 ceph-mon[26888]: pgmap v217: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:35:18.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:17 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1914799691' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:18.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:17 trial133 ceph-mon[26943]: pgmap v217: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:35:18.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:17 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1914799691' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:20.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:19 trial096 ceph-mon[24671]: pgmap v218: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:35:20.195 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:35:20.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:19 trial132 ceph-mon[26888]: pgmap v218: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:35:20.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:19 trial133 ceph-mon[26943]: pgmap v218: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:35:20.314 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:35:20.437 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.434+0000 7f10353156c0 1 -- 10.20.193.96:0/1823977275 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f103011deb0 msgr2=0x7f103017e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:20.437 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.434+0000 7f10353156c0 1 --2- 10.20.193.96:0/1823977275 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f103011deb0 0x7f103017e850 secure :-1 s=READY pgs=353 gs=1 cs=0 l=1 c_cookie=2524624257551225653 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f102000aa70 tx=0x7f102002fde0 comp rx=0 tx=0).stop 2026-02-13T03:35:20.437 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.434+0000 7f10353156c0 1 -- 10.20.193.96:0/1823977275 shutdown_connections 2026-02-13T03:35:20.437 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.434+0000 7f10353156c0 1 --2- 10.20.193.96:0/1823977275 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f103011deb0 0x7f103017e850 unknown :-1 s=CLOSED pgs=353 gs=1 cs=0 l=1 c_cookie=2524624257551225653 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:20.437 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.434+0000 7f10353156c0 1 --2- 10.20.193.96:0/1823977275 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f10301149f0 0x7f103011d6d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:20.437 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.434+0000 7f10353156c0 1 --2- 10.20.193.96:0/1823977275 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1030114000 0x7f10301143d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:20.437 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.434+0000 7f10353156c0 1 -- 10.20.193.96:0/1823977275 >> 10.20.193.96:0/1823977275 conn(0x7f103005c880 msgr2=0x7f1030058b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:20.437 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.434+0000 7f10353156c0 1 -- 10.20.193.96:0/1823977275 shutdown_connections 2026-02-13T03:35:20.437 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.434+0000 7f10353156c0 1 -- 10.20.193.96:0/1823977275 wait complete. 2026-02-13T03:35:20.438 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.434+0000 7f10353156c0 1 Processor -- start 2026-02-13T03:35:20.438 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.434+0000 7f10353156c0 1 -- start start 2026-02-13T03:35:20.438 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.435+0000 7f10353156c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1030114000 0x7f1030126620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:20.438 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.435+0000 7f10353156c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f103011deb0 0x7f1030126b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:20.438 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.435+0000 7f10353156c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f103012bf20 0x7f103012c3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:20.438 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.435+0000 7f10353156c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f103012c930 con 0x7f103012bf20 2026-02-13T03:35:20.438 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.435+0000 7f10353156c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f103012caa0 con 0x7f103011deb0 2026-02-13T03:35:20.438 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.435+0000 7f10353156c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f103012cc60 con 0x7f1030114000 2026-02-13T03:35:20.438 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.435+0000 7f102f7fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f103012bf20 0x7f103012c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:20.438 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.435+0000 7f102f7fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f103012bf20 0x7f103012c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49290/0 (socket says 10.20.193.96:49290) 2026-02-13T03:35:20.438 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.435+0000 7f102f7fe6c0 1 -- 10.20.193.96:0/2241729962 learned_addr learned my addr 10.20.193.96:0/2241729962 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:35:20.438 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.435+0000 7f102effd6c0 1 --2- 10.20.193.96:0/2241729962 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1030114000 0x7f1030126620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:20.438 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.435+0000 7f102e7fc6c0 1 --2- 10.20.193.96:0/2241729962 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f103011deb0 0x7f1030126b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:20.438 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.435+0000 7f102f7fe6c0 1 -- 10.20.193.96:0/2241729962 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1030114000 msgr2=0x7f1030126620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:20.438 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.435+0000 7f102f7fe6c0 1 --2- 10.20.193.96:0/2241729962 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1030114000 0x7f1030126620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:20.438 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.435+0000 7f102f7fe6c0 1 -- 10.20.193.96:0/2241729962 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f103011deb0 msgr2=0x7f1030126b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:20.438 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.435+0000 7f102f7fe6c0 1 --2- 10.20.193.96:0/2241729962 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f103011deb0 0x7f1030126b60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:20.438 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.435+0000 7f102f7fe6c0 1 -- 10.20.193.96:0/2241729962 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f102000a660 con 0x7f103012bf20 2026-02-13T03:35:20.438 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.435+0000 7f102f7fe6c0 1 --2- 10.20.193.96:0/2241729962 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f103012bf20 0x7f103012c3c0 secure :-1 s=READY pgs=354 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10200027a0 tx=0x7f10200054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:20.438 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.435+0000 7f100ffff6c0 1 -- 10.20.193.96:0/2241729962 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1020030d10 con 0x7f103012bf20 2026-02-13T03:35:20.438 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.435+0000 7f10353156c0 1 -- 10.20.193.96:0/2241729962 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f103016d0b0 con 0x7f103012bf20 2026-02-13T03:35:20.438 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.435+0000 7f100ffff6c0 1 -- 10.20.193.96:0/2241729962 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f1020030e70 con 0x7f103012bf20 2026-02-13T03:35:20.439 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.435+0000 7f100ffff6c0 1 -- 10.20.193.96:0/2241729962 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f10200086b0 con 0x7f103012bf20 2026-02-13T03:35:20.439 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.435+0000 7f10353156c0 1 -- 10.20.193.96:0/2241729962 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f103016d4e0 con 0x7f103012bf20 2026-02-13T03:35:20.439 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.435+0000 7f10353156c0 1 -- 10.20.193.96:0/2241729962 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10300565c0 con 0x7f103012bf20 2026-02-13T03:35:20.439 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.437+0000 7f100ffff6c0 1 -- 10.20.193.96:0/2241729962 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f1020032030 con 0x7f103012bf20 2026-02-13T03:35:20.440 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.438+0000 7f100ffff6c0 1 --2- 10.20.193.96:0/2241729962 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f10040b5690 0x7f10040d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:20.440 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.438+0000 7f102effd6c0 1 --2- 10.20.193.96:0/2241729962 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f10040b5690 0x7f10040d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:20.440 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.438+0000 7f100ffff6c0 1 -- 10.20.193.96:0/2241729962 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8031+0+0 (secure 0 0 0) 0x7f10201090f0 con 0x7f103012bf20 2026-02-13T03:35:20.440 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.438+0000 7f100ffff6c0 1 -- 10.20.193.96:0/2241729962 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f10201095e0 con 0x7f103012bf20 2026-02-13T03:35:20.440 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.438+0000 7f102effd6c0 1 --2- 10.20.193.96:0/2241729962 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f10040b5690 0x7f10040d5b40 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1024005980 tx=0x7f1024005ee0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:20.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.551+0000 7f10353156c0 1 -- 10.20.193.96:0/2241729962 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f10301143d0 con 0x7f103012bf20 2026-02-13T03:35:20.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.552+0000 7f100ffff6c0 1 -- 10.20.193.96:0/2241729962 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f10200cba50 con 0x7f103012bf20 2026-02-13T03:35:20.555 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:35:20.555 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:35:20.555 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.553+0000 7f10353156c0 1 -- 10.20.193.96:0/2241729962 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f10040b5690 msgr2=0x7f10040d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:20.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.553+0000 7f10353156c0 1 --2- 10.20.193.96:0/2241729962 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f10040b5690 0x7f10040d5b40 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1024005980 tx=0x7f1024005ee0 comp rx=0 tx=0).stop 2026-02-13T03:35:20.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.553+0000 7f10353156c0 1 -- 10.20.193.96:0/2241729962 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f103012bf20 msgr2=0x7f103012c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:20.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.553+0000 7f10353156c0 1 --2- 10.20.193.96:0/2241729962 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f103012bf20 0x7f103012c3c0 secure :-1 s=READY pgs=354 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10200027a0 tx=0x7f10200054b0 comp rx=0 tx=0).stop 2026-02-13T03:35:20.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.553+0000 7f10353156c0 1 -- 10.20.193.96:0/2241729962 shutdown_connections 2026-02-13T03:35:20.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.553+0000 7f10353156c0 1 --2- 10.20.193.96:0/2241729962 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f10040b5690 0x7f10040d5b40 unknown :-1 s=CLOSED pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:20.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.553+0000 7f10353156c0 1 --2- 10.20.193.96:0/2241729962 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f103012bf20 0x7f103012c3c0 unknown :-1 s=CLOSED pgs=354 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:20.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.553+0000 7f10353156c0 1 --2- 10.20.193.96:0/2241729962 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f103011deb0 0x7f1030126b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:20.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.553+0000 7f10353156c0 1 --2- 10.20.193.96:0/2241729962 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1030114000 0x7f1030126620 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:20.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.553+0000 7f10353156c0 1 -- 10.20.193.96:0/2241729962 >> 10.20.193.96:0/2241729962 conn(0x7f103005c880 msgr2=0x7f103011bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:20.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.553+0000 7f10353156c0 1 -- 10.20.193.96:0/2241729962 shutdown_connections 2026-02-13T03:35:20.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:20.553+0000 7f10353156c0 1 -- 10.20.193.96:0/2241729962 wait complete. 2026-02-13T03:35:21.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:20 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2241729962' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:21.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:20 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2241729962' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:21.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:20 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2241729962' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:22.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:21 trial096 ceph-mon[24671]: pgmap v219: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:35:22.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:21 trial132 ceph-mon[26888]: pgmap v219: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:35:22.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:21 trial133 ceph-mon[26943]: pgmap v219: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:35:23.596 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:35:23.713 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:35:23.832 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.829+0000 7f004a77d6c0 1 -- 10.20.193.96:0/2825127690 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f004410f200 msgr2=0x7f004410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:23.832 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.829+0000 7f004a77d6c0 1 --2- 10.20.193.96:0/2825127690 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f004410f200 0x7f004410f5d0 secure :-1 s=READY pgs=355 gs=1 cs=0 l=1 c_cookie=7330972844720802230 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00300099a0 tx=0x7f003002ed20 comp rx=0 tx=0).stop 2026-02-13T03:35:23.832 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.829+0000 7f004a77d6c0 1 -- 10.20.193.96:0/2825127690 shutdown_connections 2026-02-13T03:35:23.832 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.829+0000 7f004a77d6c0 1 --2- 10.20.193.96:0/2825127690 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0044115410 0x7f0044175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:23.832 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.829+0000 7f004a77d6c0 1 --2- 10.20.193.96:0/2825127690 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f004410fbf0 0x7f0044114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:23.832 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.829+0000 7f004a77d6c0 1 --2- 10.20.193.96:0/2825127690 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f004410f200 0x7f004410f5d0 unknown :-1 s=CLOSED pgs=355 gs=1 cs=0 l=1 c_cookie=7330972844720802230 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:23.832 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.829+0000 7f004a77d6c0 1 -- 10.20.193.96:0/2825127690 >> 10.20.193.96:0/2825127690 conn(0x7f00440ecb00 msgr2=0x7f004410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:23.832 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.829+0000 7f004a77d6c0 1 -- 10.20.193.96:0/2825127690 shutdown_connections 2026-02-13T03:35:23.832 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.829+0000 7f004a77d6c0 1 -- 10.20.193.96:0/2825127690 wait complete. 2026-02-13T03:35:23.832 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.830+0000 7f004a77d6c0 1 Processor -- start 2026-02-13T03:35:23.832 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.830+0000 7f004a77d6c0 1 -- start start 2026-02-13T03:35:23.832 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.830+0000 7f004a77d6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f004410f200 0x7f004411d190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:23.832 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.830+0000 7f004a77d6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0044115410 0x7f004411d6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:23.832 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.830+0000 7f004a77d6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0044122a90 0x7f0044122f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:23.832 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.830+0000 7f004a77d6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f00441234a0 con 0x7f0044115410 2026-02-13T03:35:23.832 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.830+0000 7f004a77d6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0044123610 con 0x7f0044122a90 2026-02-13T03:35:23.833 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.830+0000 7f004a77d6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f00441237d0 con 0x7f004410f200 2026-02-13T03:35:23.833 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.830+0000 7f00437fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0044115410 0x7f004411d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:23.833 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.830+0000 7f00437fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0044115410 0x7f004411d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:40574/0 (socket says 10.20.193.96:40574) 2026-02-13T03:35:23.833 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.830+0000 7f00437fe6c0 1 -- 10.20.193.96:0/1859904325 learned_addr learned my addr 10.20.193.96:0/1859904325 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:35:23.833 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.830+0000 7f0043fff6c0 1 --2- 10.20.193.96:0/1859904325 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f004410f200 0x7f004411d190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:23.833 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.830+0000 7f0048cef6c0 1 --2- 10.20.193.96:0/1859904325 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0044122a90 0x7f0044122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:23.833 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.830+0000 7f00437fe6c0 1 -- 10.20.193.96:0/1859904325 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f004410f200 msgr2=0x7f004411d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:23.833 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.830+0000 7f00437fe6c0 1 --2- 10.20.193.96:0/1859904325 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f004410f200 0x7f004411d190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:23.833 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.830+0000 7f00437fe6c0 1 -- 10.20.193.96:0/1859904325 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0044122a90 msgr2=0x7f0044122f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:23.833 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.830+0000 7f00437fe6c0 1 --2- 10.20.193.96:0/1859904325 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0044122a90 0x7f0044122f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:23.833 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.830+0000 7f00437fe6c0 1 -- 10.20.193.96:0/1859904325 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0030009590 con 0x7f0044115410 2026-02-13T03:35:23.833 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.830+0000 7f00437fe6c0 1 --2- 10.20.193.96:0/1859904325 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0044115410 0x7f004411d6d0 secure :-1 s=READY pgs=356 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f003400b6c0 tx=0x7f003400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:23.833 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.830+0000 7f00417fa6c0 1 -- 10.20.193.96:0/1859904325 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0034004250 con 0x7f0044115410 2026-02-13T03:35:23.833 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.830+0000 7f004a77d6c0 1 -- 10.20.193.96:0/1859904325 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0044163c80 con 0x7f0044115410 2026-02-13T03:35:23.833 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.830+0000 7f00417fa6c0 1 -- 10.20.193.96:0/1859904325 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f0034009070 con 0x7f0044115410 2026-02-13T03:35:23.833 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.830+0000 7f00417fa6c0 1 -- 10.20.193.96:0/1859904325 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f003400ccd0 con 0x7f0044115410 2026-02-13T03:35:23.833 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.830+0000 7f004a77d6c0 1 -- 10.20.193.96:0/1859904325 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0044164110 con 0x7f0044115410 2026-02-13T03:35:23.833 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.831+0000 7f004a77d6c0 1 -- 10.20.193.96:0/1859904325 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00441104d0 con 0x7f0044115410 2026-02-13T03:35:23.834 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.832+0000 7f00417fa6c0 1 -- 10.20.193.96:0/1859904325 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f00340028c0 con 0x7f0044115410 2026-02-13T03:35:23.834 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.833+0000 7f00417fa6c0 1 --2- 10.20.193.96:0/1859904325 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f00180b5690 0x7f00180d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:23.835 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.833+0000 7f0043fff6c0 1 --2- 10.20.193.96:0/1859904325 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f00180b5690 0x7f00180d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:23.835 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.833+0000 7f00417fa6c0 1 -- 10.20.193.96:0/1859904325 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8031+0+0 (secure 0 0 0) 0x7f00340e3cc0 con 0x7f0044115410 2026-02-13T03:35:23.835 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.833+0000 7f0043fff6c0 1 --2- 10.20.193.96:0/1859904325 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f00180b5690 0x7f00180d5b40 secure :-1 s=READY pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00300023e0 tx=0x7f0030005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:23.835 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.833+0000 7f00417fa6c0 1 -- 10.20.193.96:0/1859904325 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f00340a65e0 con 0x7f0044115410 2026-02-13T03:35:23.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:23 trial096 ceph-mon[24671]: pgmap v220: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:35:23.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.948+0000 7f004a77d6c0 1 -- 10.20.193.96:0/1859904325 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f004411e2e0 con 0x7f0044115410 2026-02-13T03:35:23.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.948+0000 7f00417fa6c0 1 -- 10.20.193.96:0/1859904325 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f00340a9790 con 0x7f0044115410 2026-02-13T03:35:23.950 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:35:23.950 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:35:23.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.949+0000 7f004a77d6c0 1 -- 10.20.193.96:0/1859904325 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f00180b5690 msgr2=0x7f00180d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:23.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.949+0000 7f004a77d6c0 1 --2- 10.20.193.96:0/1859904325 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f00180b5690 0x7f00180d5b40 secure :-1 s=READY pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00300023e0 tx=0x7f0030005c00 comp rx=0 tx=0).stop 2026-02-13T03:35:23.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.949+0000 7f004a77d6c0 1 -- 10.20.193.96:0/1859904325 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0044115410 msgr2=0x7f004411d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:23.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.949+0000 7f004a77d6c0 1 --2- 10.20.193.96:0/1859904325 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0044115410 0x7f004411d6d0 secure :-1 s=READY pgs=356 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f003400b6c0 tx=0x7f003400bb90 comp rx=0 tx=0).stop 2026-02-13T03:35:23.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.949+0000 7f004a77d6c0 1 -- 10.20.193.96:0/1859904325 shutdown_connections 2026-02-13T03:35:23.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.949+0000 7f004a77d6c0 1 --2- 10.20.193.96:0/1859904325 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f00180b5690 0x7f00180d5b40 unknown :-1 s=CLOSED pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:23.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.949+0000 7f004a77d6c0 1 --2- 10.20.193.96:0/1859904325 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0044122a90 0x7f0044122f30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:23.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.949+0000 7f004a77d6c0 1 --2- 10.20.193.96:0/1859904325 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0044115410 0x7f004411d6d0 unknown :-1 s=CLOSED pgs=356 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:23.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.949+0000 7f004a77d6c0 1 --2- 10.20.193.96:0/1859904325 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f004410f200 0x7f004411d190 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:23.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.949+0000 7f004a77d6c0 1 -- 10.20.193.96:0/1859904325 >> 10.20.193.96:0/1859904325 conn(0x7f00440ecb00 msgr2=0x7f004410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:23.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.949+0000 7f004a77d6c0 1 -- 10.20.193.96:0/1859904325 shutdown_connections 2026-02-13T03:35:23.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:23.949+0000 7f004a77d6c0 1 -- 10.20.193.96:0/1859904325 wait complete. 2026-02-13T03:35:24.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:23 trial132 ceph-mon[26888]: pgmap v220: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:35:24.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:23 trial133 ceph-mon[26943]: pgmap v220: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:35:25.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:24 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1859904325' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:25.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:24 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1859904325' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:25.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:24 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1859904325' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:26.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:25 trial096 ceph-mon[24671]: pgmap v221: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T03:35:26.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:25 trial096 ceph-mon[24671]: mgrmap e13: x(active, since 3m), standbys: z, y 2026-02-13T03:35:26.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:25 trial132 ceph-mon[26888]: pgmap v221: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T03:35:26.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:25 trial132 ceph-mon[26888]: mgrmap e13: x(active, since 3m), standbys: z, y 2026-02-13T03:35:26.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:25 trial133 ceph-mon[26943]: pgmap v221: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T03:35:26.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:25 trial133 ceph-mon[26943]: mgrmap e13: x(active, since 3m), standbys: z, y 2026-02-13T03:35:27.008 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:35:27.128 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:35:27.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.244+0000 7fe0ebaaf6c0 1 -- 10.20.193.96:0/2414448494 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe0e410fbf0 msgr2=0x7fe0e4114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:27.248 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.244+0000 7fe0ebaaf6c0 1 --2- 10.20.193.96:0/2414448494 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe0e410fbf0 0x7fe0e4114c30 secure :-1 s=READY pgs=357 gs=1 cs=0 l=1 c_cookie=6985215895779648872 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0d80099a0 tx=0x7fe0d802ed20 comp rx=0 tx=0).stop 2026-02-13T03:35:27.249 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.244+0000 7fe0ebaaf6c0 1 -- 10.20.193.96:0/2414448494 shutdown_connections 2026-02-13T03:35:27.249 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.244+0000 7fe0ebaaf6c0 1 --2- 10.20.193.96:0/2414448494 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe0e4115410 0x7fe0e4175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:27.249 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.244+0000 7fe0ebaaf6c0 1 --2- 10.20.193.96:0/2414448494 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe0e410fbf0 0x7fe0e4114c30 unknown :-1 s=CLOSED pgs=357 gs=1 cs=0 l=1 c_cookie=6985215895779648872 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:27.249 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.244+0000 7fe0ebaaf6c0 1 --2- 10.20.193.96:0/2414448494 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe0e410f200 0x7fe0e410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:27.249 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.244+0000 7fe0ebaaf6c0 1 -- 10.20.193.96:0/2414448494 >> 10.20.193.96:0/2414448494 conn(0x7fe0e40ecb00 msgr2=0x7fe0e410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:27.249 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.244+0000 7fe0ebaaf6c0 1 -- 10.20.193.96:0/2414448494 shutdown_connections 2026-02-13T03:35:27.249 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.244+0000 7fe0ebaaf6c0 1 -- 10.20.193.96:0/2414448494 wait complete. 2026-02-13T03:35:27.249 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.244+0000 7fe0ebaaf6c0 1 Processor -- start 2026-02-13T03:35:27.249 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.244+0000 7fe0ebaaf6c0 1 -- start start 2026-02-13T03:35:27.249 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.245+0000 7fe0ebaaf6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe0e410f200 0x7fe0e411d210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:27.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.245+0000 7fe0ebaaf6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe0e4115410 0x7fe0e411d750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:27.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.245+0000 7fe0ebaaf6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe0e4122b10 0x7fe0e4122fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:27.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.245+0000 7fe0ebaaf6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e4123520 con 0x7fe0e4122b10 2026-02-13T03:35:27.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.245+0000 7fe0ebaaf6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e4123690 con 0x7fe0e410f200 2026-02-13T03:35:27.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.245+0000 7fe0ebaaf6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e4123850 con 0x7fe0e4115410 2026-02-13T03:35:27.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.245+0000 7fe0ea0216c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe0e4122b10 0x7fe0e4122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:27.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.245+0000 7fe0ea0216c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe0e4122b10 0x7fe0e4122fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:40592/0 (socket says 10.20.193.96:40592) 2026-02-13T03:35:27.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.245+0000 7fe0ea0216c0 1 -- 10.20.193.96:0/1403827768 learned_addr learned my addr 10.20.193.96:0/1403827768 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:35:27.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.245+0000 7fe0e901f6c0 1 --2- 10.20.193.96:0/1403827768 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe0e4115410 0x7fe0e411d750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:27.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.245+0000 7fe0e98206c0 1 --2- 10.20.193.96:0/1403827768 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe0e410f200 0x7fe0e411d210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:27.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.245+0000 7fe0ea0216c0 1 -- 10.20.193.96:0/1403827768 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe0e4115410 msgr2=0x7fe0e411d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:27.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.245+0000 7fe0ea0216c0 1 --2- 10.20.193.96:0/1403827768 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe0e4115410 0x7fe0e411d750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:27.251 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.245+0000 7fe0ea0216c0 1 -- 10.20.193.96:0/1403827768 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe0e410f200 msgr2=0x7fe0e411d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:27.251 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.245+0000 7fe0ea0216c0 1 --2- 10.20.193.96:0/1403827768 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe0e410f200 0x7fe0e411d210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:27.251 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.245+0000 7fe0ea0216c0 1 -- 10.20.193.96:0/1403827768 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d8009590 con 0x7fe0e4122b10 2026-02-13T03:35:27.251 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.245+0000 7fe0ea0216c0 1 --2- 10.20.193.96:0/1403827768 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe0e4122b10 0x7fe0e4122fb0 secure :-1 s=READY pgs=358 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0e0006ea0 tx=0x7fe0e000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:27.251 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.245+0000 7fe0d2ffd6c0 1 -- 10.20.193.96:0/1403827768 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0e0003a30 con 0x7fe0e4122b10 2026-02-13T03:35:27.251 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.245+0000 7fe0d2ffd6c0 1 -- 10.20.193.96:0/1403827768 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fe0e0005510 con 0x7fe0e4122b10 2026-02-13T03:35:27.251 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.245+0000 7fe0ebaaf6c0 1 -- 10.20.193.96:0/1403827768 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e4163d00 con 0x7fe0e4122b10 2026-02-13T03:35:27.251 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.245+0000 7fe0d2ffd6c0 1 -- 10.20.193.96:0/1403827768 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0e000dd70 con 0x7fe0e4122b10 2026-02-13T03:35:27.251 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.245+0000 7fe0ebaaf6c0 1 -- 10.20.193.96:0/1403827768 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e41641e0 con 0x7fe0e4122b10 2026-02-13T03:35:27.251 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.245+0000 7fe0ebaaf6c0 1 -- 10.20.193.96:0/1403827768 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e41104d0 con 0x7fe0e4122b10 2026-02-13T03:35:27.252 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.247+0000 7fe0d2ffd6c0 1 -- 10.20.193.96:0/1403827768 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fe0e0003b90 con 0x7fe0e4122b10 2026-02-13T03:35:27.252 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.247+0000 7fe0d2ffd6c0 1 --2- 10.20.193.96:0/1403827768 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe0c00b5680 0x7fe0c00d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:27.253 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.247+0000 7fe0e98206c0 1 --2- 10.20.193.96:0/1403827768 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe0c00b5680 0x7fe0c00d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:27.253 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.248+0000 7fe0d2ffd6c0 1 -- 10.20.193.96:0/1403827768 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8031+0+0 (secure 0 0 0) 0x7fe0e00e4ab0 con 0x7fe0e4122b10 2026-02-13T03:35:27.253 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.248+0000 7fe0e98206c0 1 --2- 10.20.193.96:0/1403827768 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe0c00b5680 0x7fe0c00d5b30 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0d4004750 tx=0x7fe0d4009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:27.253 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.248+0000 7fe0d2ffd6c0 1 -- 10.20.193.96:0/1403827768 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe0e00a7570 con 0x7fe0e4122b10 2026-02-13T03:35:27.364 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.362+0000 7fe0ebaaf6c0 1 -- 10.20.193.96:0/1403827768 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe0e411e390 con 0x7fe0e4122b10 2026-02-13T03:35:27.364 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.363+0000 7fe0d2ffd6c0 1 -- 10.20.193.96:0/1403827768 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe0e00aa720 con 0x7fe0e4122b10 2026-02-13T03:35:27.364 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:35:27.364 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:35:27.366 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.364+0000 7fe0ebaaf6c0 1 -- 10.20.193.96:0/1403827768 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe0c00b5680 msgr2=0x7fe0c00d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:27.366 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.364+0000 7fe0ebaaf6c0 1 --2- 10.20.193.96:0/1403827768 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe0c00b5680 0x7fe0c00d5b30 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0d4004750 tx=0x7fe0d4009260 comp rx=0 tx=0).stop 2026-02-13T03:35:27.366 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.364+0000 7fe0ebaaf6c0 1 -- 10.20.193.96:0/1403827768 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe0e4122b10 msgr2=0x7fe0e4122fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:27.366 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.364+0000 7fe0ebaaf6c0 1 --2- 10.20.193.96:0/1403827768 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe0e4122b10 0x7fe0e4122fb0 secure :-1 s=READY pgs=358 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0e0006ea0 tx=0x7fe0e000cca0 comp rx=0 tx=0).stop 2026-02-13T03:35:27.366 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.364+0000 7fe0ebaaf6c0 1 -- 10.20.193.96:0/1403827768 shutdown_connections 2026-02-13T03:35:27.366 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.364+0000 7fe0ebaaf6c0 1 --2- 10.20.193.96:0/1403827768 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe0c00b5680 0x7fe0c00d5b30 unknown :-1 s=CLOSED pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:27.366 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.364+0000 7fe0ebaaf6c0 1 --2- 10.20.193.96:0/1403827768 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe0e4122b10 0x7fe0e4122fb0 unknown :-1 s=CLOSED pgs=358 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:27.366 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.364+0000 7fe0ebaaf6c0 1 --2- 10.20.193.96:0/1403827768 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe0e4115410 0x7fe0e411d750 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:27.366 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.364+0000 7fe0ebaaf6c0 1 --2- 10.20.193.96:0/1403827768 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe0e410f200 0x7fe0e411d210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:27.366 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.364+0000 7fe0ebaaf6c0 1 -- 10.20.193.96:0/1403827768 >> 10.20.193.96:0/1403827768 conn(0x7fe0e40ecb00 msgr2=0x7fe0e410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:27.366 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.364+0000 7fe0ebaaf6c0 1 -- 10.20.193.96:0/1403827768 shutdown_connections 2026-02-13T03:35:27.366 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:27.364+0000 7fe0ebaaf6c0 1 -- 10.20.193.96:0/1403827768 wait complete. 2026-02-13T03:35:28.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:27 trial096 ceph-mon[24671]: pgmap v222: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2026-02-13T03:35:28.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:27 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1403827768' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:28.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:27 trial132 ceph-mon[26888]: pgmap v222: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2026-02-13T03:35:28.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:27 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1403827768' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:28.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:27 trial133 ceph-mon[26943]: pgmap v222: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2026-02-13T03:35:28.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:27 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1403827768' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:30.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:29 trial096 ceph-mon[24671]: pgmap v223: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-13T03:35:30.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:29 trial132 ceph-mon[26888]: pgmap v223: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-13T03:35:30.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:29 trial133 ceph-mon[26943]: pgmap v223: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-13T03:35:30.407 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:35:30.526 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:35:30.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4638a446c0 1 -- 10.20.193.96:0/2539418163 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4634115410 msgr2=0x7f4634175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:30.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4638a446c0 1 --2- 10.20.193.96:0/2539418163 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4634115410 0x7f4634175db0 secure :-1 s=READY pgs=359 gs=1 cs=0 l=1 c_cookie=10485734951868744483 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f462400aa70 tx=0x7f462402fde0 comp rx=0 tx=0).stop 2026-02-13T03:35:30.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4638a446c0 1 -- 10.20.193.96:0/2539418163 shutdown_connections 2026-02-13T03:35:30.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4638a446c0 1 --2- 10.20.193.96:0/2539418163 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4634115410 0x7f4634175db0 unknown :-1 s=CLOSED pgs=359 gs=1 cs=0 l=1 c_cookie=10485734951868744483 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:30.647 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4638a446c0 1 --2- 10.20.193.96:0/2539418163 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f463410fbf0 0x7f4634114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:30.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4638a446c0 1 --2- 10.20.193.96:0/2539418163 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f463410f200 0x7f463410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:30.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4638a446c0 1 -- 10.20.193.96:0/2539418163 >> 10.20.193.96:0/2539418163 conn(0x7f46340ecb00 msgr2=0x7f463410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:30.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4638a446c0 1 -- 10.20.193.96:0/2539418163 shutdown_connections 2026-02-13T03:35:30.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4638a446c0 1 -- 10.20.193.96:0/2539418163 wait complete. 2026-02-13T03:35:30.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4638a446c0 1 Processor -- start 2026-02-13T03:35:30.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4638a446c0 1 -- start start 2026-02-13T03:35:30.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4638a446c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f463410f200 0x7f463411d1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:30.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4638a446c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4634115410 0x7f463411d710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:30.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4638a446c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4634122ad0 0x7f4634122f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:30.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4638a446c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f46341234e0 con 0x7f4634122ad0 2026-02-13T03:35:30.648 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4638a446c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4634123650 con 0x7f463410f200 2026-02-13T03:35:30.649 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4638a446c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4634123810 con 0x7f4634115410 2026-02-13T03:35:30.649 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4632d766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4634122ad0 0x7f4634122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:30.649 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4632d766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4634122ad0 0x7f4634122f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:40614/0 (socket says 10.20.193.96:40614) 2026-02-13T03:35:30.649 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4632d766c0 1 -- 10.20.193.96:0/1568358348 learned_addr learned my addr 10.20.193.96:0/1568358348 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:35:30.649 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f46325756c0 1 --2- 10.20.193.96:0/1568358348 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f463410f200 0x7f463411d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:30.649 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4631d746c0 1 --2- 10.20.193.96:0/1568358348 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4634115410 0x7f463411d710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:30.649 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4632d766c0 1 -- 10.20.193.96:0/1568358348 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4634115410 msgr2=0x7f463411d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:30.649 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4632d766c0 1 --2- 10.20.193.96:0/1568358348 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4634115410 0x7f463411d710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:30.649 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4632d766c0 1 -- 10.20.193.96:0/1568358348 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f463410f200 msgr2=0x7f463411d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:30.649 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4632d766c0 1 --2- 10.20.193.96:0/1568358348 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f463410f200 0x7f463411d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:30.649 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.642+0000 7f4632d766c0 1 -- 10.20.193.96:0/1568358348 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462400a660 con 0x7f4634122ad0 2026-02-13T03:35:30.649 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.643+0000 7f4632d766c0 1 --2- 10.20.193.96:0/1568358348 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4634122ad0 0x7f4634122f70 secure :-1 s=READY pgs=360 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f462400ab70 tx=0x7f46240054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:30.650 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.643+0000 7f461b7fe6c0 1 -- 10.20.193.96:0/1568358348 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4624030d10 con 0x7f4634122ad0 2026-02-13T03:35:30.650 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.643+0000 7f461b7fe6c0 1 -- 10.20.193.96:0/1568358348 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f4624030e70 con 0x7f4634122ad0 2026-02-13T03:35:30.650 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.643+0000 7f4638a446c0 1 -- 10.20.193.96:0/1568358348 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4634163c60 con 0x7f4634122ad0 2026-02-13T03:35:30.650 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.643+0000 7f461b7fe6c0 1 -- 10.20.193.96:0/1568358348 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4624032920 con 0x7f4634122ad0 2026-02-13T03:35:30.650 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.643+0000 7f4638a446c0 1 -- 10.20.193.96:0/1568358348 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4634164090 con 0x7f4634122ad0 2026-02-13T03:35:30.650 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.643+0000 7f4638a446c0 1 -- 10.20.193.96:0/1568358348 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46341104d0 con 0x7f4634122ad0 2026-02-13T03:35:30.651 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.644+0000 7f461b7fe6c0 1 -- 10.20.193.96:0/1568358348 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f4624032030 con 0x7f4634122ad0 2026-02-13T03:35:30.651 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.645+0000 7f461b7fe6c0 1 --2- 10.20.193.96:0/1568358348 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f460c0b5680 0x7f460c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:30.651 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.645+0000 7f461b7fe6c0 1 -- 10.20.193.96:0/1568358348 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8031+0+0 (secure 0 0 0) 0x7f4624108d00 con 0x7f4634122ad0 2026-02-13T03:35:30.651 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.645+0000 7f46325756c0 1 --2- 10.20.193.96:0/1568358348 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f460c0b5680 0x7f460c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:30.651 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.645+0000 7f461b7fe6c0 1 -- 10.20.193.96:0/1568358348 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f46240cb780 con 0x7f4634122ad0 2026-02-13T03:35:30.651 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.645+0000 7f46325756c0 1 --2- 10.20.193.96:0/1568358348 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f460c0b5680 0x7f460c0d5b30 secure :-1 s=READY pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4628004750 tx=0x7f4628009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:30.763 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.760+0000 7f4638a446c0 1 -- 10.20.193.96:0/1568358348 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f463410f5d0 con 0x7f4634122ad0 2026-02-13T03:35:30.763 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.760+0000 7f461b7fe6c0 1 -- 10.20.193.96:0/1568358348 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f46240ce930 con 0x7f4634122ad0 2026-02-13T03:35:30.763 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:35:30.763 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:35:30.764 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.761+0000 7f4638a446c0 1 -- 10.20.193.96:0/1568358348 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f460c0b5680 msgr2=0x7f460c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:30.764 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.761+0000 7f4638a446c0 1 --2- 10.20.193.96:0/1568358348 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f460c0b5680 0x7f460c0d5b30 secure :-1 s=READY pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4628004750 tx=0x7f4628009390 comp rx=0 tx=0).stop 2026-02-13T03:35:30.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.761+0000 7f4638a446c0 1 -- 10.20.193.96:0/1568358348 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4634122ad0 msgr2=0x7f4634122f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:30.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.761+0000 7f4638a446c0 1 --2- 10.20.193.96:0/1568358348 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4634122ad0 0x7f4634122f70 secure :-1 s=READY pgs=360 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f462400ab70 tx=0x7f46240054b0 comp rx=0 tx=0).stop 2026-02-13T03:35:30.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.761+0000 7f4638a446c0 1 -- 10.20.193.96:0/1568358348 shutdown_connections 2026-02-13T03:35:30.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.761+0000 7f4638a446c0 1 --2- 10.20.193.96:0/1568358348 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f460c0b5680 0x7f460c0d5b30 unknown :-1 s=CLOSED pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:30.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.761+0000 7f4638a446c0 1 --2- 10.20.193.96:0/1568358348 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4634122ad0 0x7f4634122f70 unknown :-1 s=CLOSED pgs=360 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:30.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.761+0000 7f4638a446c0 1 --2- 10.20.193.96:0/1568358348 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4634115410 0x7f463411d710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:30.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.761+0000 7f4638a446c0 1 --2- 10.20.193.96:0/1568358348 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f463410f200 0x7f463411d1d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:30.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.761+0000 7f4638a446c0 1 -- 10.20.193.96:0/1568358348 >> 10.20.193.96:0/1568358348 conn(0x7f46340ecb00 msgr2=0x7f463410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:30.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.761+0000 7f4638a446c0 1 -- 10.20.193.96:0/1568358348 shutdown_connections 2026-02-13T03:35:30.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:30.761+0000 7f4638a446c0 1 -- 10.20.193.96:0/1568358348 wait complete. 2026-02-13T03:35:31.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:30 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1568358348' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:31.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:30 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1568358348' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:31.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:30 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1568358348' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:32.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:31 trial096 ceph-mon[24671]: pgmap v224: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-13T03:35:32.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:31 trial132 ceph-mon[26888]: pgmap v224: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-13T03:35:32.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:31 trial133 ceph-mon[26943]: pgmap v224: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-13T03:35:33.806 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:35:33.922 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:35:34.039 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.036+0000 7f8592f806c0 1 -- 10.20.193.96:0/1653819522 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f858c10f200 msgr2=0x7f858c10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:34.039 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.036+0000 7f8592f806c0 1 --2- 10.20.193.96:0/1653819522 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f858c10f200 0x7f858c10f5d0 secure :-1 s=READY pgs=361 gs=1 cs=0 l=1 c_cookie=18246694903811097607 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f857c0099a0 tx=0x7f857c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:35:34.039 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.036+0000 7f8592f806c0 1 -- 10.20.193.96:0/1653819522 shutdown_connections 2026-02-13T03:35:34.039 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.036+0000 7f8592f806c0 1 --2- 10.20.193.96:0/1653819522 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f858c115410 0x7f858c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:34.039 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.036+0000 7f8592f806c0 1 --2- 10.20.193.96:0/1653819522 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f858c10fbf0 0x7f858c114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:34.039 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.036+0000 7f8592f806c0 1 --2- 10.20.193.96:0/1653819522 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f858c10f200 0x7f858c10f5d0 unknown :-1 s=CLOSED pgs=361 gs=1 cs=0 l=1 c_cookie=18246694903811097607 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:34.039 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.036+0000 7f8592f806c0 1 -- 10.20.193.96:0/1653819522 >> 10.20.193.96:0/1653819522 conn(0x7f858c0ecb00 msgr2=0x7f858c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:34.039 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.036+0000 7f8592f806c0 1 -- 10.20.193.96:0/1653819522 shutdown_connections 2026-02-13T03:35:34.039 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.036+0000 7f8592f806c0 1 -- 10.20.193.96:0/1653819522 wait complete. 2026-02-13T03:35:34.039 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.036+0000 7f8592f806c0 1 Processor -- start 2026-02-13T03:35:34.039 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.036+0000 7f8592f806c0 1 -- start start 2026-02-13T03:35:34.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.036+0000 7f8592f806c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f858c10f200 0x7f858c11d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:34.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.036+0000 7f8592f806c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f858c115410 0x7f858c11d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:34.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.036+0000 7f8592f806c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f858c122b50 0x7f858c122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:34.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.036+0000 7f8592f806c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f858c123560 con 0x7f858c115410 2026-02-13T03:35:34.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.036+0000 7f8592f806c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f858c1236d0 con 0x7f858c10f200 2026-02-13T03:35:34.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.036+0000 7f8592f806c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f858c123890 con 0x7f858c122b50 2026-02-13T03:35:34.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.036+0000 7f8583fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f858c115410 0x7f858c11d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:34.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.037+0000 7f8583fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f858c115410 0x7f858c11d790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49344/0 (socket says 10.20.193.96:49344) 2026-02-13T03:35:34.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.037+0000 7f8590cf56c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f858c10f200 0x7f858c11d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:34.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.037+0000 7f8583fff6c0 1 -- 10.20.193.96:0/943101838 learned_addr learned my addr 10.20.193.96:0/943101838 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:35:34.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.037+0000 7f85914f66c0 1 --2- 10.20.193.96:0/943101838 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f858c122b50 0x7f858c122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:34.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.037+0000 7f8583fff6c0 1 -- 10.20.193.96:0/943101838 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f858c122b50 msgr2=0x7f858c122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:34.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.037+0000 7f8583fff6c0 1 --2- 10.20.193.96:0/943101838 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f858c122b50 0x7f858c122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:34.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.037+0000 7f8583fff6c0 1 -- 10.20.193.96:0/943101838 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f858c10f200 msgr2=0x7f858c11d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:34.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.037+0000 7f8583fff6c0 1 --2- 10.20.193.96:0/943101838 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f858c10f200 0x7f858c11d250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:34.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.037+0000 7f8583fff6c0 1 -- 10.20.193.96:0/943101838 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f857c009590 con 0x7f858c115410 2026-02-13T03:35:34.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.037+0000 7f8583fff6c0 1 --2- 10.20.193.96:0/943101838 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f858c115410 0x7f858c11d790 secure :-1 s=READY pgs=362 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8574005dc0 tx=0x7f857400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:34.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.037+0000 7f8581ffb6c0 1 -- 10.20.193.96:0/943101838 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8574004250 con 0x7f858c115410 2026-02-13T03:35:34.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.037+0000 7f8581ffb6c0 1 -- 10.20.193.96:0/943101838 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f8574009070 con 0x7f858c115410 2026-02-13T03:35:34.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.037+0000 7f8592f806c0 1 -- 10.20.193.96:0/943101838 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f858c163d40 con 0x7f858c115410 2026-02-13T03:35:34.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.037+0000 7f8581ffb6c0 1 -- 10.20.193.96:0/943101838 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f857400cdb0 con 0x7f858c115410 2026-02-13T03:35:34.040 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.037+0000 7f8592f806c0 1 -- 10.20.193.96:0/943101838 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f858c164220 con 0x7f858c115410 2026-02-13T03:35:34.041 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.037+0000 7f8592f806c0 1 -- 10.20.193.96:0/943101838 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f858c1104d0 con 0x7f858c115410 2026-02-13T03:35:34.042 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.039+0000 7f8581ffb6c0 1 -- 10.20.193.96:0/943101838 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f85740028c0 con 0x7f858c115410 2026-02-13T03:35:34.042 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.040+0000 7f8581ffb6c0 1 --2- 10.20.193.96:0/943101838 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f85680b5680 0x7f85680d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:34.042 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.040+0000 7f8590cf56c0 1 --2- 10.20.193.96:0/943101838 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f85680b5680 0x7f85680d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:34.042 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.040+0000 7f8581ffb6c0 1 -- 10.20.193.96:0/943101838 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8031+0+0 (secure 0 0 0) 0x7f85740e38a0 con 0x7f858c115410 2026-02-13T03:35:34.043 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.040+0000 7f8581ffb6c0 1 -- 10.20.193.96:0/943101838 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f85740a9dc0 con 0x7f858c115410 2026-02-13T03:35:34.043 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.040+0000 7f8590cf56c0 1 --2- 10.20.193.96:0/943101838 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f85680b5680 0x7f85680d5b30 secure :-1 s=READY pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f857c005b40 tx=0x7f857c0023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:34.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.154+0000 7f8592f806c0 1 -- 10.20.193.96:0/943101838 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f858c10f5d0 con 0x7f858c115410 2026-02-13T03:35:34.157 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:33 trial096 ceph-mon[24671]: pgmap v225: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-13T03:35:34.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.154+0000 7f8581ffb6c0 1 -- 10.20.193.96:0/943101838 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f85740a9510 con 0x7f858c115410 2026-02-13T03:35:34.157 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:35:34.157 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:35:34.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.155+0000 7f8592f806c0 1 -- 10.20.193.96:0/943101838 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f85680b5680 msgr2=0x7f85680d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:34.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.155+0000 7f8592f806c0 1 --2- 10.20.193.96:0/943101838 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f85680b5680 0x7f85680d5b30 secure :-1 s=READY pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f857c005b40 tx=0x7f857c0023a0 comp rx=0 tx=0).stop 2026-02-13T03:35:34.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.155+0000 7f8592f806c0 1 -- 10.20.193.96:0/943101838 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f858c115410 msgr2=0x7f858c11d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:34.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.155+0000 7f8592f806c0 1 --2- 10.20.193.96:0/943101838 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f858c115410 0x7f858c11d790 secure :-1 s=READY pgs=362 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8574005dc0 tx=0x7f857400bbb0 comp rx=0 tx=0).stop 2026-02-13T03:35:34.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.155+0000 7f8592f806c0 1 -- 10.20.193.96:0/943101838 shutdown_connections 2026-02-13T03:35:34.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.155+0000 7f8592f806c0 1 --2- 10.20.193.96:0/943101838 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f85680b5680 0x7f85680d5b30 unknown :-1 s=CLOSED pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:34.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.155+0000 7f8592f806c0 1 --2- 10.20.193.96:0/943101838 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f858c122b50 0x7f858c122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:34.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.155+0000 7f8592f806c0 1 --2- 10.20.193.96:0/943101838 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f858c115410 0x7f858c11d790 unknown :-1 s=CLOSED pgs=362 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:34.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.155+0000 7f8592f806c0 1 --2- 10.20.193.96:0/943101838 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f858c10f200 0x7f858c11d250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:34.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.155+0000 7f8592f806c0 1 -- 10.20.193.96:0/943101838 >> 10.20.193.96:0/943101838 conn(0x7f858c0ecb00 msgr2=0x7f858c10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:34.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.156+0000 7f8592f806c0 1 -- 10.20.193.96:0/943101838 shutdown_connections 2026-02-13T03:35:34.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:34.156+0000 7f8592f806c0 1 -- 10.20.193.96:0/943101838 wait complete. 2026-02-13T03:35:34.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:33 trial132 ceph-mon[26888]: pgmap v225: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-13T03:35:34.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:33 trial133 ceph-mon[26943]: pgmap v225: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-13T03:35:35.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:34 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/943101838' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:35.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:34 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/943101838' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:35.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:34 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/943101838' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:36.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:35 trial096 ceph-mon[24671]: pgmap v226: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-13T03:35:36.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:35 trial132 ceph-mon[26888]: pgmap v226: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-13T03:35:36.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:35 trial133 ceph-mon[26943]: pgmap v226: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-13T03:35:37.201 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:35:37.317 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:35:37.440 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.435+0000 7f27e8f086c0 1 -- 10.20.193.96:0/2948257526 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f27e410f200 msgr2=0x7f27e410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:37.440 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.435+0000 7f27e8f086c0 1 --2- 10.20.193.96:0/2948257526 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f27e410f200 0x7f27e410f5d0 secure :-1 s=READY pgs=363 gs=1 cs=0 l=1 c_cookie=11975031756016572771 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27d80099a0 tx=0x7f27d802ed20 comp rx=0 tx=0).stop 2026-02-13T03:35:37.440 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.435+0000 7f27e8f086c0 1 -- 10.20.193.96:0/2948257526 shutdown_connections 2026-02-13T03:35:37.441 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.435+0000 7f27e8f086c0 1 --2- 10.20.193.96:0/2948257526 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f27e4115410 0x7f27e4175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:37.441 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.435+0000 7f27e8f086c0 1 --2- 10.20.193.96:0/2948257526 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f27e410fbf0 0x7f27e4114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:37.441 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.435+0000 7f27e8f086c0 1 --2- 10.20.193.96:0/2948257526 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f27e410f200 0x7f27e410f5d0 unknown :-1 s=CLOSED pgs=363 gs=1 cs=0 l=1 c_cookie=11975031756016572771 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:37.441 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.435+0000 7f27e8f086c0 1 -- 10.20.193.96:0/2948257526 >> 10.20.193.96:0/2948257526 conn(0x7f27e40ecb00 msgr2=0x7f27e410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:37.441 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.435+0000 7f27e8f086c0 1 -- 10.20.193.96:0/2948257526 shutdown_connections 2026-02-13T03:35:37.441 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.435+0000 7f27e8f086c0 1 -- 10.20.193.96:0/2948257526 wait complete. 2026-02-13T03:35:37.441 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.435+0000 7f27e8f086c0 1 Processor -- start 2026-02-13T03:35:37.441 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.436+0000 7f27e8f086c0 1 -- start start 2026-02-13T03:35:37.441 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.436+0000 7f27e8f086c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f27e410f200 0x7f27e411d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:37.441 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.436+0000 7f27e8f086c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f27e4115410 0x7f27e411d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:37.442 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.436+0000 7f27e8f086c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f27e4122b50 0x7f27e4122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:37.442 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.436+0000 7f27e8f086c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f27e4123560 con 0x7f27e4115410 2026-02-13T03:35:37.442 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.436+0000 7f27e8f086c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f27e41236d0 con 0x7f27e4122b50 2026-02-13T03:35:37.442 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.436+0000 7f27e8f086c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f27e4123890 con 0x7f27e410f200 2026-02-13T03:35:37.442 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.436+0000 7f27e1d746c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f27e4115410 0x7f27e411d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:37.442 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.436+0000 7f27e1d746c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f27e4115410 0x7f27e411d790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49376/0 (socket says 10.20.193.96:49376) 2026-02-13T03:35:37.442 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.436+0000 7f27e1d746c0 1 -- 10.20.193.96:0/3870450527 learned_addr learned my addr 10.20.193.96:0/3870450527 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:35:37.442 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.436+0000 7f27e2d766c0 1 --2- 10.20.193.96:0/3870450527 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f27e4122b50 0x7f27e4122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:37.442 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.436+0000 7f27e1d746c0 1 -- 10.20.193.96:0/3870450527 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f27e410f200 msgr2=0x7f27e411d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:37.442 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.436+0000 7f27e1d746c0 1 --2- 10.20.193.96:0/3870450527 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f27e410f200 0x7f27e411d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:37.442 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.436+0000 7f27e1d746c0 1 -- 10.20.193.96:0/3870450527 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f27e4122b50 msgr2=0x7f27e4122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:37.443 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.436+0000 7f27e1d746c0 1 --2- 10.20.193.96:0/3870450527 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f27e4122b50 0x7f27e4122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:37.443 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.436+0000 7f27e1d746c0 1 -- 10.20.193.96:0/3870450527 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d8009590 con 0x7f27e4115410 2026-02-13T03:35:37.443 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.436+0000 7f27e1d746c0 1 --2- 10.20.193.96:0/3870450527 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f27e4115410 0x7f27e411d790 secure :-1 s=READY pgs=364 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27cc005dc0 tx=0x7f27cc00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:37.443 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.436+0000 7f27cb7fe6c0 1 -- 10.20.193.96:0/3870450527 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f27cc004250 con 0x7f27e4115410 2026-02-13T03:35:37.443 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.436+0000 7f27cb7fe6c0 1 -- 10.20.193.96:0/3870450527 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f27cc009070 con 0x7f27e4115410 2026-02-13T03:35:37.443 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.436+0000 7f27e8f086c0 1 -- 10.20.193.96:0/3870450527 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27e4163d40 con 0x7f27e4115410 2026-02-13T03:35:37.443 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.436+0000 7f27cb7fe6c0 1 -- 10.20.193.96:0/3870450527 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f27cc00cdb0 con 0x7f27e4115410 2026-02-13T03:35:37.443 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.436+0000 7f27e8f086c0 1 -- 10.20.193.96:0/3870450527 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27e4164220 con 0x7f27e4115410 2026-02-13T03:35:37.443 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.437+0000 7f27e8f086c0 1 -- 10.20.193.96:0/3870450527 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27e41104d0 con 0x7f27e4115410 2026-02-13T03:35:37.444 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.438+0000 7f27cb7fe6c0 1 -- 10.20.193.96:0/3870450527 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f27cc0028c0 con 0x7f27e4115410 2026-02-13T03:35:37.445 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.439+0000 7f27cb7fe6c0 1 --2- 10.20.193.96:0/3870450527 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f27bc0b5680 0x7f27bc0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:37.445 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.439+0000 7f27e25756c0 1 --2- 10.20.193.96:0/3870450527 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f27bc0b5680 0x7f27bc0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:37.445 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.439+0000 7f27cb7fe6c0 1 -- 10.20.193.96:0/3870450527 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8031+0+0 (secure 0 0 0) 0x7f27cc0e3a00 con 0x7f27e4115410 2026-02-13T03:35:37.445 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.439+0000 7f27e25756c0 1 --2- 10.20.193.96:0/3870450527 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f27bc0b5680 0x7f27bc0d5b30 secure :-1 s=READY pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27d8005b40 tx=0x7f27d8005c20 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:37.445 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.439+0000 7f27cb7fe6c0 1 -- 10.20.193.96:0/3870450527 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f27cc0a64c0 con 0x7f27e4115410 2026-02-13T03:35:37.557 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.554+0000 7f27e8f086c0 1 -- 10.20.193.96:0/3870450527 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f27e410f5d0 con 0x7f27e4115410 2026-02-13T03:35:37.557 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.554+0000 7f27cb7fe6c0 1 -- 10.20.193.96:0/3870450527 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f27cc0a9670 con 0x7f27e4115410 2026-02-13T03:35:37.558 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:35:37.558 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:35:37.559 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.555+0000 7f27e8f086c0 1 -- 10.20.193.96:0/3870450527 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f27bc0b5680 msgr2=0x7f27bc0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:37.559 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.555+0000 7f27e8f086c0 1 --2- 10.20.193.96:0/3870450527 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f27bc0b5680 0x7f27bc0d5b30 secure :-1 s=READY pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27d8005b40 tx=0x7f27d8005c20 comp rx=0 tx=0).stop 2026-02-13T03:35:37.559 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.555+0000 7f27e8f086c0 1 -- 10.20.193.96:0/3870450527 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f27e4115410 msgr2=0x7f27e411d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:37.559 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.555+0000 7f27e8f086c0 1 --2- 10.20.193.96:0/3870450527 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f27e4115410 0x7f27e411d790 secure :-1 s=READY pgs=364 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27cc005dc0 tx=0x7f27cc00bbb0 comp rx=0 tx=0).stop 2026-02-13T03:35:37.559 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.555+0000 7f27e8f086c0 1 -- 10.20.193.96:0/3870450527 shutdown_connections 2026-02-13T03:35:37.559 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.555+0000 7f27e8f086c0 1 --2- 10.20.193.96:0/3870450527 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f27bc0b5680 0x7f27bc0d5b30 unknown :-1 s=CLOSED pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:37.559 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.555+0000 7f27e8f086c0 1 --2- 10.20.193.96:0/3870450527 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f27e4122b50 0x7f27e4122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:37.560 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.555+0000 7f27e8f086c0 1 --2- 10.20.193.96:0/3870450527 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f27e4115410 0x7f27e411d790 unknown :-1 s=CLOSED pgs=364 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:37.560 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.555+0000 7f27e8f086c0 1 --2- 10.20.193.96:0/3870450527 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f27e410f200 0x7f27e411d250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:37.560 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.555+0000 7f27e8f086c0 1 -- 10.20.193.96:0/3870450527 >> 10.20.193.96:0/3870450527 conn(0x7f27e40ecb00 msgr2=0x7f27e410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:37.560 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.555+0000 7f27e8f086c0 1 -- 10.20.193.96:0/3870450527 shutdown_connections 2026-02-13T03:35:37.560 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:37.555+0000 7f27e8f086c0 1 -- 10.20.193.96:0/3870450527 wait complete. 2026-02-13T03:35:38.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:37 trial096 ceph-mon[24671]: pgmap v227: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-13T03:35:38.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:37 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3870450527' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:38.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:37 trial132 ceph-mon[26888]: pgmap v227: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-13T03:35:38.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:37 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3870450527' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:38.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:37 trial133 ceph-mon[26943]: pgmap v227: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-13T03:35:38.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:37 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3870450527' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:40.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:39 trial096 ceph-mon[24671]: pgmap v228: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2026-02-13T03:35:40.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:39 trial132 ceph-mon[26888]: pgmap v228: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2026-02-13T03:35:40.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:39 trial133 ceph-mon[26943]: pgmap v228: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2026-02-13T03:35:40.598 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:35:40.718 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:35:40.837 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.832+0000 7f078d08d6c0 1 -- 10.20.193.96:0/2326593269 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f078810cfb0 msgr2=0x7f078810d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:40.837 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.832+0000 7f078d08d6c0 1 --2- 10.20.193.96:0/2326593269 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f078810cfb0 0x7f078810d380 secure :-1 s=READY pgs=365 gs=1 cs=0 l=1 c_cookie=3792764715441644526 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f077c0099a0 tx=0x7f077c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:35:40.837 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.832+0000 7f078d08d6c0 1 -- 10.20.193.96:0/2326593269 shutdown_connections 2026-02-13T03:35:40.837 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.832+0000 7f078d08d6c0 1 --2- 10.20.193.96:0/2326593269 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f07881131c0 0x7f0788173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:40.838 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.832+0000 7f078d08d6c0 1 --2- 10.20.193.96:0/2326593269 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f078810d9a0 0x7f07881129e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:40.838 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.832+0000 7f078d08d6c0 1 --2- 10.20.193.96:0/2326593269 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f078810cfb0 0x7f078810d380 unknown :-1 s=CLOSED pgs=365 gs=1 cs=0 l=1 c_cookie=3792764715441644526 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:40.838 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.832+0000 7f078d08d6c0 1 -- 10.20.193.96:0/2326593269 >> 10.20.193.96:0/2326593269 conn(0x7f07880ea8b0 msgr2=0x7f078810acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:40.838 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.832+0000 7f078d08d6c0 1 -- 10.20.193.96:0/2326593269 shutdown_connections 2026-02-13T03:35:40.838 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.832+0000 7f078d08d6c0 1 -- 10.20.193.96:0/2326593269 wait complete. 2026-02-13T03:35:40.838 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.832+0000 7f078d08d6c0 1 Processor -- start 2026-02-13T03:35:40.838 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.832+0000 7f078d08d6c0 1 -- start start 2026-02-13T03:35:40.838 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.832+0000 7f078d08d6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f078810cfb0 0x7f0788060700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:40.838 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.832+0000 7f078d08d6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f07881131c0 0x7f0788060c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:40.838 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.832+0000 7f078d08d6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0788061180 0x7f07881632e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:40.839 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.832+0000 7f078d08d6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0788163820 con 0x7f0788061180 2026-02-13T03:35:40.839 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.832+0000 7f078d08d6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0788163990 con 0x7f07881131c0 2026-02-13T03:35:40.839 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.832+0000 7f078d08d6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0788163b50 con 0x7f078810cfb0 2026-02-13T03:35:40.839 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.832+0000 7f07875776c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0788061180 0x7f07881632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:40.839 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.832+0000 7f07875776c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0788061180 0x7f07881632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49406/0 (socket says 10.20.193.96:49406) 2026-02-13T03:35:40.839 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.832+0000 7f07875776c0 1 -- 10.20.193.96:0/704121385 learned_addr learned my addr 10.20.193.96:0/704121385 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:35:40.839 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.833+0000 7f07865756c0 1 --2- 10.20.193.96:0/704121385 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f07881131c0 0x7f0788060c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:40.839 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.833+0000 7f0786d766c0 1 --2- 10.20.193.96:0/704121385 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f078810cfb0 0x7f0788060700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:40.839 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.833+0000 7f07875776c0 1 -- 10.20.193.96:0/704121385 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f078810cfb0 msgr2=0x7f0788060700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:40.839 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.833+0000 7f07875776c0 1 --2- 10.20.193.96:0/704121385 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f078810cfb0 0x7f0788060700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:40.839 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.833+0000 7f07875776c0 1 -- 10.20.193.96:0/704121385 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f07881131c0 msgr2=0x7f0788060c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:40.839 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.833+0000 7f07875776c0 1 --2- 10.20.193.96:0/704121385 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f07881131c0 0x7f0788060c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:40.840 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.833+0000 7f07875776c0 1 -- 10.20.193.96:0/704121385 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f077c009590 con 0x7f0788061180 2026-02-13T03:35:40.840 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.833+0000 7f07875776c0 1 --2- 10.20.193.96:0/704121385 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0788061180 0x7f07881632e0 secure :-1 s=READY pgs=366 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0778006ea0 tx=0x7f077800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:40.840 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.833+0000 7f0767fff6c0 1 -- 10.20.193.96:0/704121385 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0778003a30 con 0x7f0788061180 2026-02-13T03:35:40.840 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.833+0000 7f078d08d6c0 1 -- 10.20.193.96:0/704121385 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0788163e30 con 0x7f0788061180 2026-02-13T03:35:40.840 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.833+0000 7f0767fff6c0 1 -- 10.20.193.96:0/704121385 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f0778005510 con 0x7f0788061180 2026-02-13T03:35:40.840 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.833+0000 7f0767fff6c0 1 -- 10.20.193.96:0/704121385 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f077800dd70 con 0x7f0788061180 2026-02-13T03:35:40.840 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.833+0000 7f078d08d6c0 1 -- 10.20.193.96:0/704121385 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0788164360 con 0x7f0788061180 2026-02-13T03:35:40.840 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.833+0000 7f078d08d6c0 1 -- 10.20.193.96:0/704121385 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f078810e280 con 0x7f0788061180 2026-02-13T03:35:40.841 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.834+0000 7f0767fff6c0 1 -- 10.20.193.96:0/704121385 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f0778003b90 con 0x7f0788061180 2026-02-13T03:35:40.841 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.835+0000 7f0767fff6c0 1 --2- 10.20.193.96:0/704121385 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f075c0b5600 0x7f075c0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:40.841 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.835+0000 7f0786d766c0 1 --2- 10.20.193.96:0/704121385 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f075c0b5600 0x7f075c0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:40.842 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.835+0000 7f0767fff6c0 1 -- 10.20.193.96:0/704121385 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8031+0+0 (secure 0 0 0) 0x7f07780e4ae0 con 0x7f0788061180 2026-02-13T03:35:40.842 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.835+0000 7f0767fff6c0 1 -- 10.20.193.96:0/704121385 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f07780aafc0 con 0x7f0788061180 2026-02-13T03:35:40.842 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.835+0000 7f0786d766c0 1 --2- 10.20.193.96:0/704121385 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f075c0b5600 0x7f075c0d5ab0 secure :-1 s=READY pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f077c0023e0 tx=0x7f077c009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:40.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.951+0000 7f078d08d6c0 1 -- 10.20.193.96:0/704121385 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f078810d380 con 0x7f0788061180 2026-02-13T03:35:40.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.951+0000 7f0767fff6c0 1 -- 10.20.193.96:0/704121385 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f07780ad030 con 0x7f0788061180 2026-02-13T03:35:40.954 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:35:40.955 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:35:40.955 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.952+0000 7f078d08d6c0 1 -- 10.20.193.96:0/704121385 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f075c0b5600 msgr2=0x7f075c0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:40.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.952+0000 7f078d08d6c0 1 --2- 10.20.193.96:0/704121385 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f075c0b5600 0x7f075c0d5ab0 secure :-1 s=READY pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f077c0023e0 tx=0x7f077c009260 comp rx=0 tx=0).stop 2026-02-13T03:35:40.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.952+0000 7f078d08d6c0 1 -- 10.20.193.96:0/704121385 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0788061180 msgr2=0x7f07881632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:40.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.952+0000 7f078d08d6c0 1 --2- 10.20.193.96:0/704121385 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0788061180 0x7f07881632e0 secure :-1 s=READY pgs=366 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0778006ea0 tx=0x7f077800cca0 comp rx=0 tx=0).stop 2026-02-13T03:35:40.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.952+0000 7f078d08d6c0 1 -- 10.20.193.96:0/704121385 shutdown_connections 2026-02-13T03:35:40.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.952+0000 7f078d08d6c0 1 --2- 10.20.193.96:0/704121385 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f075c0b5600 0x7f075c0d5ab0 unknown :-1 s=CLOSED pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:40.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.952+0000 7f078d08d6c0 1 --2- 10.20.193.96:0/704121385 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0788061180 0x7f07881632e0 unknown :-1 s=CLOSED pgs=366 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:40.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.952+0000 7f078d08d6c0 1 --2- 10.20.193.96:0/704121385 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f07881131c0 0x7f0788060c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:40.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.952+0000 7f078d08d6c0 1 --2- 10.20.193.96:0/704121385 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f078810cfb0 0x7f0788060700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:40.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.952+0000 7f078d08d6c0 1 -- 10.20.193.96:0/704121385 >> 10.20.193.96:0/704121385 conn(0x7f07880ea8b0 msgr2=0x7f078810ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:40.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.952+0000 7f078d08d6c0 1 -- 10.20.193.96:0/704121385 shutdown_connections 2026-02-13T03:35:40.957 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:40.952+0000 7f078d08d6c0 1 -- 10.20.193.96:0/704121385 wait complete. 2026-02-13T03:35:42.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:41 trial096 ceph-mon[24671]: pgmap v229: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:35:42.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:41 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/704121385' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:42.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:41 trial132 ceph-mon[26888]: pgmap v229: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:35:42.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:41 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/704121385' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:42.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:41 trial133 ceph-mon[26943]: pgmap v229: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:35:42.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:41 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/704121385' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:43.997 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:35:44.115 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:35:44.138 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:43 trial096 ceph-mon[24671]: pgmap v230: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:35:44.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:43 trial132 ceph-mon[26888]: pgmap v230: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:35:44.239 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.234+0000 7f8ad11846c0 1 -- 10.20.193.96:0/604259540 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8acc10f200 msgr2=0x7f8acc10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:44.239 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.234+0000 7f8ad11846c0 1 --2- 10.20.193.96:0/604259540 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8acc10f200 0x7f8acc10f5d0 secure :-1 s=READY pgs=367 gs=1 cs=0 l=1 c_cookie=9466166687873094372 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ac00099a0 tx=0x7f8ac002ed20 comp rx=0 tx=0).stop 2026-02-13T03:35:44.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.234+0000 7f8ad11846c0 1 -- 10.20.193.96:0/604259540 shutdown_connections 2026-02-13T03:35:44.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.234+0000 7f8ad11846c0 1 --2- 10.20.193.96:0/604259540 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8acc115410 0x7f8acc175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:44.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.234+0000 7f8ad11846c0 1 --2- 10.20.193.96:0/604259540 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8acc10fbf0 0x7f8acc114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:44.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.234+0000 7f8ad11846c0 1 --2- 10.20.193.96:0/604259540 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8acc10f200 0x7f8acc10f5d0 unknown :-1 s=CLOSED pgs=367 gs=1 cs=0 l=1 c_cookie=9466166687873094372 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:44.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.234+0000 7f8ad11846c0 1 -- 10.20.193.96:0/604259540 >> 10.20.193.96:0/604259540 conn(0x7f8acc0ecb00 msgr2=0x7f8acc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:44.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.234+0000 7f8ad11846c0 1 -- 10.20.193.96:0/604259540 shutdown_connections 2026-02-13T03:35:44.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.234+0000 7f8ad11846c0 1 -- 10.20.193.96:0/604259540 wait complete. 2026-02-13T03:35:44.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.234+0000 7f8ad11846c0 1 Processor -- start 2026-02-13T03:35:44.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.234+0000 7f8ad11846c0 1 -- start start 2026-02-13T03:35:44.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.235+0000 7f8ad11846c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8acc10f200 0x7f8acc11d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:44.240 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.235+0000 7f8ad11846c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8acc115410 0x7f8acc11d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:44.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.235+0000 7f8ad11846c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8acc122ae0 0x7f8acc122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:44.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.235+0000 7f8ad11846c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f8acc1234f0 con 0x7f8acc115410 2026-02-13T03:35:44.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.235+0000 7f8ad11846c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8acc123660 con 0x7f8acc10f200 2026-02-13T03:35:44.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.235+0000 7f8ad11846c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8acc123820 con 0x7f8acc122ae0 2026-02-13T03:35:44.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.235+0000 7f8aca5756c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8acc115410 0x7f8acc11d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:44.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.235+0000 7f8aca5756c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8acc115410 0x7f8acc11d720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:37658/0 (socket says 10.20.193.96:37658) 2026-02-13T03:35:44.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.235+0000 7f8aca5756c0 1 -- 10.20.193.96:0/261746726 learned_addr learned my addr 10.20.193.96:0/261746726 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:35:44.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.235+0000 7f8acad766c0 1 --2- 10.20.193.96:0/261746726 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8acc10f200 0x7f8acc11d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:44.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.235+0000 7f8acb5776c0 1 --2- 10.20.193.96:0/261746726 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8acc122ae0 0x7f8acc122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:44.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.235+0000 7f8aca5756c0 1 -- 10.20.193.96:0/261746726 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8acc122ae0 msgr2=0x7f8acc122f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:44.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.235+0000 7f8aca5756c0 1 --2- 10.20.193.96:0/261746726 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8acc122ae0 0x7f8acc122f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:44.241 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.235+0000 7f8aca5756c0 1 -- 10.20.193.96:0/261746726 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8acc10f200 msgr2=0x7f8acc11d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:44.242 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.235+0000 7f8aca5756c0 1 --2- 10.20.193.96:0/261746726 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8acc10f200 0x7f8acc11d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:44.242 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.235+0000 7f8aca5756c0 1 -- 10.20.193.96:0/261746726 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac0009590 con 0x7f8acc115410 2026-02-13T03:35:44.242 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.235+0000 7f8aca5756c0 1 --2- 10.20.193.96:0/261746726 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8acc115410 0x7f8acc11d720 secure :-1 s=READY pgs=368 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ab400b6c0 tx=0x7f8ab400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:44.242 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.235+0000 7f8aabfff6c0 1 -- 10.20.193.96:0/261746726 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8ab4004250 con 0x7f8acc115410 2026-02-13T03:35:44.242 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.235+0000 7f8aabfff6c0 1 -- 10.20.193.96:0/261746726 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f8ab4009070 con 0x7f8acc115410 2026-02-13T03:35:44.242 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.235+0000 7f8ad11846c0 1 -- 10.20.193.96:0/261746726 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8acc163cd0 con 0x7f8acc115410 2026-02-13T03:35:44.242 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.235+0000 7f8aabfff6c0 1 -- 10.20.193.96:0/261746726 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8ab400ccd0 con 0x7f8acc115410 2026-02-13T03:35:44.242 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.235+0000 7f8ad11846c0 1 -- 10.20.193.96:0/261746726 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8acc164160 con 0x7f8acc115410 2026-02-13T03:35:44.242 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.235+0000 7f8ad11846c0 1 -- 10.20.193.96:0/261746726 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8acc1104d0 con 0x7f8acc115410 2026-02-13T03:35:44.243 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.237+0000 7f8aabfff6c0 1 -- 10.20.193.96:0/261746726 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f8ab40028c0 con 0x7f8acc115410 2026-02-13T03:35:44.243 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.237+0000 7f8aabfff6c0 1 --2- 10.20.193.96:0/261746726 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f8aa00b5680 0x7f8aa00d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:44.243 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.237+0000 7f8acad766c0 1 --2- 10.20.193.96:0/261746726 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f8aa00b5680 0x7f8aa00d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:44.243 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.238+0000 7f8aabfff6c0 1 -- 10.20.193.96:0/261746726 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8031+0+0 (secure 0 0 0) 0x7f8ab40e3ab0 con 0x7f8acc115410 2026-02-13T03:35:44.243 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.238+0000 7f8aabfff6c0 1 -- 10.20.193.96:0/261746726 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8ab40a9f90 con 0x7f8acc115410 2026-02-13T03:35:44.244 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.238+0000 7f8acad766c0 1 --2- 10.20.193.96:0/261746726 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f8aa00b5680 0x7f8aa00d5b30 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ac00023e0 tx=0x7f8ac0009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:44.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:43 trial133 ceph-mon[26943]: pgmap v230: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:35:44.354 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.351+0000 7f8ad11846c0 1 -- 10.20.193.96:0/261746726 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8acc10f5d0 con 0x7f8acc115410 2026-02-13T03:35:44.354 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.351+0000 7f8aabfff6c0 1 -- 10.20.193.96:0/261746726 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f8ab40ac000 con 0x7f8acc115410 2026-02-13T03:35:44.355 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:35:44.355 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:35:44.356 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.352+0000 7f8ad11846c0 1 -- 10.20.193.96:0/261746726 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f8aa00b5680 msgr2=0x7f8aa00d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:44.356 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.352+0000 7f8ad11846c0 1 --2- 10.20.193.96:0/261746726 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f8aa00b5680 0x7f8aa00d5b30 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ac00023e0 tx=0x7f8ac0009260 comp rx=0 tx=0).stop 2026-02-13T03:35:44.356 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.352+0000 7f8ad11846c0 1 -- 10.20.193.96:0/261746726 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8acc115410 msgr2=0x7f8acc11d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:44.356 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.352+0000 7f8ad11846c0 1 --2- 10.20.193.96:0/261746726 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8acc115410 0x7f8acc11d720 secure :-1 s=READY pgs=368 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ab400b6c0 tx=0x7f8ab400bb90 comp rx=0 tx=0).stop 2026-02-13T03:35:44.356 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.352+0000 7f8ad11846c0 1 -- 10.20.193.96:0/261746726 shutdown_connections 2026-02-13T03:35:44.357 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.352+0000 7f8ad11846c0 1 --2- 10.20.193.96:0/261746726 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f8aa00b5680 0x7f8aa00d5b30 unknown :-1 s=CLOSED pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:44.357 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.352+0000 7f8ad11846c0 1 --2- 10.20.193.96:0/261746726 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f8acc122ae0 0x7f8acc122f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:44.357 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.352+0000 7f8ad11846c0 1 --2- 10.20.193.96:0/261746726 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f8acc115410 0x7f8acc11d720 unknown :-1 s=CLOSED pgs=368 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:44.357 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.352+0000 7f8ad11846c0 1 --2- 10.20.193.96:0/261746726 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f8acc10f200 0x7f8acc11d1e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:44.357 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.352+0000 7f8ad11846c0 1 -- 10.20.193.96:0/261746726 >> 10.20.193.96:0/261746726 conn(0x7f8acc0ecb00 msgr2=0x7f8acc10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:44.357 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.352+0000 7f8ad11846c0 1 -- 10.20.193.96:0/261746726 shutdown_connections 2026-02-13T03:35:44.357 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:44.352+0000 7f8ad11846c0 1 -- 10.20.193.96:0/261746726 wait complete. 2026-02-13T03:35:45.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:44 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/261746726' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:45.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:44 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/261746726' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:45.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:44 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/261746726' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:46.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:45 trial096 ceph-mon[24671]: pgmap v231: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:35:46.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:45 trial132 ceph-mon[26888]: pgmap v231: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:35:46.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:45 trial133 ceph-mon[26943]: pgmap v231: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:35:47.397 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:35:47.518 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:35:47.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.626+0000 7f133f2136c0 1 -- 10.20.193.96:0/3737967947 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f13381131c0 msgr2=0x7f1338173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:47.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.626+0000 7f133f2136c0 1 --2- 10.20.193.96:0/3737967947 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f13381131c0 0x7f1338173b60 secure :-1 s=READY pgs=369 gs=1 cs=0 l=1 c_cookie=9527642590634764888 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f133400aa70 tx=0x7f133402fde0 comp rx=0 tx=0).stop 2026-02-13T03:35:47.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.626+0000 7f133f2136c0 1 -- 10.20.193.96:0/3737967947 shutdown_connections 2026-02-13T03:35:47.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.626+0000 7f133f2136c0 1 --2- 10.20.193.96:0/3737967947 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f13381131c0 0x7f1338173b60 unknown :-1 s=CLOSED pgs=369 gs=1 cs=0 l=1 c_cookie=9527642590634764888 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:47.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.626+0000 7f133f2136c0 1 --2- 10.20.193.96:0/3737967947 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f133810d9a0 0x7f13381129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:47.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.626+0000 7f133f2136c0 1 --2- 10.20.193.96:0/3737967947 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f133810cfb0 0x7f133810d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:47.632 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.626+0000 7f133f2136c0 1 -- 10.20.193.96:0/3737967947 >> 10.20.193.96:0/3737967947 conn(0x7f13380ea8b0 msgr2=0x7f133810acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:47.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.626+0000 7f133f2136c0 1 -- 10.20.193.96:0/3737967947 shutdown_connections 2026-02-13T03:35:47.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.627+0000 7f133f2136c0 1 -- 10.20.193.96:0/3737967947 wait complete. 2026-02-13T03:35:47.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.627+0000 7f133f2136c0 1 Processor -- start 2026-02-13T03:35:47.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.627+0000 7f133f2136c0 1 -- start start 2026-02-13T03:35:47.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.627+0000 7f133f2136c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f133810cfb0 0x7f133811af20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:47.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.627+0000 7f133f2136c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f13381131c0 0x7f133811b460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:47.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.627+0000 7f133f2136c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1338120820 0x7f1338120cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:47.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.627+0000 7f133f2136c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1338121230 con 0x7f133810cfb0 2026-02-13T03:35:47.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.627+0000 7f133f2136c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f13381213a0 con 0x7f13381131c0 2026-02-13T03:35:47.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.627+0000 7f133f2136c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1338121560 con 0x7f1338120820 2026-02-13T03:35:47.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.627+0000 7f133cf846c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f133810cfb0 0x7f133811af20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:47.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.627+0000 7f133cf846c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f133810cfb0 0x7f133811af20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:37672/0 (socket says 10.20.193.96:37672) 2026-02-13T03:35:47.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.627+0000 7f133cf846c0 1 -- 10.20.193.96:0/1462062534 learned_addr learned my addr 10.20.193.96:0/1462062534 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:35:47.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.627+0000 7f133d7856c0 1 --2- 10.20.193.96:0/1462062534 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1338120820 0x7f1338120cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:47.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.627+0000 7f132ffff6c0 1 --2- 10.20.193.96:0/1462062534 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f13381131c0 0x7f133811b460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:47.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.627+0000 7f133cf846c0 1 -- 10.20.193.96:0/1462062534 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1338120820 msgr2=0x7f1338120cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:47.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.627+0000 7f133cf846c0 1 --2- 10.20.193.96:0/1462062534 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1338120820 0x7f1338120cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:47.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.627+0000 7f133cf846c0 1 -- 10.20.193.96:0/1462062534 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f13381131c0 msgr2=0x7f133811b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:47.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.627+0000 7f133cf846c0 1 --2- 10.20.193.96:0/1462062534 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f13381131c0 0x7f133811b460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:47.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.627+0000 7f133cf846c0 1 -- 10.20.193.96:0/1462062534 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f133400a660 con 0x7f133810cfb0 2026-02-13T03:35:47.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.627+0000 7f133cf846c0 1 --2- 10.20.193.96:0/1462062534 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f133810cfb0 0x7f133811af20 secure :-1 s=READY pgs=370 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f132800b710 tx=0x7f132800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:47.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.627+0000 7f132dffb6c0 1 -- 10.20.193.96:0/1462062534 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1328004250 con 0x7f133810cfb0 2026-02-13T03:35:47.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.628+0000 7f132dffb6c0 1 -- 10.20.193.96:0/1462062534 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f1328002da0 con 0x7f133810cfb0 2026-02-13T03:35:47.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.628+0000 7f133f2136c0 1 -- 10.20.193.96:0/1462062534 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1338161a10 con 0x7f133810cfb0 2026-02-13T03:35:47.635 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.628+0000 7f132dffb6c0 1 -- 10.20.193.96:0/1462062534 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f132800ce30 con 0x7f133810cfb0 2026-02-13T03:35:47.635 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.628+0000 7f133f2136c0 1 -- 10.20.193.96:0/1462062534 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1338161ef0 con 0x7f133810cfb0 2026-02-13T03:35:47.635 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.628+0000 7f133f2136c0 1 -- 10.20.193.96:0/1462062534 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f133810e280 con 0x7f133810cfb0 2026-02-13T03:35:47.636 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.629+0000 7f132dffb6c0 1 -- 10.20.193.96:0/1462062534 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f13280028c0 con 0x7f133810cfb0 2026-02-13T03:35:47.636 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.630+0000 7f132dffb6c0 1 --2- 10.20.193.96:0/1462062534 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f13140b5680 0x7f13140d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:47.636 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.630+0000 7f132ffff6c0 1 --2- 10.20.193.96:0/1462062534 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f13140b5680 0x7f13140d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:47.636 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.630+0000 7f132dffb6c0 1 -- 10.20.193.96:0/1462062534 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8031+0+0 (secure 0 0 0) 0x7f13280e3ba0 con 0x7f133810cfb0 2026-02-13T03:35:47.636 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.630+0000 7f132ffff6c0 1 --2- 10.20.193.96:0/1462062534 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f13140b5680 0x7f13140d5b30 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13381218b0 tx=0x7f13200094f0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:47.636 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.630+0000 7f132dffb6c0 1 -- 10.20.193.96:0/1462062534 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f13280a6660 con 0x7f133810cfb0 2026-02-13T03:35:47.751 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.747+0000 7f133f2136c0 1 -- 10.20.193.96:0/1462062534 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f133811c070 con 0x7f133810cfb0 2026-02-13T03:35:47.751 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.748+0000 7f132dffb6c0 1 -- 10.20.193.96:0/1462062534 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f13280a9810 con 0x7f133810cfb0 2026-02-13T03:35:47.751 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:35:47.751 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:35:47.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.749+0000 7f133f2136c0 1 -- 10.20.193.96:0/1462062534 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f13140b5680 msgr2=0x7f13140d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:47.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.749+0000 7f133f2136c0 1 --2- 10.20.193.96:0/1462062534 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f13140b5680 0x7f13140d5b30 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13381218b0 tx=0x7f13200094f0 comp rx=0 tx=0).stop 2026-02-13T03:35:47.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.749+0000 7f133f2136c0 1 -- 10.20.193.96:0/1462062534 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f133810cfb0 msgr2=0x7f133811af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:47.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.749+0000 7f133f2136c0 1 --2- 10.20.193.96:0/1462062534 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f133810cfb0 0x7f133811af20 secure :-1 s=READY pgs=370 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f132800b710 tx=0x7f132800bbe0 comp rx=0 tx=0).stop 2026-02-13T03:35:47.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.749+0000 7f133f2136c0 1 -- 10.20.193.96:0/1462062534 shutdown_connections 2026-02-13T03:35:47.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.749+0000 7f133f2136c0 1 --2- 10.20.193.96:0/1462062534 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f13140b5680 0x7f13140d5b30 unknown :-1 s=CLOSED pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:47.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.749+0000 7f133f2136c0 1 --2- 10.20.193.96:0/1462062534 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1338120820 0x7f1338120cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:47.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.749+0000 7f133f2136c0 1 --2- 10.20.193.96:0/1462062534 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f13381131c0 0x7f133811b460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:47.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.749+0000 7f133f2136c0 1 --2- 10.20.193.96:0/1462062534 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f133810cfb0 0x7f133811af20 unknown :-1 s=CLOSED pgs=370 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:47.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.749+0000 7f133f2136c0 1 -- 10.20.193.96:0/1462062534 >> 10.20.193.96:0/1462062534 conn(0x7f13380ea8b0 msgr2=0x7f133810ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:47.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.749+0000 7f133f2136c0 1 -- 10.20.193.96:0/1462062534 shutdown_connections 2026-02-13T03:35:47.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:47.749+0000 7f133f2136c0 1 -- 10.20.193.96:0/1462062534 wait complete. 2026-02-13T03:35:48.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:47 trial096 ceph-mon[24671]: pgmap v232: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:35:48.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:47 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1462062534' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:48.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:47 trial132 ceph-mon[26888]: pgmap v232: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:35:48.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:47 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1462062534' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:48.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:47 trial133 ceph-mon[26943]: pgmap v232: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:35:48.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:47 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1462062534' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:50.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:49 trial096 ceph-mon[24671]: pgmap v233: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:35:50.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:49 trial132 ceph-mon[26888]: pgmap v233: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:35:50.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:49 trial133 ceph-mon[26943]: pgmap v233: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:35:50.795 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:35:50.915 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:35:51.029 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.024+0000 7fba9a5106c0 1 -- 10.20.193.96:0/1695706163 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fba9410fbf0 msgr2=0x7fba94114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:51.029 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.024+0000 7fba9a5106c0 1 --2- 10.20.193.96:0/1695706163 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fba9410fbf0 0x7fba94114c30 secure :-1 s=READY pgs=371 gs=1 cs=0 l=1 c_cookie=10870572440476063955 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba840099a0 tx=0x7fba8402ed50 comp rx=0 tx=0).stop 2026-02-13T03:35:51.029 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.024+0000 7fba9a5106c0 1 -- 10.20.193.96:0/1695706163 shutdown_connections 2026-02-13T03:35:51.030 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.024+0000 7fba9a5106c0 1 --2- 10.20.193.96:0/1695706163 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fba94115410 0x7fba94175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:51.030 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.024+0000 7fba9a5106c0 1 --2- 10.20.193.96:0/1695706163 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fba9410fbf0 0x7fba94114c30 unknown :-1 s=CLOSED pgs=371 gs=1 cs=0 l=1 c_cookie=10870572440476063955 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:51.030 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.024+0000 7fba9a5106c0 1 --2- 10.20.193.96:0/1695706163 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fba9410f200 0x7fba9410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:51.030 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.024+0000 7fba9a5106c0 1 -- 10.20.193.96:0/1695706163 >> 10.20.193.96:0/1695706163 conn(0x7fba940ecb00 msgr2=0x7fba9410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:51.030 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.024+0000 7fba9a5106c0 1 -- 10.20.193.96:0/1695706163 shutdown_connections 2026-02-13T03:35:51.030 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.024+0000 7fba9a5106c0 1 -- 10.20.193.96:0/1695706163 wait complete. 2026-02-13T03:35:51.030 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.024+0000 7fba9a5106c0 1 Processor -- start 2026-02-13T03:35:51.030 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.024+0000 7fba9a5106c0 1 -- start start 2026-02-13T03:35:51.030 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.024+0000 7fba9a5106c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fba9410f200 0x7fba9411d1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:51.030 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.024+0000 7fba9a5106c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fba94115410 0x7fba9411d710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:51.030 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.024+0000 7fba9a5106c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fba94122ad0 0x7fba94122f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:51.031 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.024+0000 7fba9a5106c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fba941234b0 con 0x7fba9410f200 2026-02-13T03:35:51.031 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.024+0000 7fba9a5106c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fba94123620 con 0x7fba94115410 2026-02-13T03:35:51.031 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.024+0000 7fba9a5106c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fba941237e0 con 0x7fba94122ad0 2026-02-13T03:35:51.031 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.025+0000 7fba93fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fba9410f200 0x7fba9411d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:51.031 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.025+0000 7fba93fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fba9410f200 0x7fba9411d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:37694/0 (socket says 10.20.193.96:37694) 2026-02-13T03:35:51.031 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.025+0000 7fba93fff6c0 1 -- 10.20.193.96:0/2856282076 learned_addr learned my addr 10.20.193.96:0/2856282076 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:35:51.031 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.025+0000 7fba937fe6c0 1 --2- 10.20.193.96:0/2856282076 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fba94115410 0x7fba9411d710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:51.031 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.025+0000 7fba98a826c0 1 --2- 10.20.193.96:0/2856282076 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fba94122ad0 0x7fba94122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:51.031 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.025+0000 7fba93fff6c0 1 -- 10.20.193.96:0/2856282076 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fba94122ad0 msgr2=0x7fba94122f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:51.031 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.025+0000 7fba93fff6c0 1 --2- 10.20.193.96:0/2856282076 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fba94122ad0 0x7fba94122f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:51.031 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.025+0000 7fba93fff6c0 1 -- 10.20.193.96:0/2856282076 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fba94115410 msgr2=0x7fba9411d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:51.032 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.025+0000 7fba93fff6c0 1 --2- 10.20.193.96:0/2856282076 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fba94115410 0x7fba9411d710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:51.032 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.025+0000 7fba93fff6c0 1 -- 10.20.193.96:0/2856282076 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba84009590 con 0x7fba9410f200 2026-02-13T03:35:51.032 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.025+0000 7fba937fe6c0 1 --2- 10.20.193.96:0/2856282076 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fba94115410 0x7fba9411d710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:35:51.032 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.025+0000 7fba98a826c0 1 --2- 10.20.193.96:0/2856282076 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fba94122ad0 0x7fba94122f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:35:51.032 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.025+0000 7fba93fff6c0 1 --2- 10.20.193.96:0/2856282076 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fba9410f200 0x7fba9411d1d0 secure :-1 s=READY pgs=372 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba8000b6c0 tx=0x7fba8000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:51.032 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.025+0000 7fba917fa6c0 1 -- 10.20.193.96:0/2856282076 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba800044a0 con 0x7fba9410f200 2026-02-13T03:35:51.032 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.025+0000 7fba9a5106c0 1 -- 10.20.193.96:0/2856282076 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba94163c60 con 0x7fba9410f200 2026-02-13T03:35:51.032 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.025+0000 7fba917fa6c0 1 -- 10.20.193.96:0/2856282076 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fba80009030 con 0x7fba9410f200 2026-02-13T03:35:51.032 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.025+0000 7fba917fa6c0 1 -- 10.20.193.96:0/2856282076 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba8000cc50 con 0x7fba9410f200 2026-02-13T03:35:51.032 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.025+0000 7fba9a5106c0 1 -- 10.20.193.96:0/2856282076 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba94164140 con 0x7fba9410f200 2026-02-13T03:35:51.032 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.025+0000 7fba9a5106c0 1 -- 10.20.193.96:0/2856282076 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba941104d0 con 0x7fba9410f200 2026-02-13T03:35:51.033 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.027+0000 7fba917fa6c0 1 -- 10.20.193.96:0/2856282076 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fba80005080 con 0x7fba9410f200 2026-02-13T03:35:51.034 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.027+0000 7fba917fa6c0 1 --2- 10.20.193.96:0/2856282076 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fba680b5680 0x7fba680d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:51.034 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.027+0000 7fba937fe6c0 1 --2- 10.20.193.96:0/2856282076 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fba680b5680 0x7fba680d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:51.034 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.028+0000 7fba917fa6c0 1 -- 10.20.193.96:0/2856282076 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8031+0+0 (secure 0 0 0) 0x7fba800e3890 con 0x7fba9410f200 2026-02-13T03:35:51.034 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.028+0000 7fba917fa6c0 1 -- 10.20.193.96:0/2856282076 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fba800a94c0 con 0x7fba9410f200 2026-02-13T03:35:51.034 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.028+0000 7fba937fe6c0 1 --2- 10.20.193.96:0/2856282076 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fba680b5680 0x7fba680d5b30 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba840023e0 tx=0x7fba8402f750 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:51.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.144+0000 7fba9a5106c0 1 -- 10.20.193.96:0/2856282076 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fba9411e320 con 0x7fba9410f200 2026-02-13T03:35:51.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.144+0000 7fba917fa6c0 1 -- 10.20.193.96:0/2856282076 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fba800a96a0 con 0x7fba9410f200 2026-02-13T03:35:51.146 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:35:51.147 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:35:51.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.145+0000 7fba9a5106c0 1 -- 10.20.193.96:0/2856282076 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fba680b5680 msgr2=0x7fba680d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:51.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.145+0000 7fba9a5106c0 1 --2- 10.20.193.96:0/2856282076 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fba680b5680 0x7fba680d5b30 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba840023e0 tx=0x7fba8402f750 comp rx=0 tx=0).stop 2026-02-13T03:35:51.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.145+0000 7fba9a5106c0 1 -- 10.20.193.96:0/2856282076 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fba9410f200 msgr2=0x7fba9411d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:51.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.145+0000 7fba9a5106c0 1 --2- 10.20.193.96:0/2856282076 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fba9410f200 0x7fba9411d1d0 secure :-1 s=READY pgs=372 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba8000b6c0 tx=0x7fba8000bb90 comp rx=0 tx=0).stop 2026-02-13T03:35:51.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.145+0000 7fba9a5106c0 1 -- 10.20.193.96:0/2856282076 shutdown_connections 2026-02-13T03:35:51.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.145+0000 7fba9a5106c0 1 --2- 10.20.193.96:0/2856282076 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fba680b5680 0x7fba680d5b30 unknown :-1 s=CLOSED pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:51.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.145+0000 7fba9a5106c0 1 --2- 10.20.193.96:0/2856282076 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fba94122ad0 0x7fba94122f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:51.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.145+0000 7fba9a5106c0 1 --2- 10.20.193.96:0/2856282076 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fba94115410 0x7fba9411d710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:51.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.145+0000 7fba9a5106c0 1 --2- 10.20.193.96:0/2856282076 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fba9410f200 0x7fba9411d1d0 unknown :-1 s=CLOSED pgs=372 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:51.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.145+0000 7fba9a5106c0 1 -- 10.20.193.96:0/2856282076 >> 10.20.193.96:0/2856282076 conn(0x7fba940ecb00 msgr2=0x7fba9410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:51.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.145+0000 7fba9a5106c0 1 -- 10.20.193.96:0/2856282076 shutdown_connections 2026-02-13T03:35:51.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:51.145+0000 7fba9a5106c0 1 -- 10.20.193.96:0/2856282076 wait complete. 2026-02-13T03:35:52.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:51 trial096 ceph-mon[24671]: pgmap v234: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:35:52.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:51 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2856282076' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:52.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:51 trial132 ceph-mon[26888]: pgmap v234: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:35:52.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:51 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2856282076' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:52.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:51 trial133 ceph-mon[26943]: pgmap v234: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:35:52.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:51 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2856282076' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:53.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:52 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]} : dispatch 2026-02-13T03:35:53.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:52 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]} : dispatch 2026-02-13T03:35:53.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:52 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]} : dispatch 2026-02-13T03:35:54.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:53 trial096 ceph-mon[24671]: pgmap v235: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:35:54.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:53 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2026-02-13T03:35:54.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:53 trial096 ceph-mon[24671]: osdmap e71: 12 total, 12 up, 12 in 2026-02-13T03:35:54.188 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:35:54.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:53 trial132 ceph-mon[26888]: pgmap v235: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:35:54.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:53 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2026-02-13T03:35:54.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:53 trial132 ceph-mon[26888]: osdmap e71: 12 total, 12 up, 12 in 2026-02-13T03:35:54.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:53 trial133 ceph-mon[26943]: pgmap v235: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:35:54.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:53 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2026-02-13T03:35:54.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:53 trial133 ceph-mon[26943]: osdmap e71: 12 total, 12 up, 12 in 2026-02-13T03:35:54.305 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:35:54.424 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.420+0000 7f16048656c0 1 -- 10.20.193.96:0/3827541493 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f15fc10fc20 msgr2=0x7f15fc114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:54.424 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.420+0000 7f16048656c0 1 --2- 10.20.193.96:0/3827541493 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f15fc10fc20 0x7f15fc114c60 secure :-1 s=READY pgs=373 gs=1 cs=0 l=1 c_cookie=9823680948390091934 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15e80099a0 tx=0x7f15e802ed20 comp rx=0 tx=0).stop 2026-02-13T03:35:54.424 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.420+0000 7f16048656c0 1 -- 10.20.193.96:0/3827541493 shutdown_connections 2026-02-13T03:35:54.424 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.420+0000 7f16048656c0 1 --2- 10.20.193.96:0/3827541493 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f15fc115440 0x7f15fc175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:54.424 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.420+0000 7f16048656c0 1 --2- 10.20.193.96:0/3827541493 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f15fc10fc20 0x7f15fc114c60 unknown :-1 s=CLOSED pgs=373 gs=1 cs=0 l=1 c_cookie=9823680948390091934 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:54.424 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.420+0000 7f16048656c0 1 --2- 10.20.193.96:0/3827541493 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f15fc10f230 0x7f15fc10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:54.424 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.420+0000 7f16048656c0 1 -- 10.20.193.96:0/3827541493 >> 10.20.193.96:0/3827541493 conn(0x7f15fc0ecb30 msgr2=0x7f15fc10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:54.425 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.420+0000 7f16048656c0 1 -- 10.20.193.96:0/3827541493 shutdown_connections 2026-02-13T03:35:54.425 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.420+0000 7f16048656c0 1 -- 10.20.193.96:0/3827541493 wait complete. 2026-02-13T03:35:54.425 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.420+0000 7f16048656c0 1 Processor -- start 2026-02-13T03:35:54.425 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.420+0000 7f16048656c0 1 -- start start 2026-02-13T03:35:54.425 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.420+0000 7f16048656c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f15fc10f230 0x7f15fc11d190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:54.425 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.420+0000 7f16048656c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f15fc115440 0x7f15fc11d6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:54.425 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.420+0000 7f16048656c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f15fc122a90 0x7f15fc122f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:54.425 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.420+0000 7f16048656c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc1234a0 con 0x7f15fc115440 2026-02-13T03:35:54.425 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.420+0000 7f16048656c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc123610 con 0x7f15fc10f230 2026-02-13T03:35:54.425 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.420+0000 7f16048656c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc1237d0 con 0x7f15fc122a90 2026-02-13T03:35:54.425 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.420+0000 7f1601dd56c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f15fc115440 0x7f15fc11d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:54.426 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.420+0000 7f1601dd56c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f15fc115440 0x7f15fc11d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:51794/0 (socket says 10.20.193.96:51794) 2026-02-13T03:35:54.426 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.420+0000 7f1601dd56c0 1 -- 10.20.193.96:0/2074167812 learned_addr learned my addr 10.20.193.96:0/2074167812 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:35:54.426 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.421+0000 7f1601dd56c0 1 -- 10.20.193.96:0/2074167812 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f15fc122a90 msgr2=0x7f15fc122f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:54.426 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.421+0000 7f1601dd56c0 1 --2- 10.20.193.96:0/2074167812 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f15fc122a90 0x7f15fc122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:54.426 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.421+0000 7f16025d66c0 1 --2- 10.20.193.96:0/2074167812 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f15fc10f230 0x7f15fc11d190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:54.426 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.421+0000 7f1601dd56c0 1 -- 10.20.193.96:0/2074167812 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f15fc10f230 msgr2=0x7f15fc11d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:54.426 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.421+0000 7f1601dd56c0 1 --2- 10.20.193.96:0/2074167812 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f15fc10f230 0x7f15fc11d190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:54.426 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.421+0000 7f1601dd56c0 1 -- 10.20.193.96:0/2074167812 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e8009590 con 0x7f15fc115440 2026-02-13T03:35:54.426 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.421+0000 7f16025d66c0 1 --2- 10.20.193.96:0/2074167812 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f15fc10f230 0x7f15fc11d190 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:35:54.426 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.421+0000 7f1601dd56c0 1 --2- 10.20.193.96:0/2074167812 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f15fc115440 0x7f15fc11d6d0 secure :-1 s=READY pgs=374 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15e8005b40 tx=0x7f15e80047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:54.426 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.421+0000 7f15e77fe6c0 1 -- 10.20.193.96:0/2074167812 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f15e8002ae0 con 0x7f15fc115440 2026-02-13T03:35:54.426 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.421+0000 7f16048656c0 1 -- 10.20.193.96:0/2074167812 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15fc163c20 con 0x7f15fc115440 2026-02-13T03:35:54.427 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.421+0000 7f15e77fe6c0 1 -- 10.20.193.96:0/2074167812 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f15e8007740 con 0x7f15fc115440 2026-02-13T03:35:54.427 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.421+0000 7f15e77fe6c0 1 -- 10.20.193.96:0/2074167812 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f15e8031550 con 0x7f15fc115440 2026-02-13T03:35:54.427 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.421+0000 7f16048656c0 1 -- 10.20.193.96:0/2074167812 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15fc1640a0 con 0x7f15fc115440 2026-02-13T03:35:54.427 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.421+0000 7f16048656c0 1 -- 10.20.193.96:0/2074167812 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15fc110500 con 0x7f15fc115440 2026-02-13T03:35:54.428 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.422+0000 7f15e77fe6c0 1 -- 10.20.193.96:0/2074167812 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f15e8002c40 con 0x7f15fc115440 2026-02-13T03:35:54.428 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.423+0000 7f15e77fe6c0 1 --2- 10.20.193.96:0/2074167812 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f15d80b5600 0x7f15d80d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:54.428 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.423+0000 7f16025d66c0 1 --2- 10.20.193.96:0/2074167812 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f15d80b5600 0x7f15d80d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:54.428 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.423+0000 7f15e77fe6c0 1 -- 10.20.193.96:0/2074167812 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f15e8107ce0 con 0x7f15fc115440 2026-02-13T03:35:54.428 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.423+0000 7f15e77fe6c0 1 -- 10.20.193.96:0/2074167812 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f15e80cd710 con 0x7f15fc115440 2026-02-13T03:35:54.428 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.424+0000 7f16025d66c0 1 --2- 10.20.193.96:0/2074167812 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f15d80b5600 0x7f15d80d5ab0 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15f4004750 tx=0x7f15f4005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:54.542 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.540+0000 7f16048656c0 1 -- 10.20.193.96:0/2074167812 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f15fc10fc20 con 0x7f15fc115440 2026-02-13T03:35:54.543 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.540+0000 7f15e77fe6c0 1 -- 10.20.193.96:0/2074167812 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f15e80cd8f0 con 0x7f15fc115440 2026-02-13T03:35:54.543 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:35:54.543 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:35:54.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.542+0000 7f16048656c0 1 -- 10.20.193.96:0/2074167812 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f15d80b5600 msgr2=0x7f15d80d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:54.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.542+0000 7f16048656c0 1 --2- 10.20.193.96:0/2074167812 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f15d80b5600 0x7f15d80d5ab0 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15f4004750 tx=0x7f15f4005f10 comp rx=0 tx=0).stop 2026-02-13T03:35:54.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.542+0000 7f16048656c0 1 -- 10.20.193.96:0/2074167812 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f15fc115440 msgr2=0x7f15fc11d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:54.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.542+0000 7f16048656c0 1 --2- 10.20.193.96:0/2074167812 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f15fc115440 0x7f15fc11d6d0 secure :-1 s=READY pgs=374 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15e8005b40 tx=0x7f15e80047f0 comp rx=0 tx=0).stop 2026-02-13T03:35:54.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.542+0000 7f16048656c0 1 -- 10.20.193.96:0/2074167812 shutdown_connections 2026-02-13T03:35:54.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.542+0000 7f16048656c0 1 --2- 10.20.193.96:0/2074167812 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f15d80b5600 0x7f15d80d5ab0 unknown :-1 s=CLOSED pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:54.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.542+0000 7f16048656c0 1 --2- 10.20.193.96:0/2074167812 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f15fc122a90 0x7f15fc122f30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:54.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.542+0000 7f16048656c0 1 --2- 10.20.193.96:0/2074167812 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f15fc115440 0x7f15fc11d6d0 unknown :-1 s=CLOSED pgs=374 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:54.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.542+0000 7f16048656c0 1 --2- 10.20.193.96:0/2074167812 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f15fc10f230 0x7f15fc11d190 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:54.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.542+0000 7f16048656c0 1 -- 10.20.193.96:0/2074167812 >> 10.20.193.96:0/2074167812 conn(0x7f15fc0ecb30 msgr2=0x7f15fc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:54.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.542+0000 7f16048656c0 1 -- 10.20.193.96:0/2074167812 shutdown_connections 2026-02-13T03:35:54.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:54.542+0000 7f16048656c0 1 -- 10.20.193.96:0/2074167812 wait complete. 2026-02-13T03:35:55.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:54 trial096 ceph-mon[24671]: osdmap e72: 12 total, 12 up, 12 in 2026-02-13T03:35:55.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:54 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2074167812' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:55.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:54 trial132 ceph-mon[26888]: osdmap e72: 12 total, 12 up, 12 in 2026-02-13T03:35:55.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:54 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2074167812' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:55.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:54 trial133 ceph-mon[26943]: osdmap e72: 12 total, 12 up, 12 in 2026-02-13T03:35:55.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:54 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2074167812' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:56.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:55 trial096 ceph-mon[24671]: pgmap v238: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.9 KiB/s rd, 4 op/s 2026-02-13T03:35:56.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:55 trial132 ceph-mon[26888]: pgmap v238: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.9 KiB/s rd, 4 op/s 2026-02-13T03:35:56.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:55 trial133 ceph-mon[26943]: pgmap v238: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.9 KiB/s rd, 4 op/s 2026-02-13T03:35:57.585 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:35:57.705 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:35:57.826 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.822+0000 7fb610ab46c0 1 -- 10.20.193.96:0/2784467244 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb60c10f230 msgr2=0x7fb60c10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:57.826 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.822+0000 7fb610ab46c0 1 --2- 10.20.193.96:0/2784467244 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb60c10f230 0x7fb60c10f600 secure :-1 s=READY pgs=375 gs=1 cs=0 l=1 c_cookie=10176678053373958656 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6000099a0 tx=0x7fb60002ed20 comp rx=0 tx=0).stop 2026-02-13T03:35:57.826 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.822+0000 7fb610ab46c0 1 -- 10.20.193.96:0/2784467244 shutdown_connections 2026-02-13T03:35:57.826 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.822+0000 7fb610ab46c0 1 --2- 10.20.193.96:0/2784467244 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb60c115440 0x7fb60c175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:57.826 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.822+0000 7fb610ab46c0 1 --2- 10.20.193.96:0/2784467244 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb60c10fc20 0x7fb60c114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:57.826 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.822+0000 7fb610ab46c0 1 --2- 10.20.193.96:0/2784467244 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb60c10f230 0x7fb60c10f600 unknown :-1 s=CLOSED pgs=375 gs=1 cs=0 l=1 c_cookie=10176678053373958656 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:57.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.822+0000 7fb610ab46c0 1 -- 10.20.193.96:0/2784467244 >> 10.20.193.96:0/2784467244 conn(0x7fb60c0ecb30 msgr2=0x7fb60c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:57.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.822+0000 7fb610ab46c0 1 -- 10.20.193.96:0/2784467244 shutdown_connections 2026-02-13T03:35:57.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.822+0000 7fb610ab46c0 1 -- 10.20.193.96:0/2784467244 wait complete. 2026-02-13T03:35:57.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.822+0000 7fb610ab46c0 1 Processor -- start 2026-02-13T03:35:57.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.823+0000 7fb610ab46c0 1 -- start start 2026-02-13T03:35:57.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.823+0000 7fb610ab46c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb60c10f230 0x7fb60c11d220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:57.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.823+0000 7fb610ab46c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb60c115440 0x7fb60c11d760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:57.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.823+0000 7fb610ab46c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb60c122b20 0x7fb60c122fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:57.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.823+0000 7fb610ab46c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb60c123530 con 0x7fb60c10f230 2026-02-13T03:35:57.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.823+0000 7fb610ab46c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb60c1236a0 con 0x7fb60c115440 2026-02-13T03:35:57.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.823+0000 7fb610ab46c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb60c123860 con 0x7fb60c122b20 2026-02-13T03:35:57.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.823+0000 7fb60a5756c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb60c10f230 0x7fb60c11d220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:57.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.823+0000 7fb60a5756c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb60c10f230 0x7fb60c11d220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:51816/0 (socket says 10.20.193.96:51816) 2026-02-13T03:35:57.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.823+0000 7fb60a5756c0 1 -- 10.20.193.96:0/1572983791 learned_addr learned my addr 10.20.193.96:0/1572983791 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:35:57.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.823+0000 7fb60a5756c0 1 -- 10.20.193.96:0/1572983791 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb60c122b20 msgr2=0x7fb60c122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:57.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.823+0000 7fb60a5756c0 1 --2- 10.20.193.96:0/1572983791 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb60c122b20 0x7fb60c122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:57.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.823+0000 7fb60a5756c0 1 -- 10.20.193.96:0/1572983791 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb60c115440 msgr2=0x7fb60c11d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:57.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.823+0000 7fb60a5756c0 1 --2- 10.20.193.96:0/1572983791 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb60c115440 0x7fb60c11d760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:57.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.823+0000 7fb60a5756c0 1 -- 10.20.193.96:0/1572983791 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb600009590 con 0x7fb60c10f230 2026-02-13T03:35:57.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.823+0000 7fb60a5756c0 1 --2- 10.20.193.96:0/1572983791 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb60c10f230 0x7fb60c11d220 secure :-1 s=READY pgs=376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6000098c0 tx=0x7fb6000047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:57.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.823+0000 7fb5f37fe6c0 1 -- 10.20.193.96:0/1572983791 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb600002ae0 con 0x7fb60c10f230 2026-02-13T03:35:57.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.823+0000 7fb5f37fe6c0 1 -- 10.20.193.96:0/1572983791 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fb600002c40 con 0x7fb60c10f230 2026-02-13T03:35:57.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.823+0000 7fb610ab46c0 1 -- 10.20.193.96:0/1572983791 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb60c163cb0 con 0x7fb60c10f230 2026-02-13T03:35:57.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.823+0000 7fb5f37fe6c0 1 -- 10.20.193.96:0/1572983791 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6000372f0 con 0x7fb60c10f230 2026-02-13T03:35:57.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.823+0000 7fb610ab46c0 1 -- 10.20.193.96:0/1572983791 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb60c164130 con 0x7fb60c10f230 2026-02-13T03:35:57.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.823+0000 7fb610ab46c0 1 -- 10.20.193.96:0/1572983791 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb60c110500 con 0x7fb60c10f230 2026-02-13T03:35:57.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.825+0000 7fb5f37fe6c0 1 -- 10.20.193.96:0/1572983791 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fb600007960 con 0x7fb60c10f230 2026-02-13T03:35:57.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.826+0000 7fb5f37fe6c0 1 --2- 10.20.193.96:0/1572983791 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb5e40b5680 0x7fb5e40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:35:57.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.826+0000 7fb609d746c0 1 --2- 10.20.193.96:0/1572983791 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb5e40b5680 0x7fb5e40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:35:57.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.826+0000 7fb5f37fe6c0 1 -- 10.20.193.96:0/1572983791 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7fb600107d20 con 0x7fb60c10f230 2026-02-13T03:35:57.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.826+0000 7fb5f37fe6c0 1 -- 10.20.193.96:0/1572983791 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb6000cd750 con 0x7fb60c10f230 2026-02-13T03:35:57.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.826+0000 7fb609d746c0 1 --2- 10.20.193.96:0/1572983791 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb5e40b5680 0x7fb5e40d5b30 secure :-1 s=READY pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5f4005980 tx=0x7fb5f4005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:35:57.943 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.940+0000 7fb610ab46c0 1 -- 10.20.193.96:0/1572983791 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb60c10f600 con 0x7fb60c10f230 2026-02-13T03:35:57.943 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.941+0000 7fb5f37fe6c0 1 -- 10.20.193.96:0/1572983791 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb6000cd930 con 0x7fb60c10f230 2026-02-13T03:35:57.944 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:35:57.944 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:35:57.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.942+0000 7fb610ab46c0 1 -- 10.20.193.96:0/1572983791 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb5e40b5680 msgr2=0x7fb5e40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:57.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.942+0000 7fb610ab46c0 1 --2- 10.20.193.96:0/1572983791 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb5e40b5680 0x7fb5e40d5b30 secure :-1 s=READY pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5f4005980 tx=0x7fb5f4005910 comp rx=0 tx=0).stop 2026-02-13T03:35:57.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.942+0000 7fb610ab46c0 1 -- 10.20.193.96:0/1572983791 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb60c10f230 msgr2=0x7fb60c11d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:35:57.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.942+0000 7fb610ab46c0 1 --2- 10.20.193.96:0/1572983791 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb60c10f230 0x7fb60c11d220 secure :-1 s=READY pgs=376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6000098c0 tx=0x7fb6000047f0 comp rx=0 tx=0).stop 2026-02-13T03:35:57.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.942+0000 7fb610ab46c0 1 -- 10.20.193.96:0/1572983791 shutdown_connections 2026-02-13T03:35:57.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.942+0000 7fb610ab46c0 1 --2- 10.20.193.96:0/1572983791 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb5e40b5680 0x7fb5e40d5b30 unknown :-1 s=CLOSED pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:57.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.942+0000 7fb610ab46c0 1 --2- 10.20.193.96:0/1572983791 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb60c122b20 0x7fb60c122fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:57.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.942+0000 7fb610ab46c0 1 --2- 10.20.193.96:0/1572983791 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb60c115440 0x7fb60c11d760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:57.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.942+0000 7fb610ab46c0 1 --2- 10.20.193.96:0/1572983791 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb60c10f230 0x7fb60c11d220 unknown :-1 s=CLOSED pgs=376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:35:57.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.942+0000 7fb610ab46c0 1 -- 10.20.193.96:0/1572983791 >> 10.20.193.96:0/1572983791 conn(0x7fb60c0ecb30 msgr2=0x7fb60c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:35:57.946 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.942+0000 7fb610ab46c0 1 -- 10.20.193.96:0/1572983791 shutdown_connections 2026-02-13T03:35:57.946 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:35:57.942+0000 7fb610ab46c0 1 -- 10.20.193.96:0/1572983791 wait complete. 2026-02-13T03:35:58.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:57 trial096 ceph-mon[24671]: pgmap v239: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-13T03:35:58.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:57 trial132 ceph-mon[26888]: pgmap v239: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-13T03:35:58.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:57 trial133 ceph-mon[26943]: pgmap v239: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-13T03:35:59.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:58 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1572983791' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:59.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:58 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1572983791' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:35:59.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:58 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1572983791' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:00.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:35:59 trial096 ceph-mon[24671]: pgmap v240: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.9 KiB/s rd, 4 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T03:36:00.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:35:59 trial132 ceph-mon[26888]: pgmap v240: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.9 KiB/s rd, 4 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T03:36:00.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:35:59 trial133 ceph-mon[26943]: pgmap v240: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.9 KiB/s rd, 4 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T03:36:00.986 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:36:01.106 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:36:01.222 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.217+0000 7ff1159986c0 1 -- 10.20.193.96:0/871342819 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff11010fc20 msgr2=0x7ff110114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:01.222 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.217+0000 7ff1159986c0 1 --2- 10.20.193.96:0/871342819 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff11010fc20 0x7ff110114c60 secure :-1 s=READY pgs=377 gs=1 cs=0 l=1 c_cookie=13992938268475757625 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0f80099a0 tx=0x7ff0f802ed20 comp rx=0 tx=0).stop 2026-02-13T03:36:01.222 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.217+0000 7ff1159986c0 1 -- 10.20.193.96:0/871342819 shutdown_connections 2026-02-13T03:36:01.222 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.217+0000 7ff1159986c0 1 --2- 10.20.193.96:0/871342819 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff110115440 0x7ff110175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:01.222 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.217+0000 7ff1159986c0 1 --2- 10.20.193.96:0/871342819 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff11010fc20 0x7ff110114c60 unknown :-1 s=CLOSED pgs=377 gs=1 cs=0 l=1 c_cookie=13992938268475757625 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:01.223 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.217+0000 7ff1159986c0 1 --2- 10.20.193.96:0/871342819 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff11010f230 0x7ff11010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:01.223 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.217+0000 7ff1159986c0 1 -- 10.20.193.96:0/871342819 >> 10.20.193.96:0/871342819 conn(0x7ff1100ecb30 msgr2=0x7ff11010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:01.223 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.217+0000 7ff1159986c0 1 -- 10.20.193.96:0/871342819 shutdown_connections 2026-02-13T03:36:01.223 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.217+0000 7ff1159986c0 1 -- 10.20.193.96:0/871342819 wait complete. 2026-02-13T03:36:01.223 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff1159986c0 1 Processor -- start 2026-02-13T03:36:01.223 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff1159986c0 1 -- start start 2026-02-13T03:36:01.223 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff1159986c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff11010f230 0x7ff11011d210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:01.223 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff1159986c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff110115440 0x7ff11011d750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:01.223 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff1159986c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff110122b10 0x7ff110122fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:01.223 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff1159986c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff1101234f0 con 0x7ff110122b10 2026-02-13T03:36:01.223 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff1159986c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff110123660 con 0x7ff110115440 2026-02-13T03:36:01.224 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff1159986c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff110123820 con 0x7ff11010f230 2026-02-13T03:36:01.224 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff10f7fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff110122b10 0x7ff110122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:01.224 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff10f7fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff110122b10 0x7ff110122fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:51832/0 (socket says 10.20.193.96:51832) 2026-02-13T03:36:01.224 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff10f7fe6c0 1 -- 10.20.193.96:0/4159182546 learned_addr learned my addr 10.20.193.96:0/4159182546 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:36:01.224 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff10e7fc6c0 1 --2- 10.20.193.96:0/4159182546 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff110115440 0x7ff11011d750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:01.224 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff10effd6c0 1 --2- 10.20.193.96:0/4159182546 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff11010f230 0x7ff11011d210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:01.224 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff10f7fe6c0 1 -- 10.20.193.96:0/4159182546 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff11010f230 msgr2=0x7ff11011d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:01.224 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff10f7fe6c0 1 --2- 10.20.193.96:0/4159182546 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff11010f230 0x7ff11011d210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:01.224 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff10f7fe6c0 1 -- 10.20.193.96:0/4159182546 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff110115440 msgr2=0x7ff11011d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:01.224 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff10f7fe6c0 1 --2- 10.20.193.96:0/4159182546 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff110115440 0x7ff11011d750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:01.224 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff10f7fe6c0 1 -- 10.20.193.96:0/4159182546 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f8009590 con 0x7ff110122b10 2026-02-13T03:36:01.225 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff10effd6c0 1 --2- 10.20.193.96:0/4159182546 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff11010f230 0x7ff11011d210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:36:01.225 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff10f7fe6c0 1 --2- 10.20.193.96:0/4159182546 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff110122b10 0x7ff110122fb0 secure :-1 s=READY pgs=378 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff10000c730 tx=0x7ff10000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:01.225 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff1149966c0 1 -- 10.20.193.96:0/4159182546 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff100003c40 con 0x7ff110122b10 2026-02-13T03:36:01.225 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff1149966c0 1 -- 10.20.193.96:0/4159182546 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7ff10000a070 con 0x7ff110122b10 2026-02-13T03:36:01.225 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff1159986c0 1 -- 10.20.193.96:0/4159182546 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff110163ca0 con 0x7ff110122b10 2026-02-13T03:36:01.225 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff1149966c0 1 -- 10.20.193.96:0/4159182546 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff10000dcf0 con 0x7ff110122b10 2026-02-13T03:36:01.225 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.218+0000 7ff1159986c0 1 -- 10.20.193.96:0/4159182546 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff110164180 con 0x7ff110122b10 2026-02-13T03:36:01.225 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.219+0000 7ff1159986c0 1 -- 10.20.193.96:0/4159182546 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff110110500 con 0x7ff110122b10 2026-02-13T03:36:01.225 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.220+0000 7ff1149966c0 1 -- 10.20.193.96:0/4159182546 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7ff100005030 con 0x7ff110122b10 2026-02-13T03:36:01.226 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.220+0000 7ff1149966c0 1 --2- 10.20.193.96:0/4159182546 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff0e40b5600 0x7ff0e40d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:01.226 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.220+0000 7ff1149966c0 1 -- 10.20.193.96:0/4159182546 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7ff1000e4b10 con 0x7ff110122b10 2026-02-13T03:36:01.226 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.220+0000 7ff10effd6c0 1 --2- 10.20.193.96:0/4159182546 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff0e40b5600 0x7ff0e40d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:01.227 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.221+0000 7ff10effd6c0 1 --2- 10.20.193.96:0/4159182546 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff0e40b5600 0x7ff0e40d5ab0 secure :-1 s=READY pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff104004750 tx=0x7ff104005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:01.227 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.221+0000 7ff1149966c0 1 -- 10.20.193.96:0/4159182546 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff1000a7570 con 0x7ff110122b10 2026-02-13T03:36:01.338 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.335+0000 7ff1159986c0 1 -- 10.20.193.96:0/4159182546 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff11010f600 con 0x7ff110122b10 2026-02-13T03:36:01.338 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.336+0000 7ff1149966c0 1 -- 10.20.193.96:0/4159182546 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff1000aa720 con 0x7ff110122b10 2026-02-13T03:36:01.338 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:36:01.339 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:36:01.339 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.337+0000 7ff1159986c0 1 -- 10.20.193.96:0/4159182546 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff0e40b5600 msgr2=0x7ff0e40d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:01.340 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.337+0000 7ff1159986c0 1 --2- 10.20.193.96:0/4159182546 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff0e40b5600 0x7ff0e40d5ab0 secure :-1 s=READY pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff104004750 tx=0x7ff104005f10 comp rx=0 tx=0).stop 2026-02-13T03:36:01.340 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.337+0000 7ff1159986c0 1 -- 10.20.193.96:0/4159182546 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff110122b10 msgr2=0x7ff110122fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:01.340 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.337+0000 7ff1159986c0 1 --2- 10.20.193.96:0/4159182546 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff110122b10 0x7ff110122fb0 secure :-1 s=READY pgs=378 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff10000c730 tx=0x7ff10000cc00 comp rx=0 tx=0).stop 2026-02-13T03:36:01.340 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.337+0000 7ff1159986c0 1 -- 10.20.193.96:0/4159182546 shutdown_connections 2026-02-13T03:36:01.340 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.337+0000 7ff1159986c0 1 --2- 10.20.193.96:0/4159182546 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff0e40b5600 0x7ff0e40d5ab0 unknown :-1 s=CLOSED pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:01.340 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.337+0000 7ff1159986c0 1 --2- 10.20.193.96:0/4159182546 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff110122b10 0x7ff110122fb0 unknown :-1 s=CLOSED pgs=378 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:01.340 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.337+0000 7ff1159986c0 1 --2- 10.20.193.96:0/4159182546 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff110115440 0x7ff11011d750 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:01.340 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.337+0000 7ff1159986c0 1 --2- 10.20.193.96:0/4159182546 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff11010f230 0x7ff11011d210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:01.340 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.337+0000 7ff1159986c0 1 -- 10.20.193.96:0/4159182546 >> 10.20.193.96:0/4159182546 conn(0x7ff1100ecb30 msgr2=0x7ff11010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:01.340 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.337+0000 7ff1159986c0 1 -- 10.20.193.96:0/4159182546 shutdown_connections 2026-02-13T03:36:01.341 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:01.337+0000 7ff1159986c0 1 -- 10.20.193.96:0/4159182546 wait complete. 2026-02-13T03:36:02.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:01 trial096 ceph-mon[24671]: pgmap v241: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T03:36:02.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:01 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/4159182546' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:02.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:01 trial132 ceph-mon[26888]: pgmap v241: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T03:36:02.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:01 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/4159182546' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:02.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:01 trial133 ceph-mon[26943]: pgmap v241: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T03:36:02.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:01 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/4159182546' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:04.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:03 trial096 ceph-mon[24671]: pgmap v242: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T03:36:04.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:03 trial132 ceph-mon[26888]: pgmap v242: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T03:36:04.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:03 trial133 ceph-mon[26943]: pgmap v242: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T03:36:04.379 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:36:04.497 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:36:04.616 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.612+0000 7f24111396c0 1 -- 10.20.193.96:0/187000821 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f240c1556e0 msgr2=0x7f240c175ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:04.617 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.612+0000 7f24111396c0 1 --2- 10.20.193.96:0/187000821 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f240c1556e0 0x7f240c175ac0 secure :-1 s=READY pgs=379 gs=1 cs=0 l=1 c_cookie=17439609270397677079 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23fc00aa40 tx=0x7f23fc02fde0 comp rx=0 tx=0).stop 2026-02-13T03:36:04.617 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.612+0000 7f24111396c0 1 -- 10.20.193.96:0/187000821 shutdown_connections 2026-02-13T03:36:04.617 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.612+0000 7f24111396c0 1 --2- 10.20.193.96:0/187000821 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f240c1556e0 0x7f240c175ac0 unknown :-1 s=CLOSED pgs=379 gs=1 cs=0 l=1 c_cookie=17439609270397677079 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:04.617 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.612+0000 7f24111396c0 1 --2- 10.20.193.96:0/187000821 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f240c061030 0x7f240c1551a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:04.617 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.612+0000 7f24111396c0 1 --2- 10.20.193.96:0/187000821 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f240c060720 0x7f240c060af0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:04.617 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.612+0000 7f24111396c0 1 -- 10.20.193.96:0/187000821 >> 10.20.193.96:0/187000821 conn(0x7f240c0ea8b0 msgr2=0x7f240c10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:04.617 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f24111396c0 1 -- 10.20.193.96:0/187000821 shutdown_connections 2026-02-13T03:36:04.617 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f24111396c0 1 -- 10.20.193.96:0/187000821 wait complete. 2026-02-13T03:36:04.617 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f24111396c0 1 Processor -- start 2026-02-13T03:36:04.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f24111396c0 1 -- start start 2026-02-13T03:36:04.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f24111396c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f240c060720 0x7f240c161420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:04.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f24111396c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f240c061030 0x7f240c161960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:04.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f24111396c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f240c1556e0 0x7f240c166cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:04.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f24111396c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f240c167290 con 0x7f240c060720 2026-02-13T03:36:04.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f24111396c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f240c167400 con 0x7f240c061030 2026-02-13T03:36:04.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f24111396c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f240c1675c0 con 0x7f240c1556e0 2026-02-13T03:36:04.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f240ad766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f240c060720 0x7f240c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:04.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f240ad766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f240c060720 0x7f240c161420 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:46064/0 (socket says 10.20.193.96:46064) 2026-02-13T03:36:04.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f240ad766c0 1 -- 10.20.193.96:0/2154081635 learned_addr learned my addr 10.20.193.96:0/2154081635 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:36:04.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f240b5776c0 1 --2- 10.20.193.96:0/2154081635 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f240c1556e0 0x7f240c166cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:04.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f240a5756c0 1 --2- 10.20.193.96:0/2154081635 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f240c061030 0x7f240c161960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:04.619 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f240ad766c0 1 -- 10.20.193.96:0/2154081635 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f240c1556e0 msgr2=0x7f240c166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:04.619 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f240ad766c0 1 --2- 10.20.193.96:0/2154081635 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f240c1556e0 0x7f240c166cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:04.619 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f240ad766c0 1 -- 10.20.193.96:0/2154081635 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f240c061030 msgr2=0x7f240c161960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:04.619 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f240ad766c0 1 --2- 10.20.193.96:0/2154081635 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f240c061030 0x7f240c161960 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:04.619 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f240ad766c0 1 -- 10.20.193.96:0/2154081635 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23fc00a660 con 0x7f240c060720 2026-02-13T03:36:04.619 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f240b5776c0 1 --2- 10.20.193.96:0/2154081635 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f240c1556e0 0x7f240c166cd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:36:04.619 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f240ad766c0 1 --2- 10.20.193.96:0/2154081635 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f240c060720 0x7f240c161420 secure :-1 s=READY pgs=380 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2400009490 tx=0x7f240000bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:04.619 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f23ebfff6c0 1 -- 10.20.193.96:0/2154081635 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2400004a80 con 0x7f240c060720 2026-02-13T03:36:04.619 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f23ebfff6c0 1 -- 10.20.193.96:0/2154081635 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f2400009030 con 0x7f240c060720 2026-02-13T03:36:04.619 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f24111396c0 1 -- 10.20.193.96:0/2154081635 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f240c1678a0 con 0x7f240c060720 2026-02-13T03:36:04.619 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.613+0000 7f23ebfff6c0 1 -- 10.20.193.96:0/2154081635 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f240000cea0 con 0x7f240c060720 2026-02-13T03:36:04.619 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.614+0000 7f24111396c0 1 -- 10.20.193.96:0/2154081635 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f240c151310 con 0x7f240c060720 2026-02-13T03:36:04.620 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.614+0000 7f24111396c0 1 -- 10.20.193.96:0/2154081635 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f240c061c30 con 0x7f240c060720 2026-02-13T03:36:04.621 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.615+0000 7f23ebfff6c0 1 -- 10.20.193.96:0/2154081635 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f2400004060 con 0x7f240c060720 2026-02-13T03:36:04.621 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.616+0000 7f23ebfff6c0 1 --2- 10.20.193.96:0/2154081635 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f23e00b5600 0x7f23e00d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:04.621 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.616+0000 7f240a5756c0 1 --2- 10.20.193.96:0/2154081635 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f23e00b5600 0x7f23e00d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:04.621 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.616+0000 7f23ebfff6c0 1 -- 10.20.193.96:0/2154081635 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f24000e3af0 con 0x7f240c060720 2026-02-13T03:36:04.621 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.616+0000 7f240a5756c0 1 --2- 10.20.193.96:0/2154081635 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f23e00b5600 0x7f23e00d5ab0 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f240c167d60 tx=0x7f23f4005da0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:04.621 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.616+0000 7f23ebfff6c0 1 -- 10.20.193.96:0/2154081635 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f24000a6590 con 0x7f240c060720 2026-02-13T03:36:04.734 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.731+0000 7f24111396c0 1 -- 10.20.193.96:0/2154081635 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f240c060af0 con 0x7f240c060720 2026-02-13T03:36:04.734 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.731+0000 7f23ebfff6c0 1 -- 10.20.193.96:0/2154081635 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f24000a9740 con 0x7f240c060720 2026-02-13T03:36:04.734 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:36:04.734 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:36:04.735 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.732+0000 7f24111396c0 1 -- 10.20.193.96:0/2154081635 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f23e00b5600 msgr2=0x7f23e00d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:04.735 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.732+0000 7f24111396c0 1 --2- 10.20.193.96:0/2154081635 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f23e00b5600 0x7f23e00d5ab0 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f240c167d60 tx=0x7f23f4005da0 comp rx=0 tx=0).stop 2026-02-13T03:36:04.735 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.732+0000 7f24111396c0 1 -- 10.20.193.96:0/2154081635 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f240c060720 msgr2=0x7f240c161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:04.736 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.732+0000 7f24111396c0 1 --2- 10.20.193.96:0/2154081635 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f240c060720 0x7f240c161420 secure :-1 s=READY pgs=380 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2400009490 tx=0x7f240000bca0 comp rx=0 tx=0).stop 2026-02-13T03:36:04.736 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.732+0000 7f24111396c0 1 -- 10.20.193.96:0/2154081635 shutdown_connections 2026-02-13T03:36:04.736 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.732+0000 7f24111396c0 1 --2- 10.20.193.96:0/2154081635 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f23e00b5600 0x7f23e00d5ab0 unknown :-1 s=CLOSED pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:04.736 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.732+0000 7f24111396c0 1 --2- 10.20.193.96:0/2154081635 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f240c1556e0 0x7f240c166cd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:04.736 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.732+0000 7f24111396c0 1 --2- 10.20.193.96:0/2154081635 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f240c061030 0x7f240c161960 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:04.736 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.732+0000 7f24111396c0 1 --2- 10.20.193.96:0/2154081635 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f240c060720 0x7f240c161420 unknown :-1 s=CLOSED pgs=380 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:04.736 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.732+0000 7f24111396c0 1 -- 10.20.193.96:0/2154081635 >> 10.20.193.96:0/2154081635 conn(0x7f240c0ea8b0 msgr2=0x7f240c10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:04.736 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.733+0000 7f24111396c0 1 -- 10.20.193.96:0/2154081635 shutdown_connections 2026-02-13T03:36:04.736 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:04.733+0000 7f24111396c0 1 -- 10.20.193.96:0/2154081635 wait complete. 2026-02-13T03:36:05.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:04 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2154081635' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:05.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:04 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2154081635' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:05.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:04 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2154081635' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:06.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:05 trial096 ceph-mon[24671]: pgmap v243: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T03:36:06.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:05 trial132 ceph-mon[26888]: pgmap v243: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T03:36:06.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:05 trial133 ceph-mon[26943]: pgmap v243: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T03:36:07.777 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:36:07.897 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:36:08.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.011+0000 7f544b7146c0 1 -- 10.20.193.96:0/1110689669 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f544410f200 msgr2=0x7f544410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:08.014 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.011+0000 7f544b7146c0 1 --2- 10.20.193.96:0/1110689669 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f544410f200 0x7f544410f5d0 secure :-1 s=READY pgs=381 gs=1 cs=0 l=1 c_cookie=5694805963417780910 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54340099a0 tx=0x7f543402ed20 comp rx=0 tx=0).stop 2026-02-13T03:36:08.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.011+0000 7f544b7146c0 1 -- 10.20.193.96:0/1110689669 shutdown_connections 2026-02-13T03:36:08.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.011+0000 7f544b7146c0 1 --2- 10.20.193.96:0/1110689669 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5444115410 0x7f5444175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:08.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.011+0000 7f544b7146c0 1 --2- 10.20.193.96:0/1110689669 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f544410fbf0 0x7f5444114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:08.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.011+0000 7f544b7146c0 1 --2- 10.20.193.96:0/1110689669 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f544410f200 0x7f544410f5d0 unknown :-1 s=CLOSED pgs=381 gs=1 cs=0 l=1 c_cookie=5694805963417780910 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:08.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.011+0000 7f544b7146c0 1 -- 10.20.193.96:0/1110689669 >> 10.20.193.96:0/1110689669 conn(0x7f54440ecb00 msgr2=0x7f544410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:08.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.011+0000 7f544b7146c0 1 -- 10.20.193.96:0/1110689669 shutdown_connections 2026-02-13T03:36:08.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.011+0000 7f544b7146c0 1 -- 10.20.193.96:0/1110689669 wait complete. 2026-02-13T03:36:08.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f544b7146c0 1 Processor -- start 2026-02-13T03:36:08.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f544b7146c0 1 -- start start 2026-02-13T03:36:08.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f544b7146c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f544410f200 0x7f544411d190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:08.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f544b7146c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5444115410 0x7f544411d6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:08.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f544b7146c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5444122a90 0x7f5444122f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:08.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f544b7146c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f54441234a0 con 0x7f5444115410 2026-02-13T03:36:08.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f544b7146c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5444123610 con 0x7f544410f200 2026-02-13T03:36:08.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f544b7146c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f54441237d0 con 0x7f5444122a90 2026-02-13T03:36:08.015 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f5448c846c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5444115410 0x7f544411d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:08.016 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f5448c846c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5444115410 0x7f544411d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:46092/0 (socket says 10.20.193.96:46092) 2026-02-13T03:36:08.016 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f5448c846c0 1 -- 10.20.193.96:0/1866936346 learned_addr learned my addr 10.20.193.96:0/1866936346 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:36:08.016 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f5449c866c0 1 --2- 10.20.193.96:0/1866936346 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5444122a90 0x7f5444122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:08.016 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f54494856c0 1 --2- 10.20.193.96:0/1866936346 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f544410f200 0x7f544411d190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:08.016 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f5448c846c0 1 -- 10.20.193.96:0/1866936346 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5444122a90 msgr2=0x7f5444122f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:08.016 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f5448c846c0 1 --2- 10.20.193.96:0/1866936346 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5444122a90 0x7f5444122f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:08.016 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f5448c846c0 1 -- 10.20.193.96:0/1866936346 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f544410f200 msgr2=0x7f544411d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:08.016 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f5448c846c0 1 --2- 10.20.193.96:0/1866936346 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f544410f200 0x7f544411d190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:08.016 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f5448c846c0 1 -- 10.20.193.96:0/1866936346 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5434009590 con 0x7f5444115410 2026-02-13T03:36:08.016 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f5449c866c0 1 --2- 10.20.193.96:0/1866936346 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5444122a90 0x7f5444122f30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:36:08.016 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f54494856c0 1 --2- 10.20.193.96:0/1866936346 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f544410f200 0x7f544411d190 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:36:08.016 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f5448c846c0 1 --2- 10.20.193.96:0/1866936346 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5444115410 0x7f544411d6d0 secure :-1 s=READY pgs=382 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f543800b6c0 tx=0x7f543800bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:08.016 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f54327fc6c0 1 -- 10.20.193.96:0/1866936346 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5438004250 con 0x7f5444115410 2026-02-13T03:36:08.016 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f544b7146c0 1 -- 10.20.193.96:0/1866936346 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5444163c80 con 0x7f5444115410 2026-02-13T03:36:08.016 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f54327fc6c0 1 -- 10.20.193.96:0/1866936346 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f5438009070 con 0x7f5444115410 2026-02-13T03:36:08.016 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f54327fc6c0 1 -- 10.20.193.96:0/1866936346 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f543800ccd0 con 0x7f5444115410 2026-02-13T03:36:08.016 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.012+0000 7f544b7146c0 1 -- 10.20.193.96:0/1866936346 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5444164110 con 0x7f5444115410 2026-02-13T03:36:08.016 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.013+0000 7f544b7146c0 1 -- 10.20.193.96:0/1866936346 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54441104d0 con 0x7f5444115410 2026-02-13T03:36:08.017 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.014+0000 7f54327fc6c0 1 -- 10.20.193.96:0/1866936346 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f54380028c0 con 0x7f5444115410 2026-02-13T03:36:08.018 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.015+0000 7f54327fc6c0 1 --2- 10.20.193.96:0/1866936346 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f54200b5680 0x7f54200d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:08.018 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.015+0000 7f54494856c0 1 --2- 10.20.193.96:0/1866936346 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f54200b5680 0x7f54200d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:08.018 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.015+0000 7f54327fc6c0 1 -- 10.20.193.96:0/1866936346 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f54380e3ad0 con 0x7f5444115410 2026-02-13T03:36:08.018 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.015+0000 7f54494856c0 1 --2- 10.20.193.96:0/1866936346 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f54200b5680 0x7f54200d5b30 secure :-1 s=READY pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5434009970 tx=0x7f54340023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:08.018 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.015+0000 7f54327fc6c0 1 -- 10.20.193.96:0/1866936346 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f543811c5e0 con 0x7f5444115410 2026-02-13T03:36:08.133 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.130+0000 7f544b7146c0 1 -- 10.20.193.96:0/1866936346 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f544410f5d0 con 0x7f5444115410 2026-02-13T03:36:08.133 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:07 trial096 ceph-mon[24671]: pgmap v244: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T03:36:08.133 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.130+0000 7f54327fc6c0 1 -- 10.20.193.96:0/1866936346 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f54380a6530 con 0x7f5444115410 2026-02-13T03:36:08.133 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:36:08.133 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:36:08.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.131+0000 7f544b7146c0 1 -- 10.20.193.96:0/1866936346 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f54200b5680 msgr2=0x7f54200d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:08.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.131+0000 7f544b7146c0 1 --2- 10.20.193.96:0/1866936346 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f54200b5680 0x7f54200d5b30 secure :-1 s=READY pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5434009970 tx=0x7f54340023a0 comp rx=0 tx=0).stop 2026-02-13T03:36:08.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.131+0000 7f544b7146c0 1 -- 10.20.193.96:0/1866936346 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5444115410 msgr2=0x7f544411d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:08.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.131+0000 7f544b7146c0 1 --2- 10.20.193.96:0/1866936346 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5444115410 0x7f544411d6d0 secure :-1 s=READY pgs=382 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f543800b6c0 tx=0x7f543800bb90 comp rx=0 tx=0).stop 2026-02-13T03:36:08.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.131+0000 7f544b7146c0 1 -- 10.20.193.96:0/1866936346 shutdown_connections 2026-02-13T03:36:08.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.131+0000 7f544b7146c0 1 --2- 10.20.193.96:0/1866936346 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f54200b5680 0x7f54200d5b30 unknown :-1 s=CLOSED pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:08.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.131+0000 7f544b7146c0 1 --2- 10.20.193.96:0/1866936346 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5444122a90 0x7f5444122f30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:08.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.131+0000 7f544b7146c0 1 --2- 10.20.193.96:0/1866936346 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5444115410 0x7f544411d6d0 unknown :-1 s=CLOSED pgs=382 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:08.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.131+0000 7f544b7146c0 1 --2- 10.20.193.96:0/1866936346 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f544410f200 0x7f544411d190 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:08.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.131+0000 7f544b7146c0 1 -- 10.20.193.96:0/1866936346 >> 10.20.193.96:0/1866936346 conn(0x7f54440ecb00 msgr2=0x7f544410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:08.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.131+0000 7f544b7146c0 1 -- 10.20.193.96:0/1866936346 shutdown_connections 2026-02-13T03:36:08.134 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:08.131+0000 7f544b7146c0 1 -- 10.20.193.96:0/1866936346 wait complete. 2026-02-13T03:36:08.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:07 trial132 ceph-mon[26888]: pgmap v244: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T03:36:08.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:07 trial133 ceph-mon[26943]: pgmap v244: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T03:36:09.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:08 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1866936346' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:09.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:08 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1866936346' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:09.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:08 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1866936346' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:10.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:09 trial096 ceph-mon[24671]: pgmap v245: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T03:36:10.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:09 trial132 ceph-mon[26888]: pgmap v245: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T03:36:10.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:09 trial133 ceph-mon[26943]: pgmap v245: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T03:36:11.175 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:36:11.296 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:36:11.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.410+0000 7f983a9ec6c0 1 -- 10.20.193.96:0/3601138824 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9834115440 msgr2=0x7f9834175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:11.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.410+0000 7f983a9ec6c0 1 --2- 10.20.193.96:0/3601138824 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9834115440 0x7f9834175de0 secure :-1 s=READY pgs=383 gs=1 cs=0 l=1 c_cookie=17871194167348888035 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f982800aa70 tx=0x7f982802fde0 comp rx=0 tx=0).stop 2026-02-13T03:36:11.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.410+0000 7f983a9ec6c0 1 -- 10.20.193.96:0/3601138824 shutdown_connections 2026-02-13T03:36:11.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.410+0000 7f983a9ec6c0 1 --2- 10.20.193.96:0/3601138824 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9834115440 0x7f9834175de0 unknown :-1 s=CLOSED pgs=383 gs=1 cs=0 l=1 c_cookie=17871194167348888035 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:11.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.410+0000 7f983a9ec6c0 1 --2- 10.20.193.96:0/3601138824 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f983410fc20 0x7f9834114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:11.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.410+0000 7f983a9ec6c0 1 --2- 10.20.193.96:0/3601138824 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f983410f230 0x7f983410f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:11.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.410+0000 7f983a9ec6c0 1 -- 10.20.193.96:0/3601138824 >> 10.20.193.96:0/3601138824 conn(0x7f98340ecb30 msgr2=0x7f983410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:11.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.410+0000 7f983a9ec6c0 1 -- 10.20.193.96:0/3601138824 shutdown_connections 2026-02-13T03:36:11.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.410+0000 7f983a9ec6c0 1 -- 10.20.193.96:0/3601138824 wait complete. 2026-02-13T03:36:11.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.410+0000 7f983a9ec6c0 1 Processor -- start 2026-02-13T03:36:11.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.410+0000 7f983a9ec6c0 1 -- start start 2026-02-13T03:36:11.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.410+0000 7f983a9ec6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f983410f230 0x7f983411d230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:11.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.410+0000 7f983a9ec6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9834115440 0x7f983411d770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:11.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.410+0000 7f983a9ec6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9834122b30 0x7f9834122fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:11.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.410+0000 7f983a9ec6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9834123540 con 0x7f983410f230 2026-02-13T03:36:11.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.410+0000 7f983a9ec6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f98341236b0 con 0x7f9834115440 2026-02-13T03:36:11.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.410+0000 7f983a9ec6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9834123870 con 0x7f9834122b30 2026-02-13T03:36:11.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.410+0000 7f9833fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f983410f230 0x7f983411d230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:11.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.410+0000 7f9833fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f983410f230 0x7f983411d230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:46106/0 (socket says 10.20.193.96:46106) 2026-02-13T03:36:11.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.410+0000 7f9833fff6c0 1 -- 10.20.193.96:0/2910144784 learned_addr learned my addr 10.20.193.96:0/2910144784 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:36:11.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.411+0000 7f98337fe6c0 1 --2- 10.20.193.96:0/2910144784 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9834115440 0x7f983411d770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:11.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.411+0000 7f9838f626c0 1 --2- 10.20.193.96:0/2910144784 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9834122b30 0x7f9834122fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:11.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.411+0000 7f9833fff6c0 1 -- 10.20.193.96:0/2910144784 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9834122b30 msgr2=0x7f9834122fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:11.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.411+0000 7f9833fff6c0 1 --2- 10.20.193.96:0/2910144784 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9834122b30 0x7f9834122fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:11.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.411+0000 7f9833fff6c0 1 -- 10.20.193.96:0/2910144784 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9834115440 msgr2=0x7f983411d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:11.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.411+0000 7f9833fff6c0 1 --2- 10.20.193.96:0/2910144784 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9834115440 0x7f983411d770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:11.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.411+0000 7f9833fff6c0 1 -- 10.20.193.96:0/2910144784 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982800a660 con 0x7f983410f230 2026-02-13T03:36:11.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.411+0000 7f98337fe6c0 1 --2- 10.20.193.96:0/2910144784 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9834115440 0x7f983411d770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:36:11.414 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.411+0000 7f9838f626c0 1 --2- 10.20.193.96:0/2910144784 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9834122b30 0x7f9834122fd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:36:11.415 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.411+0000 7f9833fff6c0 1 --2- 10.20.193.96:0/2910144784 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f983410f230 0x7f983411d230 secure :-1 s=READY pgs=384 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f982000b710 tx=0x7f982000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:11.415 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.411+0000 7f98317fa6c0 1 -- 10.20.193.96:0/2910144784 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9820004250 con 0x7f983410f230 2026-02-13T03:36:11.415 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.411+0000 7f98317fa6c0 1 -- 10.20.193.96:0/2910144784 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f9820009070 con 0x7f983410f230 2026-02-13T03:36:11.415 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.411+0000 7f983a9ec6c0 1 -- 10.20.193.96:0/2910144784 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9834163d20 con 0x7f983410f230 2026-02-13T03:36:11.415 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.411+0000 7f98317fa6c0 1 -- 10.20.193.96:0/2910144784 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f982000cd50 con 0x7f983410f230 2026-02-13T03:36:11.415 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.411+0000 7f983a9ec6c0 1 -- 10.20.193.96:0/2910144784 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9834164200 con 0x7f983410f230 2026-02-13T03:36:11.415 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.411+0000 7f983a9ec6c0 1 -- 10.20.193.96:0/2910144784 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9834110500 con 0x7f983410f230 2026-02-13T03:36:11.416 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.413+0000 7f98317fa6c0 1 -- 10.20.193.96:0/2910144784 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f98200028c0 con 0x7f983410f230 2026-02-13T03:36:11.417 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.414+0000 7f98317fa6c0 1 --2- 10.20.193.96:0/2910144784 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f98080b5680 0x7f98080d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:11.417 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.414+0000 7f98337fe6c0 1 --2- 10.20.193.96:0/2910144784 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f98080b5680 0x7f98080d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:11.417 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.414+0000 7f98317fa6c0 1 -- 10.20.193.96:0/2910144784 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f98200e3b40 con 0x7f983410f230 2026-02-13T03:36:11.417 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.414+0000 7f98337fe6c0 1 --2- 10.20.193.96:0/2910144784 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f98080b5680 0x7f98080d5b30 secure :-1 s=READY pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9824005fd0 tx=0x7f9824005d50 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:11.417 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.414+0000 7f98317fa6c0 1 -- 10.20.193.96:0/2910144784 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f98200a65a0 con 0x7f983410f230 2026-02-13T03:36:11.531 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.528+0000 7f983a9ec6c0 1 -- 10.20.193.96:0/2910144784 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f983410f600 con 0x7f983410f230 2026-02-13T03:36:11.531 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.528+0000 7f98317fa6c0 1 -- 10.20.193.96:0/2910144784 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f98200a9750 con 0x7f983410f230 2026-02-13T03:36:11.531 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:36:11.531 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:36:11.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.529+0000 7f983a9ec6c0 1 -- 10.20.193.96:0/2910144784 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f98080b5680 msgr2=0x7f98080d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:11.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.529+0000 7f983a9ec6c0 1 --2- 10.20.193.96:0/2910144784 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f98080b5680 0x7f98080d5b30 secure :-1 s=READY pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9824005fd0 tx=0x7f9824005d50 comp rx=0 tx=0).stop 2026-02-13T03:36:11.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.529+0000 7f983a9ec6c0 1 -- 10.20.193.96:0/2910144784 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f983410f230 msgr2=0x7f983411d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:11.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.529+0000 7f983a9ec6c0 1 --2- 10.20.193.96:0/2910144784 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f983410f230 0x7f983411d230 secure :-1 s=READY pgs=384 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f982000b710 tx=0x7f982000bbe0 comp rx=0 tx=0).stop 2026-02-13T03:36:11.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.529+0000 7f983a9ec6c0 1 -- 10.20.193.96:0/2910144784 shutdown_connections 2026-02-13T03:36:11.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.529+0000 7f983a9ec6c0 1 --2- 10.20.193.96:0/2910144784 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f98080b5680 0x7f98080d5b30 unknown :-1 s=CLOSED pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:11.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.529+0000 7f983a9ec6c0 1 --2- 10.20.193.96:0/2910144784 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9834122b30 0x7f9834122fd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:11.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.529+0000 7f983a9ec6c0 1 --2- 10.20.193.96:0/2910144784 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9834115440 0x7f983411d770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:11.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.529+0000 7f983a9ec6c0 1 --2- 10.20.193.96:0/2910144784 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f983410f230 0x7f983411d230 unknown :-1 s=CLOSED pgs=384 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:11.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.529+0000 7f983a9ec6c0 1 -- 10.20.193.96:0/2910144784 >> 10.20.193.96:0/2910144784 conn(0x7f98340ecb30 msgr2=0x7f983410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:11.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.529+0000 7f983a9ec6c0 1 -- 10.20.193.96:0/2910144784 shutdown_connections 2026-02-13T03:36:11.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:11.529+0000 7f983a9ec6c0 1 -- 10.20.193.96:0/2910144784 wait complete. 2026-02-13T03:36:12.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:11 trial096 ceph-mon[24671]: pgmap v246: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:36:12.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:11 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2910144784' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:12.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:11 trial132 ceph-mon[26888]: pgmap v246: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:36:12.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:11 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2910144784' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:12.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:11 trial133 ceph-mon[26943]: pgmap v246: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:36:12.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:11 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2910144784' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:14.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:13 trial096 ceph-mon[24671]: pgmap v247: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:36:14.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:13 trial132 ceph-mon[26888]: pgmap v247: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:36:14.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:13 trial133 ceph-mon[26943]: pgmap v247: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:36:14.573 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:36:14.691 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:36:14.821 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.817+0000 7f7ae75b96c0 1 -- 10.20.193.96:0/2191325697 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7ae010f230 msgr2=0x7f7ae010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:14.821 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.817+0000 7f7ae75b96c0 1 --2- 10.20.193.96:0/2191325697 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7ae010f230 0x7f7ae010f600 secure :-1 s=READY pgs=385 gs=1 cs=0 l=1 c_cookie=5864197715350139704 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ad00099a0 tx=0x7f7ad002ed20 comp rx=0 tx=0).stop 2026-02-13T03:36:14.821 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.817+0000 7f7ae75b96c0 1 -- 10.20.193.96:0/2191325697 shutdown_connections 2026-02-13T03:36:14.821 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.817+0000 7f7ae75b96c0 1 --2- 10.20.193.96:0/2191325697 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7ae0115440 0x7f7ae0175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:14.821 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.817+0000 7f7ae75b96c0 1 --2- 10.20.193.96:0/2191325697 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7ae010fc20 0x7f7ae0114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:14.821 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.817+0000 7f7ae75b96c0 1 --2- 10.20.193.96:0/2191325697 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7ae010f230 0x7f7ae010f600 unknown :-1 s=CLOSED pgs=385 gs=1 cs=0 l=1 c_cookie=5864197715350139704 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:14.821 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.817+0000 7f7ae75b96c0 1 -- 10.20.193.96:0/2191325697 >> 10.20.193.96:0/2191325697 conn(0x7f7ae00ecb30 msgr2=0x7f7ae010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:14.821 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.817+0000 7f7ae75b96c0 1 -- 10.20.193.96:0/2191325697 shutdown_connections 2026-02-13T03:36:14.821 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.817+0000 7f7ae75b96c0 1 -- 10.20.193.96:0/2191325697 wait complete. 2026-02-13T03:36:14.823 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ae75b96c0 1 Processor -- start 2026-02-13T03:36:14.823 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ae75b96c0 1 -- start start 2026-02-13T03:36:14.823 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ae75b96c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7ae010f230 0x7f7ae011d280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:14.823 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ae75b96c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7ae0115440 0x7f7ae011d7c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:14.823 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ae75b96c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7ae0122b80 0x7f7ae0123020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:14.823 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ae75b96c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae0123590 con 0x7f7ae0115440 2026-02-13T03:36:14.823 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ae75b96c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae0123700 con 0x7f7ae010f230 2026-02-13T03:36:14.823 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ae75b96c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae01238c0 con 0x7f7ae0122b80 2026-02-13T03:36:14.823 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ae4b296c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7ae0115440 0x7f7ae011d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:14.824 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ae4b296c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7ae0115440 0x7f7ae011d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:58252/0 (socket says 10.20.193.96:58252) 2026-02-13T03:36:14.824 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ae4b296c0 1 -- 10.20.193.96:0/2156679634 learned_addr learned my addr 10.20.193.96:0/2156679634 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:36:14.824 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ae532a6c0 1 --2- 10.20.193.96:0/2156679634 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7ae010f230 0x7f7ae011d280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:14.824 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ae4b296c0 1 -- 10.20.193.96:0/2156679634 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7ae0122b80 msgr2=0x7f7ae0123020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:14.824 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ae5b2b6c0 1 --2- 10.20.193.96:0/2156679634 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7ae0122b80 0x7f7ae0123020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:14.824 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ae4b296c0 1 --2- 10.20.193.96:0/2156679634 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7ae0122b80 0x7f7ae0123020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:14.824 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ae4b296c0 1 -- 10.20.193.96:0/2156679634 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7ae010f230 msgr2=0x7f7ae011d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:14.824 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ae4b296c0 1 --2- 10.20.193.96:0/2156679634 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7ae010f230 0x7f7ae011d280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:14.824 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ae4b296c0 1 -- 10.20.193.96:0/2156679634 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad0009590 con 0x7f7ae0115440 2026-02-13T03:36:14.824 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ae5b2b6c0 1 --2- 10.20.193.96:0/2156679634 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7ae0122b80 0x7f7ae0123020 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:36:14.824 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ae4b296c0 1 --2- 10.20.193.96:0/2156679634 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7ae0115440 0x7f7ae011d7c0 secure :-1 s=READY pgs=386 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ad4005fd0 tx=0x7f7ad400bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:14.824 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ace7fc6c0 1 -- 10.20.193.96:0/2156679634 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ad4004280 con 0x7f7ae0115440 2026-02-13T03:36:14.824 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ae75b96c0 1 -- 10.20.193.96:0/2156679634 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae0163d70 con 0x7f7ae0115440 2026-02-13T03:36:14.824 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ace7fc6c0 1 -- 10.20.193.96:0/2156679634 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f7ad40043e0 con 0x7f7ae0115440 2026-02-13T03:36:14.824 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ace7fc6c0 1 -- 10.20.193.96:0/2156679634 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ad400cde0 con 0x7f7ae0115440 2026-02-13T03:36:14.824 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.818+0000 7f7ae75b96c0 1 -- 10.20.193.96:0/2156679634 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae0164200 con 0x7f7ae0115440 2026-02-13T03:36:14.824 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.819+0000 7f7ae75b96c0 1 -- 10.20.193.96:0/2156679634 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ae0110500 con 0x7f7ae0115440 2026-02-13T03:36:14.824 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.820+0000 7f7ace7fc6c0 1 -- 10.20.193.96:0/2156679634 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f7ad4005080 con 0x7f7ae0115440 2026-02-13T03:36:14.825 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.821+0000 7f7ace7fc6c0 1 --2- 10.20.193.96:0/2156679634 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7abc0b5600 0x7f7abc0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:14.825 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.821+0000 7f7ace7fc6c0 1 -- 10.20.193.96:0/2156679634 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f7ad40e3a50 con 0x7f7ae0115440 2026-02-13T03:36:14.825 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.821+0000 7f7ae532a6c0 1 --2- 10.20.193.96:0/2156679634 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7abc0b5600 0x7f7abc0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:14.825 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.821+0000 7f7ae532a6c0 1 --2- 10.20.193.96:0/2156679634 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7abc0b5600 0x7f7abc0d5ab0 secure :-1 s=READY pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ad00023e0 tx=0x7f7ad0009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:14.825 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.821+0000 7f7ace7fc6c0 1 -- 10.20.193.96:0/2156679634 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7ad40a64b0 con 0x7f7ae0115440 2026-02-13T03:36:14.947 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.943+0000 7f7ae75b96c0 1 -- 10.20.193.96:0/2156679634 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7ae010f600 con 0x7f7ae0115440 2026-02-13T03:36:14.947 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.944+0000 7f7ace7fc6c0 1 -- 10.20.193.96:0/2156679634 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f7ad40a9660 con 0x7f7ae0115440 2026-02-13T03:36:14.948 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:36:14.948 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:36:14.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.945+0000 7f7ae75b96c0 1 -- 10.20.193.96:0/2156679634 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7abc0b5600 msgr2=0x7f7abc0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:14.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.945+0000 7f7ae75b96c0 1 --2- 10.20.193.96:0/2156679634 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7abc0b5600 0x7f7abc0d5ab0 secure :-1 s=READY pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ad00023e0 tx=0x7f7ad0009260 comp rx=0 tx=0).stop 2026-02-13T03:36:14.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.945+0000 7f7ae75b96c0 1 -- 10.20.193.96:0/2156679634 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7ae0115440 msgr2=0x7f7ae011d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:14.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.945+0000 7f7ae75b96c0 1 --2- 10.20.193.96:0/2156679634 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7ae0115440 0x7f7ae011d7c0 secure :-1 s=READY pgs=386 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ad4005fd0 tx=0x7f7ad400bca0 comp rx=0 tx=0).stop 2026-02-13T03:36:14.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.945+0000 7f7ae75b96c0 1 -- 10.20.193.96:0/2156679634 shutdown_connections 2026-02-13T03:36:14.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.945+0000 7f7ae75b96c0 1 --2- 10.20.193.96:0/2156679634 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7abc0b5600 0x7f7abc0d5ab0 unknown :-1 s=CLOSED pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:14.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.945+0000 7f7ae75b96c0 1 --2- 10.20.193.96:0/2156679634 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7ae0122b80 0x7f7ae0123020 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:14.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.945+0000 7f7ae75b96c0 1 --2- 10.20.193.96:0/2156679634 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7ae0115440 0x7f7ae011d7c0 unknown :-1 s=CLOSED pgs=386 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:14.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.945+0000 7f7ae75b96c0 1 --2- 10.20.193.96:0/2156679634 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7ae010f230 0x7f7ae011d280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:14.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.945+0000 7f7ae75b96c0 1 -- 10.20.193.96:0/2156679634 >> 10.20.193.96:0/2156679634 conn(0x7f7ae00ecb30 msgr2=0x7f7ae010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:14.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.946+0000 7f7ae75b96c0 1 -- 10.20.193.96:0/2156679634 shutdown_connections 2026-02-13T03:36:14.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:14.946+0000 7f7ae75b96c0 1 -- 10.20.193.96:0/2156679634 wait complete. 2026-02-13T03:36:15.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:14 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:36:15.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:14 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:36:15.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:14 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:36:16.163 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:15 trial133 ceph-mon[26943]: pgmap v248: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:36:16.163 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:15 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2156679634' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:16.163 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:15 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:36:16.163 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:15 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:36:16.163 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:15 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:36:16.163 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:15 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:36:16.163 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:15 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:36:16.163 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:15 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:36:16.163 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:15 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:36:16.163 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:15 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:36:16.163 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:15 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:36:16.163 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:15 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:36:16.163 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:15 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:36:16.163 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:15 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:36:16.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:15 trial096 ceph-mon[24671]: pgmap v248: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:36:16.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:15 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2156679634' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:16.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:15 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:36:16.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:15 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:36:16.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:15 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:36:16.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:15 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:36:16.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:15 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:36:16.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:15 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:36:16.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:15 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:36:16.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:15 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:36:16.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:15 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:36:16.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:15 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:36:16.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:15 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:36:16.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:15 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:36:16.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:15 trial132 ceph-mon[26888]: pgmap v248: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:36:16.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:15 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2156679634' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:16.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:15 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:36:16.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:15 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:36:16.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:15 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:36:16.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:15 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:36:16.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:15 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:36:16.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:15 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:36:16.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:15 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:36:16.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:15 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:36:16.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:15 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:36:16.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:15 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:36:16.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:15 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:36:16.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:15 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:36:17.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:16 trial096 ceph-mon[24671]: pgmap v249: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 7 op/s 2026-02-13T03:36:17.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:16 trial132 ceph-mon[26888]: pgmap v249: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 7 op/s 2026-02-13T03:36:17.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:16 trial133 ceph-mon[26943]: pgmap v249: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 7 op/s 2026-02-13T03:36:17.991 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:36:18.109 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:36:18.161 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:17 trial096 ceph-mon[24671]: pgmap v250: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:36:18.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:17 trial132 ceph-mon[26888]: pgmap v250: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:36:18.235 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.232+0000 7f07539a36c0 1 -- 10.20.193.96:0/1251619553 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f074c10fbf0 msgr2=0x7f074c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:18.235 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.232+0000 7f07539a36c0 1 --2- 10.20.193.96:0/1251619553 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f074c10fbf0 0x7f074c114c30 secure :-1 s=READY pgs=387 gs=1 cs=0 l=1 c_cookie=12216634376778222522 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07400099a0 tx=0x7f074002ed50 comp rx=0 tx=0).stop 2026-02-13T03:36:18.235 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.232+0000 7f07539a36c0 1 -- 10.20.193.96:0/1251619553 shutdown_connections 2026-02-13T03:36:18.235 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.232+0000 7f07539a36c0 1 --2- 10.20.193.96:0/1251619553 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f074c115410 0x7f074c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:18.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.232+0000 7f07539a36c0 1 --2- 10.20.193.96:0/1251619553 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f074c10fbf0 0x7f074c114c30 unknown :-1 s=CLOSED pgs=387 gs=1 cs=0 l=1 c_cookie=12216634376778222522 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:18.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.232+0000 7f07539a36c0 1 --2- 10.20.193.96:0/1251619553 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f074c10f200 0x7f074c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:18.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.232+0000 7f07539a36c0 1 -- 10.20.193.96:0/1251619553 >> 10.20.193.96:0/1251619553 conn(0x7f074c0ecb00 msgr2=0x7f074c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:18.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.232+0000 7f07539a36c0 1 -- 10.20.193.96:0/1251619553 shutdown_connections 2026-02-13T03:36:18.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.232+0000 7f07539a36c0 1 -- 10.20.193.96:0/1251619553 wait complete. 2026-02-13T03:36:18.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.232+0000 7f07539a36c0 1 Processor -- start 2026-02-13T03:36:18.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.232+0000 7f07539a36c0 1 -- start start 2026-02-13T03:36:18.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.232+0000 7f07539a36c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f074c10f200 0x7f074c0f4be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:18.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.232+0000 7f07539a36c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f074c115410 0x7f074c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:18.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.232+0000 7f07539a36c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f074c0f5210 0x7f074c0fa490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:18.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.232+0000 7f07539a36c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f074c0f5900 con 0x7f074c10f200 2026-02-13T03:36:18.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.232+0000 7f07539a36c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f074c0fa9d0 con 0x7f074c115410 2026-02-13T03:36:18.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.232+0000 7f07539a36c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f074c0fab90 con 0x7f074c0f5210 2026-02-13T03:36:18.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.232+0000 7f07517146c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f074c10f200 0x7f074c0f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:18.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.232+0000 7f07517146c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f074c10f200 0x7f074c0f4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:58262/0 (socket says 10.20.193.96:58262) 2026-02-13T03:36:18.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.232+0000 7f07517146c0 1 -- 10.20.193.96:0/2028432320 learned_addr learned my addr 10.20.193.96:0/2028432320 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:36:18.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.232+0000 7f0750f136c0 1 --2- 10.20.193.96:0/2028432320 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f074c115410 0x7f074c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:18.236 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.232+0000 7f0751f156c0 1 --2- 10.20.193.96:0/2028432320 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f074c0f5210 0x7f074c0fa490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:18.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.233+0000 7f07517146c0 1 -- 10.20.193.96:0/2028432320 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f074c0f5210 msgr2=0x7f074c0fa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:18.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.233+0000 7f07517146c0 1 --2- 10.20.193.96:0/2028432320 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f074c0f5210 0x7f074c0fa490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:18.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.233+0000 7f07517146c0 1 -- 10.20.193.96:0/2028432320 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f074c115410 msgr2=0x7f074c175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:18.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.233+0000 7f07517146c0 1 --2- 10.20.193.96:0/2028432320 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f074c115410 0x7f074c175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:18.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.233+0000 7f07517146c0 1 -- 10.20.193.96:0/2028432320 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0740009590 con 0x7f074c10f200 2026-02-13T03:36:18.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.233+0000 7f07517146c0 1 --2- 10.20.193.96:0/2028432320 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f074c10f200 0x7f074c0f4be0 secure :-1 s=READY pgs=388 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f073c00b710 tx=0x7f073c00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:18.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.233+0000 7f073a7fc6c0 1 -- 10.20.193.96:0/2028432320 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f073c004250 con 0x7f074c10f200 2026-02-13T03:36:18.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.233+0000 7f073a7fc6c0 1 -- 10.20.193.96:0/2028432320 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f073c002da0 con 0x7f074c10f200 2026-02-13T03:36:18.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.233+0000 7f07539a36c0 1 -- 10.20.193.96:0/2028432320 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f074c0fae70 con 0x7f074c10f200 2026-02-13T03:36:18.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.233+0000 7f073a7fc6c0 1 -- 10.20.193.96:0/2028432320 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f073c00ce50 con 0x7f074c10f200 2026-02-13T03:36:18.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.233+0000 7f07539a36c0 1 -- 10.20.193.96:0/2028432320 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f074c0fb600 con 0x7f074c10f200 2026-02-13T03:36:18.237 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.233+0000 7f07539a36c0 1 -- 10.20.193.96:0/2028432320 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f074c1104d0 con 0x7f074c10f200 2026-02-13T03:36:18.238 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.235+0000 7f073a7fc6c0 1 -- 10.20.193.96:0/2028432320 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f073c0043b0 con 0x7f074c10f200 2026-02-13T03:36:18.238 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.235+0000 7f073a7fc6c0 1 --2- 10.20.193.96:0/2028432320 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f07280b55f0 0x7f07280d5aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:18.238 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.235+0000 7f0750f136c0 1 --2- 10.20.193.96:0/2028432320 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f07280b55f0 0x7f07280d5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:18.239 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.235+0000 7f073a7fc6c0 1 -- 10.20.193.96:0/2028432320 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f073c0e3b30 con 0x7f074c10f200 2026-02-13T03:36:18.239 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.236+0000 7f0750f136c0 1 --2- 10.20.193.96:0/2028432320 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f07280b55f0 0x7f07280d5aa0 secure :-1 s=READY pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07400023e0 tx=0x7f0740005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:18.239 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.236+0000 7f073a7fc6c0 1 -- 10.20.193.96:0/2028432320 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f073c0a65d0 con 0x7f074c10f200 2026-02-13T03:36:18.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:17 trial133 ceph-mon[26943]: pgmap v250: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:36:18.355 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.352+0000 7f07539a36c0 1 -- 10.20.193.96:0/2028432320 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f074c0f5ce0 con 0x7f074c10f200 2026-02-13T03:36:18.356 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.352+0000 7f073a7fc6c0 1 -- 10.20.193.96:0/2028432320 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f073c0a9780 con 0x7f074c10f200 2026-02-13T03:36:18.356 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:36:18.356 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:36:18.357 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.354+0000 7f07539a36c0 1 -- 10.20.193.96:0/2028432320 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f07280b55f0 msgr2=0x7f07280d5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:18.357 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.354+0000 7f07539a36c0 1 --2- 10.20.193.96:0/2028432320 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f07280b55f0 0x7f07280d5aa0 secure :-1 s=READY pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07400023e0 tx=0x7f0740005c00 comp rx=0 tx=0).stop 2026-02-13T03:36:18.357 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.354+0000 7f07539a36c0 1 -- 10.20.193.96:0/2028432320 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f074c10f200 msgr2=0x7f074c0f4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:18.357 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.354+0000 7f07539a36c0 1 --2- 10.20.193.96:0/2028432320 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f074c10f200 0x7f074c0f4be0 secure :-1 s=READY pgs=388 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f073c00b710 tx=0x7f073c00bbe0 comp rx=0 tx=0).stop 2026-02-13T03:36:18.358 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.354+0000 7f07539a36c0 1 -- 10.20.193.96:0/2028432320 shutdown_connections 2026-02-13T03:36:18.358 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.354+0000 7f07539a36c0 1 --2- 10.20.193.96:0/2028432320 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f07280b55f0 0x7f07280d5aa0 unknown :-1 s=CLOSED pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:18.358 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.354+0000 7f07539a36c0 1 --2- 10.20.193.96:0/2028432320 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f074c0f5210 0x7f074c0fa490 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:18.358 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.354+0000 7f07539a36c0 1 --2- 10.20.193.96:0/2028432320 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f074c115410 0x7f074c175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:18.358 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.354+0000 7f07539a36c0 1 --2- 10.20.193.96:0/2028432320 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f074c10f200 0x7f074c0f4be0 unknown :-1 s=CLOSED pgs=388 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:18.358 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.354+0000 7f07539a36c0 1 -- 10.20.193.96:0/2028432320 >> 10.20.193.96:0/2028432320 conn(0x7f074c0ecb00 msgr2=0x7f074c10d860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:18.358 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.354+0000 7f07539a36c0 1 -- 10.20.193.96:0/2028432320 shutdown_connections 2026-02-13T03:36:18.358 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:18.354+0000 7f07539a36c0 1 -- 10.20.193.96:0/2028432320 wait complete. 2026-02-13T03:36:19.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:18 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2028432320' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:19.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:18 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2028432320' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:19.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:18 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2028432320' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:20.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:19 trial096 ceph-mon[24671]: pgmap v251: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:36:20.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:19 trial132 ceph-mon[26888]: pgmap v251: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:36:20.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:19 trial133 ceph-mon[26943]: pgmap v251: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:36:21.399 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:36:21.520 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:36:21.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.630+0000 7fb831c7c6c0 1 -- 10.20.193.96:0/2976170687 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb82c115440 msgr2=0x7fb82c175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:21.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.630+0000 7fb831c7c6c0 1 --2- 10.20.193.96:0/2976170687 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb82c115440 0x7fb82c175de0 secure :-1 s=READY pgs=389 gs=1 cs=0 l=1 c_cookie=16359899942677015316 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb82000aa70 tx=0x7fb82002fde0 comp rx=0 tx=0).stop 2026-02-13T03:36:21.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.630+0000 7fb831c7c6c0 1 -- 10.20.193.96:0/2976170687 shutdown_connections 2026-02-13T03:36:21.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.630+0000 7fb831c7c6c0 1 --2- 10.20.193.96:0/2976170687 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb82c115440 0x7fb82c175de0 unknown :-1 s=CLOSED pgs=389 gs=1 cs=0 l=1 c_cookie=16359899942677015316 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:21.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.630+0000 7fb831c7c6c0 1 --2- 10.20.193.96:0/2976170687 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb82c10fc20 0x7fb82c114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:21.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.630+0000 7fb831c7c6c0 1 --2- 10.20.193.96:0/2976170687 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb82c10f230 0x7fb82c10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:21.633 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.630+0000 7fb831c7c6c0 1 -- 10.20.193.96:0/2976170687 >> 10.20.193.96:0/2976170687 conn(0x7fb82c0ecb30 msgr2=0x7fb82c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:21.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.630+0000 7fb831c7c6c0 1 -- 10.20.193.96:0/2976170687 shutdown_connections 2026-02-13T03:36:21.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.630+0000 7fb831c7c6c0 1 -- 10.20.193.96:0/2976170687 wait complete. 2026-02-13T03:36:21.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.630+0000 7fb831c7c6c0 1 Processor -- start 2026-02-13T03:36:21.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.630+0000 7fb831c7c6c0 1 -- start start 2026-02-13T03:36:21.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.631+0000 7fb831c7c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb82c10f230 0x7fb82c11d170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:21.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.631+0000 7fb831c7c6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb82c115440 0x7fb82c11d6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:21.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.631+0000 7fb831c7c6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb82c122a70 0x7fb82c122f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:21.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.631+0000 7fb831c7c6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c123480 con 0x7fb82c10f230 2026-02-13T03:36:21.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.631+0000 7fb831c7c6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c1235f0 con 0x7fb82c122a70 2026-02-13T03:36:21.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.631+0000 7fb831c7c6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c1237b0 con 0x7fb82c115440 2026-02-13T03:36:21.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.631+0000 7fb82b7fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb82c10f230 0x7fb82c11d170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:21.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.631+0000 7fb82b7fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb82c10f230 0x7fb82c11d170 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:58280/0 (socket says 10.20.193.96:58280) 2026-02-13T03:36:21.634 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.631+0000 7fb82b7fe6c0 1 -- 10.20.193.96:0/3548492106 learned_addr learned my addr 10.20.193.96:0/3548492106 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:36:21.635 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.631+0000 7fb82b7fe6c0 1 -- 10.20.193.96:0/3548492106 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb82c115440 msgr2=0x7fb82c11d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:21.635 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.631+0000 7fb82b7fe6c0 1 --2- 10.20.193.96:0/3548492106 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb82c115440 0x7fb82c11d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:21.635 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.631+0000 7fb82b7fe6c0 1 -- 10.20.193.96:0/3548492106 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb82c122a70 msgr2=0x7fb82c122f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:21.635 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.631+0000 7fb82bfff6c0 1 --2- 10.20.193.96:0/3548492106 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb82c122a70 0x7fb82c122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:21.635 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.631+0000 7fb82b7fe6c0 1 --2- 10.20.193.96:0/3548492106 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb82c122a70 0x7fb82c122f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:21.635 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.631+0000 7fb82b7fe6c0 1 -- 10.20.193.96:0/3548492106 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82000a660 con 0x7fb82c10f230 2026-02-13T03:36:21.635 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.631+0000 7fb82bfff6c0 1 --2- 10.20.193.96:0/3548492106 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb82c122a70 0x7fb82c122f10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:36:21.635 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.631+0000 7fb82b7fe6c0 1 --2- 10.20.193.96:0/3548492106 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb82c10f230 0x7fb82c11d170 secure :-1 s=READY pgs=390 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb81800b710 tx=0x7fb81800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:21.635 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.631+0000 7fb828ff96c0 1 -- 10.20.193.96:0/3548492106 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb818004250 con 0x7fb82c10f230 2026-02-13T03:36:21.635 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.631+0000 7fb831c7c6c0 1 -- 10.20.193.96:0/3548492106 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb82c163c60 con 0x7fb82c10f230 2026-02-13T03:36:21.635 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.631+0000 7fb828ff96c0 1 -- 10.20.193.96:0/3548492106 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fb818009070 con 0x7fb82c10f230 2026-02-13T03:36:21.635 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.631+0000 7fb828ff96c0 1 -- 10.20.193.96:0/3548492106 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb81800cd50 con 0x7fb82c10f230 2026-02-13T03:36:21.635 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.631+0000 7fb831c7c6c0 1 -- 10.20.193.96:0/3548492106 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb82c1640f0 con 0x7fb82c10f230 2026-02-13T03:36:21.635 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.631+0000 7fb831c7c6c0 1 -- 10.20.193.96:0/3548492106 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb82c110500 con 0x7fb82c10f230 2026-02-13T03:36:21.636 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.633+0000 7fb828ff96c0 1 -- 10.20.193.96:0/3548492106 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fb8180028c0 con 0x7fb82c10f230 2026-02-13T03:36:21.636 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.633+0000 7fb828ff96c0 1 --2- 10.20.193.96:0/3548492106 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb8000b5600 0x7fb8000d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:21.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.634+0000 7fb82affd6c0 1 --2- 10.20.193.96:0/3548492106 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb8000b5600 0x7fb8000d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:21.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.634+0000 7fb828ff96c0 1 -- 10.20.193.96:0/3548492106 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7fb8180e3ba0 con 0x7fb82c10f230 2026-02-13T03:36:21.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.634+0000 7fb828ff96c0 1 -- 10.20.193.96:0/3548492106 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb8180a6600 con 0x7fb82c10f230 2026-02-13T03:36:21.637 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.634+0000 7fb82affd6c0 1 --2- 10.20.193.96:0/3548492106 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb8000b5600 0x7fb8000d5ab0 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb82c123b00 tx=0x7fb81c005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:21.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.750+0000 7fb831c7c6c0 1 -- 10.20.193.96:0/3548492106 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb82c10fc20 con 0x7fb82c10f230 2026-02-13T03:36:21.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.750+0000 7fb828ff96c0 1 -- 10.20.193.96:0/3548492106 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb8180a97b0 con 0x7fb82c10f230 2026-02-13T03:36:21.754 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:36:21.754 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:36:21.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.751+0000 7fb831c7c6c0 1 -- 10.20.193.96:0/3548492106 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb8000b5600 msgr2=0x7fb8000d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:21.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.751+0000 7fb831c7c6c0 1 --2- 10.20.193.96:0/3548492106 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb8000b5600 0x7fb8000d5ab0 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb82c123b00 tx=0x7fb81c005f10 comp rx=0 tx=0).stop 2026-02-13T03:36:21.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.751+0000 7fb831c7c6c0 1 -- 10.20.193.96:0/3548492106 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb82c10f230 msgr2=0x7fb82c11d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:21.756 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.751+0000 7fb831c7c6c0 1 --2- 10.20.193.96:0/3548492106 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb82c10f230 0x7fb82c11d170 secure :-1 s=READY pgs=390 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb81800b710 tx=0x7fb81800bbe0 comp rx=0 tx=0).stop 2026-02-13T03:36:21.756 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.752+0000 7fb831c7c6c0 1 -- 10.20.193.96:0/3548492106 shutdown_connections 2026-02-13T03:36:21.756 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.752+0000 7fb831c7c6c0 1 --2- 10.20.193.96:0/3548492106 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb8000b5600 0x7fb8000d5ab0 unknown :-1 s=CLOSED pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:21.756 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.752+0000 7fb831c7c6c0 1 --2- 10.20.193.96:0/3548492106 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb82c122a70 0x7fb82c122f10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:21.756 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.752+0000 7fb831c7c6c0 1 --2- 10.20.193.96:0/3548492106 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb82c115440 0x7fb82c11d6b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:21.756 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.752+0000 7fb831c7c6c0 1 --2- 10.20.193.96:0/3548492106 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb82c10f230 0x7fb82c11d170 unknown :-1 s=CLOSED pgs=390 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:21.756 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.752+0000 7fb831c7c6c0 1 -- 10.20.193.96:0/3548492106 >> 10.20.193.96:0/3548492106 conn(0x7fb82c0ecb30 msgr2=0x7fb82c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:21.756 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.752+0000 7fb831c7c6c0 1 -- 10.20.193.96:0/3548492106 shutdown_connections 2026-02-13T03:36:21.756 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:21.752+0000 7fb831c7c6c0 1 -- 10.20.193.96:0/3548492106 wait complete. 2026-02-13T03:36:22.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:21 trial096 ceph-mon[24671]: pgmap v252: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:36:22.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:21 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3548492106' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:22.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:21 trial132 ceph-mon[26888]: pgmap v252: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:36:22.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:21 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3548492106' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:22.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:21 trial133 ceph-mon[26943]: pgmap v252: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:36:22.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:21 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3548492106' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:24.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:23 trial096 ceph-mon[24671]: pgmap v253: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:36:24.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:23 trial132 ceph-mon[26888]: pgmap v253: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:36:24.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:23 trial133 ceph-mon[26943]: pgmap v253: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:36:24.797 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:36:24.917 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:36:25.033 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.029+0000 7fb89aeb86c0 1 -- 10.20.193.96:0/3803560075 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb894115410 msgr2=0x7fb894175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:25.034 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.029+0000 7fb89aeb86c0 1 --2- 10.20.193.96:0/3803560075 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb894115410 0x7fb894175db0 secure :-1 s=READY pgs=391 gs=1 cs=0 l=1 c_cookie=9705966982371955336 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb89000aa70 tx=0x7fb89002fde0 comp rx=0 tx=0).stop 2026-02-13T03:36:25.034 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.029+0000 7fb89aeb86c0 1 -- 10.20.193.96:0/3803560075 shutdown_connections 2026-02-13T03:36:25.034 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.029+0000 7fb89aeb86c0 1 --2- 10.20.193.96:0/3803560075 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb894115410 0x7fb894175db0 unknown :-1 s=CLOSED pgs=391 gs=1 cs=0 l=1 c_cookie=9705966982371955336 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:25.034 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.029+0000 7fb89aeb86c0 1 --2- 10.20.193.96:0/3803560075 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb89410fbf0 0x7fb894114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:25.034 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.029+0000 7fb89aeb86c0 1 --2- 10.20.193.96:0/3803560075 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb89410f200 0x7fb89410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:25.034 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.029+0000 7fb89aeb86c0 1 -- 10.20.193.96:0/3803560075 >> 10.20.193.96:0/3803560075 conn(0x7fb8940ecb00 msgr2=0x7fb89410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:25.034 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.029+0000 7fb89aeb86c0 1 -- 10.20.193.96:0/3803560075 shutdown_connections 2026-02-13T03:36:25.034 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.029+0000 7fb89aeb86c0 1 -- 10.20.193.96:0/3803560075 wait complete. 2026-02-13T03:36:25.034 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.029+0000 7fb89aeb86c0 1 Processor -- start 2026-02-13T03:36:25.034 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.029+0000 7fb89aeb86c0 1 -- start start 2026-02-13T03:36:25.035 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.029+0000 7fb89aeb86c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb89410f200 0x7fb89411d110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:25.035 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.029+0000 7fb89aeb86c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb894115410 0x7fb89411d650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:25.035 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.029+0000 7fb89aeb86c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb894122a10 0x7fb894122eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:25.035 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.029+0000 7fb89aeb86c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb894123420 con 0x7fb894122a10 2026-02-13T03:36:25.035 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.029+0000 7fb89aeb86c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb894123590 con 0x7fb894115410 2026-02-13T03:36:25.035 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.029+0000 7fb89aeb86c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb894123750 con 0x7fb89410f200 2026-02-13T03:36:25.035 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.029+0000 7fb89942a6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb894122a10 0x7fb894122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:25.035 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.029+0000 7fb89942a6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb894122a10 0x7fb894122eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:50250/0 (socket says 10.20.193.96:50250) 2026-02-13T03:36:25.035 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.029+0000 7fb89942a6c0 1 -- 10.20.193.96:0/1962149731 learned_addr learned my addr 10.20.193.96:0/1962149731 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:36:25.035 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.029+0000 7fb88bfff6c0 1 --2- 10.20.193.96:0/1962149731 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb894115410 0x7fb89411d650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:25.035 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.029+0000 7fb898c296c0 1 --2- 10.20.193.96:0/1962149731 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb89410f200 0x7fb89411d110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:25.035 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.030+0000 7fb89942a6c0 1 -- 10.20.193.96:0/1962149731 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb89410f200 msgr2=0x7fb89411d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:25.036 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.030+0000 7fb89942a6c0 1 --2- 10.20.193.96:0/1962149731 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb89410f200 0x7fb89411d110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:25.036 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.030+0000 7fb89942a6c0 1 -- 10.20.193.96:0/1962149731 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb894115410 msgr2=0x7fb89411d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:25.036 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.030+0000 7fb89942a6c0 1 --2- 10.20.193.96:0/1962149731 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb894115410 0x7fb89411d650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:25.036 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.030+0000 7fb89942a6c0 1 -- 10.20.193.96:0/1962149731 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb89000a660 con 0x7fb894122a10 2026-02-13T03:36:25.036 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.030+0000 7fb898c296c0 1 --2- 10.20.193.96:0/1962149731 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb89410f200 0x7fb89411d110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:36:25.036 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.030+0000 7fb88bfff6c0 1 --2- 10.20.193.96:0/1962149731 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb894115410 0x7fb89411d650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:36:25.036 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.030+0000 7fb89942a6c0 1 --2- 10.20.193.96:0/1962149731 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb894122a10 0x7fb894122eb0 secure :-1 s=READY pgs=392 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb89000ab70 tx=0x7fb8900054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:25.036 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.030+0000 7fb889ffb6c0 1 -- 10.20.193.96:0/1962149731 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb890030d10 con 0x7fb894122a10 2026-02-13T03:36:25.036 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.030+0000 7fb89aeb86c0 1 -- 10.20.193.96:0/1962149731 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb894163ba0 con 0x7fb894122a10 2026-02-13T03:36:25.036 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.030+0000 7fb889ffb6c0 1 -- 10.20.193.96:0/1962149731 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fb890030e70 con 0x7fb894122a10 2026-02-13T03:36:25.036 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.030+0000 7fb889ffb6c0 1 -- 10.20.193.96:0/1962149731 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb890032920 con 0x7fb894122a10 2026-02-13T03:36:25.036 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.030+0000 7fb89aeb86c0 1 -- 10.20.193.96:0/1962149731 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb894163fd0 con 0x7fb894122a10 2026-02-13T03:36:25.037 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.030+0000 7fb89aeb86c0 1 -- 10.20.193.96:0/1962149731 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8941104d0 con 0x7fb894122a10 2026-02-13T03:36:25.038 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.032+0000 7fb889ffb6c0 1 -- 10.20.193.96:0/1962149731 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fb890032030 con 0x7fb894122a10 2026-02-13T03:36:25.038 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.032+0000 7fb889ffb6c0 1 --2- 10.20.193.96:0/1962149731 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb8700b5600 0x7fb8700d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:25.038 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.032+0000 7fb898c296c0 1 --2- 10.20.193.96:0/1962149731 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb8700b5600 0x7fb8700d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:25.038 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.032+0000 7fb889ffb6c0 1 -- 10.20.193.96:0/1962149731 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7fb890108e40 con 0x7fb894122a10 2026-02-13T03:36:25.038 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.032+0000 7fb898c296c0 1 --2- 10.20.193.96:0/1962149731 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb8700b5600 0x7fb8700d5ab0 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb884004750 tx=0x7fb884009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:25.038 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.033+0000 7fb889ffb6c0 1 -- 10.20.193.96:0/1962149731 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb8900cb8a0 con 0x7fb894122a10 2026-02-13T03:36:25.150 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.147+0000 7fb89aeb86c0 1 -- 10.20.193.96:0/1962149731 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb89410f5d0 con 0x7fb894122a10 2026-02-13T03:36:25.150 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.148+0000 7fb889ffb6c0 1 -- 10.20.193.96:0/1962149731 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb8900cea50 con 0x7fb894122a10 2026-02-13T03:36:25.151 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:36:25.151 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:36:25.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.149+0000 7fb89aeb86c0 1 -- 10.20.193.96:0/1962149731 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb8700b5600 msgr2=0x7fb8700d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:25.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.149+0000 7fb89aeb86c0 1 --2- 10.20.193.96:0/1962149731 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb8700b5600 0x7fb8700d5ab0 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb884004750 tx=0x7fb884009260 comp rx=0 tx=0).stop 2026-02-13T03:36:25.152 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.149+0000 7fb89aeb86c0 1 -- 10.20.193.96:0/1962149731 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb894122a10 msgr2=0x7fb894122eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:25.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.149+0000 7fb89aeb86c0 1 --2- 10.20.193.96:0/1962149731 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb894122a10 0x7fb894122eb0 secure :-1 s=READY pgs=392 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb89000ab70 tx=0x7fb8900054b0 comp rx=0 tx=0).stop 2026-02-13T03:36:25.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.149+0000 7fb89aeb86c0 1 -- 10.20.193.96:0/1962149731 shutdown_connections 2026-02-13T03:36:25.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.149+0000 7fb89aeb86c0 1 --2- 10.20.193.96:0/1962149731 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb8700b5600 0x7fb8700d5ab0 unknown :-1 s=CLOSED pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:25.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.149+0000 7fb89aeb86c0 1 --2- 10.20.193.96:0/1962149731 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb894122a10 0x7fb894122eb0 unknown :-1 s=CLOSED pgs=392 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:25.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.149+0000 7fb89aeb86c0 1 --2- 10.20.193.96:0/1962149731 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb894115410 0x7fb89411d650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:25.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.149+0000 7fb89aeb86c0 1 --2- 10.20.193.96:0/1962149731 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb89410f200 0x7fb89411d110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:25.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.149+0000 7fb89aeb86c0 1 -- 10.20.193.96:0/1962149731 >> 10.20.193.96:0/1962149731 conn(0x7fb8940ecb00 msgr2=0x7fb89410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:25.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.149+0000 7fb89aeb86c0 1 -- 10.20.193.96:0/1962149731 shutdown_connections 2026-02-13T03:36:25.153 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:25.149+0000 7fb89aeb86c0 1 -- 10.20.193.96:0/1962149731 wait complete. 2026-02-13T03:36:26.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:25 trial096 ceph-mon[24671]: pgmap v254: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:36:26.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:25 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1962149731' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:26.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:25 trial132 ceph-mon[26888]: pgmap v254: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:36:26.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:25 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1962149731' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:26.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:25 trial133 ceph-mon[26943]: pgmap v254: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-13T03:36:26.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:25 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1962149731' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:28.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:27 trial096 ceph-mon[24671]: pgmap v255: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T03:36:28.193 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:36:28.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:27 trial132 ceph-mon[26888]: pgmap v255: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T03:36:28.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:27 trial133 ceph-mon[26943]: pgmap v255: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T03:36:28.310 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:36:28.423 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.419+0000 7fd48b84c6c0 1 -- 10.20.193.96:0/659817673 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd48410f230 msgr2=0x7fd48410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:28.424 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.419+0000 7fd48b84c6c0 1 --2- 10.20.193.96:0/659817673 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd48410f230 0x7fd48410f600 secure :-1 s=READY pgs=393 gs=1 cs=0 l=1 c_cookie=1360265287401645533 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4740099a0 tx=0x7fd47402ed20 comp rx=0 tx=0).stop 2026-02-13T03:36:28.424 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.419+0000 7fd48b84c6c0 1 -- 10.20.193.96:0/659817673 shutdown_connections 2026-02-13T03:36:28.424 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.419+0000 7fd48b84c6c0 1 --2- 10.20.193.96:0/659817673 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd484115440 0x7fd484175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:28.424 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.419+0000 7fd48b84c6c0 1 --2- 10.20.193.96:0/659817673 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd48410fc20 0x7fd484114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:28.424 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.419+0000 7fd48b84c6c0 1 --2- 10.20.193.96:0/659817673 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd48410f230 0x7fd48410f600 unknown :-1 s=CLOSED pgs=393 gs=1 cs=0 l=1 c_cookie=1360265287401645533 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:28.424 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.419+0000 7fd48b84c6c0 1 -- 10.20.193.96:0/659817673 >> 10.20.193.96:0/659817673 conn(0x7fd4840ecb30 msgr2=0x7fd48410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:28.424 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.419+0000 7fd48b84c6c0 1 -- 10.20.193.96:0/659817673 shutdown_connections 2026-02-13T03:36:28.424 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.419+0000 7fd48b84c6c0 1 -- 10.20.193.96:0/659817673 wait complete. 2026-02-13T03:36:28.424 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.420+0000 7fd48b84c6c0 1 Processor -- start 2026-02-13T03:36:28.425 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.420+0000 7fd48b84c6c0 1 -- start start 2026-02-13T03:36:28.425 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.420+0000 7fd48b84c6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd48410f230 0x7fd48411d1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:28.425 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.420+0000 7fd48b84c6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd484115440 0x7fd48411d700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:28.425 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.420+0000 7fd48b84c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd484122ac0 0x7fd484122f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:28.425 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.420+0000 7fd48b84c6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd4841234d0 con 0x7fd484122ac0 2026-02-13T03:36:28.425 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.420+0000 7fd48b84c6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd484123640 con 0x7fd484115440 2026-02-13T03:36:28.425 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.420+0000 7fd48b84c6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd484123800 con 0x7fd48410f230 2026-02-13T03:36:28.425 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.420+0000 7fd489dc26c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd484122ac0 0x7fd484122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:28.425 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.420+0000 7fd489dc26c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd484122ac0 0x7fd484122f60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:50280/0 (socket says 10.20.193.96:50280) 2026-02-13T03:36:28.425 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.420+0000 7fd489dc26c0 1 -- 10.20.193.96:0/1806224571 learned_addr learned my addr 10.20.193.96:0/1806224571 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:36:28.425 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.420+0000 7fd4895c16c0 1 --2- 10.20.193.96:0/1806224571 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd48410f230 0x7fd48411d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:28.425 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.420+0000 7fd488dc06c0 1 --2- 10.20.193.96:0/1806224571 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd484115440 0x7fd48411d700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:28.426 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.420+0000 7fd489dc26c0 1 -- 10.20.193.96:0/1806224571 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd48410f230 msgr2=0x7fd48411d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:28.426 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.420+0000 7fd489dc26c0 1 --2- 10.20.193.96:0/1806224571 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd48410f230 0x7fd48411d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:28.426 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.420+0000 7fd489dc26c0 1 -- 10.20.193.96:0/1806224571 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd484115440 msgr2=0x7fd48411d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:28.426 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.420+0000 7fd489dc26c0 1 --2- 10.20.193.96:0/1806224571 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd484115440 0x7fd48411d700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:28.426 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.420+0000 7fd489dc26c0 1 -- 10.20.193.96:0/1806224571 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd474009590 con 0x7fd484122ac0 2026-02-13T03:36:28.426 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.420+0000 7fd489dc26c0 1 --2- 10.20.193.96:0/1806224571 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd484122ac0 0x7fd484122f60 secure :-1 s=READY pgs=394 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd48000c6c0 tx=0x7fd48000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:28.426 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.420+0000 7fd4727fc6c0 1 -- 10.20.193.96:0/1806224571 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd480003c40 con 0x7fd484122ac0 2026-02-13T03:36:28.426 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.420+0000 7fd4727fc6c0 1 -- 10.20.193.96:0/1806224571 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fd48000a030 con 0x7fd484122ac0 2026-02-13T03:36:28.426 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.420+0000 7fd48b84c6c0 1 -- 10.20.193.96:0/1806224571 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd484163cb0 con 0x7fd484122ac0 2026-02-13T03:36:28.426 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.420+0000 7fd4727fc6c0 1 -- 10.20.193.96:0/1806224571 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd48000dbe0 con 0x7fd484122ac0 2026-02-13T03:36:28.426 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.420+0000 7fd48b84c6c0 1 -- 10.20.193.96:0/1806224571 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd484164190 con 0x7fd484122ac0 2026-02-13T03:36:28.426 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.421+0000 7fd48b84c6c0 1 -- 10.20.193.96:0/1806224571 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd484110500 con 0x7fd484122ac0 2026-02-13T03:36:28.427 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.422+0000 7fd4727fc6c0 1 -- 10.20.193.96:0/1806224571 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fd480005030 con 0x7fd484122ac0 2026-02-13T03:36:28.428 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.422+0000 7fd4727fc6c0 1 --2- 10.20.193.96:0/1806224571 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd4600b5680 0x7fd4600d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:28.428 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.423+0000 7fd4727fc6c0 1 -- 10.20.193.96:0/1806224571 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7fd4800e48c0 con 0x7fd484122ac0 2026-02-13T03:36:28.428 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.423+0000 7fd4895c16c0 1 --2- 10.20.193.96:0/1806224571 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd4600b5680 0x7fd4600d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:28.428 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.423+0000 7fd4895c16c0 1 --2- 10.20.193.96:0/1806224571 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd4600b5680 0x7fd4600d5b30 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd474005b40 tx=0x7fd4740023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:28.428 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.423+0000 7fd4727fc6c0 1 -- 10.20.193.96:0/1806224571 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd4800a7320 con 0x7fd484122ac0 2026-02-13T03:36:28.540 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.538+0000 7fd48b84c6c0 1 -- 10.20.193.96:0/1806224571 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd48411e370 con 0x7fd484122ac0 2026-02-13T03:36:28.540 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.538+0000 7fd4727fc6c0 1 -- 10.20.193.96:0/1806224571 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd480005310 con 0x7fd484122ac0 2026-02-13T03:36:28.541 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:36:28.541 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:36:28.542 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.539+0000 7fd48b84c6c0 1 -- 10.20.193.96:0/1806224571 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd4600b5680 msgr2=0x7fd4600d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:28.542 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.539+0000 7fd48b84c6c0 1 --2- 10.20.193.96:0/1806224571 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd4600b5680 0x7fd4600d5b30 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd474005b40 tx=0x7fd4740023a0 comp rx=0 tx=0).stop 2026-02-13T03:36:28.542 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.539+0000 7fd48b84c6c0 1 -- 10.20.193.96:0/1806224571 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd484122ac0 msgr2=0x7fd484122f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:28.542 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.539+0000 7fd48b84c6c0 1 --2- 10.20.193.96:0/1806224571 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd484122ac0 0x7fd484122f60 secure :-1 s=READY pgs=394 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd48000c6c0 tx=0x7fd48000cb90 comp rx=0 tx=0).stop 2026-02-13T03:36:28.542 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.539+0000 7fd48b84c6c0 1 -- 10.20.193.96:0/1806224571 shutdown_connections 2026-02-13T03:36:28.542 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.539+0000 7fd48b84c6c0 1 --2- 10.20.193.96:0/1806224571 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd4600b5680 0x7fd4600d5b30 unknown :-1 s=CLOSED pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:28.543 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.539+0000 7fd48b84c6c0 1 --2- 10.20.193.96:0/1806224571 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd484122ac0 0x7fd484122f60 unknown :-1 s=CLOSED pgs=394 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:28.543 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.539+0000 7fd48b84c6c0 1 --2- 10.20.193.96:0/1806224571 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd484115440 0x7fd48411d700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:28.543 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.539+0000 7fd48b84c6c0 1 --2- 10.20.193.96:0/1806224571 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd48410f230 0x7fd48411d1c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:28.543 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.539+0000 7fd48b84c6c0 1 -- 10.20.193.96:0/1806224571 >> 10.20.193.96:0/1806224571 conn(0x7fd4840ecb30 msgr2=0x7fd48410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:28.543 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.539+0000 7fd48b84c6c0 1 -- 10.20.193.96:0/1806224571 shutdown_connections 2026-02-13T03:36:28.543 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:28.539+0000 7fd48b84c6c0 1 -- 10.20.193.96:0/1806224571 wait complete. 2026-02-13T03:36:29.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:28 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1806224571' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:29.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:28 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1806224571' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:29.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:28 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1806224571' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:30.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:29 trial096 ceph-mon[24671]: pgmap v256: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:36:30.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:29 trial132 ceph-mon[26888]: pgmap v256: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:36:30.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:29 trial133 ceph-mon[26943]: pgmap v256: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:36:31.583 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:36:31.705 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:36:31.825 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.820+0000 7f60c54c56c0 1 -- 10.20.193.96:0/1759816513 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f60c01174b0 msgr2=0x7f60c0113dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:31.825 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.820+0000 7f60c54c56c0 1 --2- 10.20.193.96:0/1759816513 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f60c01174b0 0x7f60c0113dc0 secure :-1 s=READY pgs=395 gs=1 cs=0 l=1 c_cookie=17682661496915211726 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60b4009970 tx=0x7f60b402ed20 comp rx=0 tx=0).stop 2026-02-13T03:36:31.825 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60c54c56c0 1 -- 10.20.193.96:0/1759816513 shutdown_connections 2026-02-13T03:36:31.825 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60c54c56c0 1 --2- 10.20.193.96:0/1759816513 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f60c015dfa0 0x7f60c017e3a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:31.826 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60c54c56c0 1 --2- 10.20.193.96:0/1759816513 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f60c0114300 0x7f60c0114730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:31.826 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60c54c56c0 1 --2- 10.20.193.96:0/1759816513 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f60c01174b0 0x7f60c0113dc0 unknown :-1 s=CLOSED pgs=395 gs=1 cs=0 l=1 c_cookie=17682661496915211726 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:31.826 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60c54c56c0 1 -- 10.20.193.96:0/1759816513 >> 10.20.193.96:0/1759816513 conn(0x7f60c0058a50 msgr2=0x7f60c0058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:31.826 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60c54c56c0 1 -- 10.20.193.96:0/1759816513 shutdown_connections 2026-02-13T03:36:31.826 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60c54c56c0 1 -- 10.20.193.96:0/1759816513 wait complete. 2026-02-13T03:36:31.826 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60c54c56c0 1 Processor -- start 2026-02-13T03:36:31.826 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60c54c56c0 1 -- start start 2026-02-13T03:36:31.826 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60c54c56c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f60c0114300 0x7f60c00fd290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:31.826 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60c54c56c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f60c01174b0 0x7f60c00fd7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:31.826 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60c54c56c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f60c015dfa0 0x7f60c0102b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:31.826 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60c54c56c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f60c01031e0 con 0x7f60c01174b0 2026-02-13T03:36:31.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60c54c56c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f60c0103350 con 0x7f60c0114300 2026-02-13T03:36:31.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60c54c56c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f60c0103510 con 0x7f60c015dfa0 2026-02-13T03:36:31.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60be7fc6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f60c01174b0 0x7f60c00fd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:31.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60be7fc6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f60c01174b0 0x7f60c00fd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:50296/0 (socket says 10.20.193.96:50296) 2026-02-13T03:36:31.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60be7fc6c0 1 -- 10.20.193.96:0/2094709339 learned_addr learned my addr 10.20.193.96:0/2094709339 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:36:31.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60beffd6c0 1 --2- 10.20.193.96:0/2094709339 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f60c0114300 0x7f60c00fd290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:31.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60be7fc6c0 1 -- 10.20.193.96:0/2094709339 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f60c015dfa0 msgr2=0x7f60c0102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:31.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60be7fc6c0 1 --2- 10.20.193.96:0/2094709339 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f60c015dfa0 0x7f60c0102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:31.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60be7fc6c0 1 -- 10.20.193.96:0/2094709339 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f60c0114300 msgr2=0x7f60c00fd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:31.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60be7fc6c0 1 --2- 10.20.193.96:0/2094709339 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f60c0114300 0x7f60c00fd290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:31.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60be7fc6c0 1 -- 10.20.193.96:0/2094709339 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b4009590 con 0x7f60c01174b0 2026-02-13T03:36:31.827 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.821+0000 7f60be7fc6c0 1 --2- 10.20.193.96:0/2094709339 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f60c01174b0 0x7f60c00fd7d0 secure :-1 s=READY pgs=396 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60a8005dc0 tx=0x7f60a800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:31.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.822+0000 7f609ffff6c0 1 -- 10.20.193.96:0/2094709339 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f60a8004250 con 0x7f60c01174b0 2026-02-13T03:36:31.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.822+0000 7f60c54c56c0 1 -- 10.20.193.96:0/2094709339 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60c01037f0 con 0x7f60c01174b0 2026-02-13T03:36:31.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.822+0000 7f609ffff6c0 1 -- 10.20.193.96:0/2094709339 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f60a8009070 con 0x7f60c01174b0 2026-02-13T03:36:31.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.822+0000 7f609ffff6c0 1 -- 10.20.193.96:0/2094709339 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f60a800cdb0 con 0x7f60c01174b0 2026-02-13T03:36:31.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.822+0000 7f60c54c56c0 1 -- 10.20.193.96:0/2094709339 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60c015c130 con 0x7f60c01174b0 2026-02-13T03:36:31.828 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.822+0000 7f60c54c56c0 1 -- 10.20.193.96:0/2094709339 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60c005b000 con 0x7f60c01174b0 2026-02-13T03:36:31.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.824+0000 7f609ffff6c0 1 -- 10.20.193.96:0/2094709339 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f60a80028c0 con 0x7f60c01174b0 2026-02-13T03:36:31.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.824+0000 7f609ffff6c0 1 --2- 10.20.193.96:0/2094709339 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f60940b5680 0x7f60940d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:31.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.824+0000 7f609ffff6c0 1 -- 10.20.193.96:0/2094709339 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f60a80e3a30 con 0x7f60c01174b0 2026-02-13T03:36:31.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.824+0000 7f60beffd6c0 1 --2- 10.20.193.96:0/2094709339 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f60940b5680 0x7f60940d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:31.829 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.824+0000 7f609ffff6c0 1 -- 10.20.193.96:0/2094709339 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f60a80a9460 con 0x7f60c01174b0 2026-02-13T03:36:31.830 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.824+0000 7f60beffd6c0 1 --2- 10.20.193.96:0/2094709339 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f60940b5680 0x7f60940d5b30 secure :-1 s=READY pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60b40023e0 tx=0x7f60b4009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:31.947 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.944+0000 7f60c54c56c0 1 -- 10.20.193.96:0/2094709339 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f60c0114730 con 0x7f60c01174b0 2026-02-13T03:36:31.947 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.944+0000 7f609ffff6c0 1 -- 10.20.193.96:0/2094709339 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f60a80a9640 con 0x7f60c01174b0 2026-02-13T03:36:31.947 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:36:31.947 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:36:31.948 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.945+0000 7f60c54c56c0 1 -- 10.20.193.96:0/2094709339 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f60940b5680 msgr2=0x7f60940d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:31.948 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.945+0000 7f60c54c56c0 1 --2- 10.20.193.96:0/2094709339 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f60940b5680 0x7f60940d5b30 secure :-1 s=READY pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60b40023e0 tx=0x7f60b4009260 comp rx=0 tx=0).stop 2026-02-13T03:36:31.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.945+0000 7f60c54c56c0 1 -- 10.20.193.96:0/2094709339 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f60c01174b0 msgr2=0x7f60c00fd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:31.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.945+0000 7f60c54c56c0 1 --2- 10.20.193.96:0/2094709339 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f60c01174b0 0x7f60c00fd7d0 secure :-1 s=READY pgs=396 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60a8005dc0 tx=0x7f60a800bbb0 comp rx=0 tx=0).stop 2026-02-13T03:36:31.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.945+0000 7f60c54c56c0 1 -- 10.20.193.96:0/2094709339 shutdown_connections 2026-02-13T03:36:31.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.945+0000 7f60c54c56c0 1 --2- 10.20.193.96:0/2094709339 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f60940b5680 0x7f60940d5b30 unknown :-1 s=CLOSED pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:31.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.945+0000 7f60c54c56c0 1 --2- 10.20.193.96:0/2094709339 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f60c015dfa0 0x7f60c0102b90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:31.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.945+0000 7f60c54c56c0 1 --2- 10.20.193.96:0/2094709339 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f60c01174b0 0x7f60c00fd7d0 unknown :-1 s=CLOSED pgs=396 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:31.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.945+0000 7f60c54c56c0 1 --2- 10.20.193.96:0/2094709339 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f60c0114300 0x7f60c00fd290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:31.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.945+0000 7f60c54c56c0 1 -- 10.20.193.96:0/2094709339 >> 10.20.193.96:0/2094709339 conn(0x7f60c0058a50 msgr2=0x7f60c00f5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:31.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.945+0000 7f60c54c56c0 1 -- 10.20.193.96:0/2094709339 shutdown_connections 2026-02-13T03:36:31.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:31.945+0000 7f60c54c56c0 1 -- 10.20.193.96:0/2094709339 wait complete. 2026-02-13T03:36:31.987 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:31 trial096 ceph-mon[24671]: pgmap v257: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:36:32.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:31 trial132 ceph-mon[26888]: pgmap v257: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:36:32.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:31 trial133 ceph-mon[26943]: pgmap v257: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:36:33.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:32 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2094709339' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:33.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:32 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2094709339' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:33.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:32 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2094709339' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:34.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:33 trial096 ceph-mon[24671]: pgmap v258: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:36:34.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:33 trial132 ceph-mon[26888]: pgmap v258: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:36:34.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:33 trial133 ceph-mon[26943]: pgmap v258: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:36:34.989 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:36:35.110 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:36:35.228 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.224+0000 7f51ef1746c0 1 -- 10.20.193.96:0/836475508 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f51e8115440 msgr2=0x7f51e8175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:35.229 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.224+0000 7f51ef1746c0 1 --2- 10.20.193.96:0/836475508 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f51e8115440 0x7f51e8175de0 secure :-1 s=READY pgs=397 gs=1 cs=0 l=1 c_cookie=16789006613367810753 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f51e400aa70 tx=0x7f51e402fde0 comp rx=0 tx=0).stop 2026-02-13T03:36:35.229 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.224+0000 7f51ef1746c0 1 -- 10.20.193.96:0/836475508 shutdown_connections 2026-02-13T03:36:35.229 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.224+0000 7f51ef1746c0 1 --2- 10.20.193.96:0/836475508 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f51e8115440 0x7f51e8175de0 unknown :-1 s=CLOSED pgs=397 gs=1 cs=0 l=1 c_cookie=16789006613367810753 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:35.229 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.224+0000 7f51ef1746c0 1 --2- 10.20.193.96:0/836475508 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f51e810fc20 0x7f51e8114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:35.229 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.224+0000 7f51ef1746c0 1 --2- 10.20.193.96:0/836475508 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f51e810f230 0x7f51e810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:35.229 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.224+0000 7f51ef1746c0 1 -- 10.20.193.96:0/836475508 >> 10.20.193.96:0/836475508 conn(0x7f51e80ecb30 msgr2=0x7f51e810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:35.229 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.224+0000 7f51ef1746c0 1 -- 10.20.193.96:0/836475508 shutdown_connections 2026-02-13T03:36:35.229 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.224+0000 7f51ef1746c0 1 -- 10.20.193.96:0/836475508 wait complete. 2026-02-13T03:36:35.229 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.224+0000 7f51ef1746c0 1 Processor -- start 2026-02-13T03:36:35.230 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.225+0000 7f51ef1746c0 1 -- start start 2026-02-13T03:36:35.230 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.225+0000 7f51ef1746c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f51e810f230 0x7f51e811d100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:35.230 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.225+0000 7f51ef1746c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f51e8115440 0x7f51e811d640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:35.230 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.225+0000 7f51ef1746c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f51e8122a00 0x7f51e8122ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:35.230 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.225+0000 7f51ef1746c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f51e8123410 con 0x7f51e810f230 2026-02-13T03:36:35.230 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.225+0000 7f51ef1746c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f51e8123580 con 0x7f51e8122a00 2026-02-13T03:36:35.230 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.225+0000 7f51ef1746c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f51e8123740 con 0x7f51e8115440 2026-02-13T03:36:35.230 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.225+0000 7f51ecee56c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f51e810f230 0x7f51e811d100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:35.230 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.225+0000 7f51ecee56c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f51e810f230 0x7f51e811d100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:55380/0 (socket says 10.20.193.96:55380) 2026-02-13T03:36:35.230 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.225+0000 7f51ecee56c0 1 -- 10.20.193.96:0/947806595 learned_addr learned my addr 10.20.193.96:0/947806595 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:36:35.230 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.225+0000 7f51ed6e66c0 1 --2- 10.20.193.96:0/947806595 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f51e8122a00 0x7f51e8122ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:35.230 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.225+0000 7f51ecee56c0 1 -- 10.20.193.96:0/947806595 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f51e8115440 msgr2=0x7f51e811d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:35.231 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.225+0000 7f51ecee56c0 1 --2- 10.20.193.96:0/947806595 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f51e8115440 0x7f51e811d640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:35.231 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.225+0000 7f51ecee56c0 1 -- 10.20.193.96:0/947806595 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f51e8122a00 msgr2=0x7f51e8122ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:35.231 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.225+0000 7f51ecee56c0 1 --2- 10.20.193.96:0/947806595 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f51e8122a00 0x7f51e8122ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:35.250 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.225+0000 7f51ecee56c0 1 -- 10.20.193.96:0/947806595 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e400a660 con 0x7f51e810f230 2026-02-13T03:36:35.251 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.225+0000 7f51ecee56c0 1 --2- 10.20.193.96:0/947806595 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f51e810f230 0x7f51e811d100 secure :-1 s=READY pgs=398 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f51d800b710 tx=0x7f51d800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:35.251 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.225+0000 7f51ddffb6c0 1 -- 10.20.193.96:0/947806595 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f51d8004250 con 0x7f51e810f230 2026-02-13T03:36:35.251 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.225+0000 7f51ddffb6c0 1 -- 10.20.193.96:0/947806595 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f51d8002da0 con 0x7f51e810f230 2026-02-13T03:36:35.251 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.225+0000 7f51ef1746c0 1 -- 10.20.193.96:0/947806595 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51e8163bf0 con 0x7f51e810f230 2026-02-13T03:36:35.251 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.225+0000 7f51ddffb6c0 1 -- 10.20.193.96:0/947806595 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f51d800ce30 con 0x7f51e810f230 2026-02-13T03:36:35.251 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.225+0000 7f51ef1746c0 1 -- 10.20.193.96:0/947806595 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51e8164080 con 0x7f51e810f230 2026-02-13T03:36:35.251 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.225+0000 7f51ef1746c0 1 -- 10.20.193.96:0/947806595 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51e8110500 con 0x7f51e810f230 2026-02-13T03:36:35.252 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.227+0000 7f51ddffb6c0 1 -- 10.20.193.96:0/947806595 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f51d80028c0 con 0x7f51e810f230 2026-02-13T03:36:35.252 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.227+0000 7f51ddffb6c0 1 --2- 10.20.193.96:0/947806595 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f51c40b5600 0x7f51c40d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:35.252 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.227+0000 7f51dffff6c0 1 --2- 10.20.193.96:0/947806595 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f51c40b5600 0x7f51c40d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:35.253 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.227+0000 7f51ddffb6c0 1 -- 10.20.193.96:0/947806595 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f51d80e3c30 con 0x7f51e810f230 2026-02-13T03:36:35.253 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.227+0000 7f51ddffb6c0 1 -- 10.20.193.96:0/947806595 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f51d80a66d0 con 0x7f51e810f230 2026-02-13T03:36:35.253 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.228+0000 7f51dffff6c0 1 --2- 10.20.193.96:0/947806595 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f51c40b5600 0x7f51c40d5ab0 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f51d0005980 tx=0x7f51d0005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:35.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.343+0000 7f51ef1746c0 1 -- 10.20.193.96:0/947806595 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f51e810fc20 con 0x7f51e810f230 2026-02-13T03:36:35.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.344+0000 7f51ddffb6c0 1 -- 10.20.193.96:0/947806595 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f51d80a9880 con 0x7f51e810f230 2026-02-13T03:36:35.346 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:36:35.346 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:36:35.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.345+0000 7f51ef1746c0 1 -- 10.20.193.96:0/947806595 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f51c40b5600 msgr2=0x7f51c40d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:35.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.345+0000 7f51ef1746c0 1 --2- 10.20.193.96:0/947806595 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f51c40b5600 0x7f51c40d5ab0 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f51d0005980 tx=0x7f51d0005910 comp rx=0 tx=0).stop 2026-02-13T03:36:35.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.345+0000 7f51ef1746c0 1 -- 10.20.193.96:0/947806595 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f51e810f230 msgr2=0x7f51e811d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:35.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.345+0000 7f51ef1746c0 1 --2- 10.20.193.96:0/947806595 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f51e810f230 0x7f51e811d100 secure :-1 s=READY pgs=398 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f51d800b710 tx=0x7f51d800bbe0 comp rx=0 tx=0).stop 2026-02-13T03:36:35.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.345+0000 7f51ef1746c0 1 -- 10.20.193.96:0/947806595 shutdown_connections 2026-02-13T03:36:35.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.345+0000 7f51ef1746c0 1 --2- 10.20.193.96:0/947806595 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f51c40b5600 0x7f51c40d5ab0 unknown :-1 s=CLOSED pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:35.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.345+0000 7f51ef1746c0 1 --2- 10.20.193.96:0/947806595 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f51e8122a00 0x7f51e8122ea0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:35.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.345+0000 7f51ef1746c0 1 --2- 10.20.193.96:0/947806595 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f51e8115440 0x7f51e811d640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:35.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.345+0000 7f51ef1746c0 1 --2- 10.20.193.96:0/947806595 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f51e810f230 0x7f51e811d100 unknown :-1 s=CLOSED pgs=398 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:35.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.345+0000 7f51ef1746c0 1 -- 10.20.193.96:0/947806595 >> 10.20.193.96:0/947806595 conn(0x7f51e80ecb30 msgr2=0x7f51e810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:35.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.345+0000 7f51ef1746c0 1 -- 10.20.193.96:0/947806595 shutdown_connections 2026-02-13T03:36:35.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:35.345+0000 7f51ef1746c0 1 -- 10.20.193.96:0/947806595 wait complete. 2026-02-13T03:36:36.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:35 trial132 ceph-mon[26888]: pgmap v259: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:36:36.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:35 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/947806595' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:36.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:35 trial133 ceph-mon[26943]: pgmap v259: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:36:36.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:35 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/947806595' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:36.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:35 trial096 ceph-mon[24671]: pgmap v259: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:36:36.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:35 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/947806595' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:38.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:37 trial132 ceph-mon[26888]: pgmap v260: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:36:38.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:37 trial133 ceph-mon[26943]: pgmap v260: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:36:38.390 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:36:38.412 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:37 trial096 ceph-mon[24671]: pgmap v260: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:36:38.506 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:36:38.616 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.613+0000 7f56347446c0 1 -- 10.20.193.96:0/810265808 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f562c10fbf0 msgr2=0x7f562c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:38.616 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.613+0000 7f56347446c0 1 --2- 10.20.193.96:0/810265808 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f562c10fbf0 0x7f562c114c30 secure :-1 s=READY pgs=399 gs=1 cs=0 l=1 c_cookie=3458943911176558947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56200099a0 tx=0x7f562002ed20 comp rx=0 tx=0).stop 2026-02-13T03:36:38.616 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.613+0000 7f56347446c0 1 -- 10.20.193.96:0/810265808 shutdown_connections 2026-02-13T03:36:38.616 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.613+0000 7f56347446c0 1 --2- 10.20.193.96:0/810265808 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f562c115410 0x7f562c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:38.616 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.613+0000 7f56347446c0 1 --2- 10.20.193.96:0/810265808 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f562c10fbf0 0x7f562c114c30 unknown :-1 s=CLOSED pgs=399 gs=1 cs=0 l=1 c_cookie=3458943911176558947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:38.616 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.613+0000 7f56347446c0 1 --2- 10.20.193.96:0/810265808 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f562c10f200 0x7f562c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:38.616 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.613+0000 7f56347446c0 1 -- 10.20.193.96:0/810265808 >> 10.20.193.96:0/810265808 conn(0x7f562c0ecb00 msgr2=0x7f562c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:38.616 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.613+0000 7f56347446c0 1 -- 10.20.193.96:0/810265808 shutdown_connections 2026-02-13T03:36:38.617 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.613+0000 7f56347446c0 1 -- 10.20.193.96:0/810265808 wait complete. 2026-02-13T03:36:38.617 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.613+0000 7f56347446c0 1 Processor -- start 2026-02-13T03:36:38.617 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.613+0000 7f56347446c0 1 -- start start 2026-02-13T03:36:38.617 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.613+0000 7f56347446c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f562c10f200 0x7f562c0f4be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:38.617 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.613+0000 7f56347446c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f562c115410 0x7f562c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:38.617 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.613+0000 7f56347446c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f562c0f5210 0x7f562c0fa4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:38.617 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.613+0000 7f56347446c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f562c0f5900 con 0x7f562c115410 2026-02-13T03:36:38.617 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.613+0000 7f56347446c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f562c0faa20 con 0x7f562c0f5210 2026-02-13T03:36:38.617 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.613+0000 7f56347446c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f562c0fabe0 con 0x7f562c10f200 2026-02-13T03:36:38.617 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.614+0000 7f5631cb46c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f562c115410 0x7f562c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:38.617 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.614+0000 7f5631cb46c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f562c115410 0x7f562c175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:55402/0 (socket says 10.20.193.96:55402) 2026-02-13T03:36:38.617 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.614+0000 7f5631cb46c0 1 -- 10.20.193.96:0/3360665635 learned_addr learned my addr 10.20.193.96:0/3360665635 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:36:38.617 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.614+0000 7f56324b56c0 1 --2- 10.20.193.96:0/3360665635 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f562c10f200 0x7f562c0f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:38.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.614+0000 7f5632cb66c0 1 --2- 10.20.193.96:0/3360665635 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f562c0f5210 0x7f562c0fa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:38.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.614+0000 7f5631cb46c0 1 -- 10.20.193.96:0/3360665635 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f562c10f200 msgr2=0x7f562c0f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:38.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.614+0000 7f5631cb46c0 1 --2- 10.20.193.96:0/3360665635 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f562c10f200 0x7f562c0f4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:38.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.614+0000 7f5631cb46c0 1 -- 10.20.193.96:0/3360665635 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f562c0f5210 msgr2=0x7f562c0fa4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:38.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.614+0000 7f5631cb46c0 1 --2- 10.20.193.96:0/3360665635 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f562c0f5210 0x7f562c0fa4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:38.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.614+0000 7f5631cb46c0 1 -- 10.20.193.96:0/3360665635 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5620009590 con 0x7f562c115410 2026-02-13T03:36:38.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.614+0000 7f5631cb46c0 1 --2- 10.20.193.96:0/3360665635 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f562c115410 0x7f562c175cb0 secure :-1 s=READY pgs=400 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f562002f230 tx=0x7f562002fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:38.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.614+0000 7f56137fe6c0 1 -- 10.20.193.96:0/3360665635 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5620002ae0 con 0x7f562c115410 2026-02-13T03:36:38.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.614+0000 7f56137fe6c0 1 -- 10.20.193.96:0/3360665635 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f5620002c40 con 0x7f562c115410 2026-02-13T03:36:38.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.614+0000 7f56347446c0 1 -- 10.20.193.96:0/3360665635 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f562c0fae60 con 0x7f562c115410 2026-02-13T03:36:38.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.614+0000 7f56137fe6c0 1 -- 10.20.193.96:0/3360665635 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56200312b0 con 0x7f562c115410 2026-02-13T03:36:38.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.614+0000 7f56347446c0 1 -- 10.20.193.96:0/3360665635 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f562c0fb330 con 0x7f562c115410 2026-02-13T03:36:38.618 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.614+0000 7f56347446c0 1 -- 10.20.193.96:0/3360665635 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f562c1104d0 con 0x7f562c115410 2026-02-13T03:36:38.619 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.616+0000 7f56137fe6c0 1 -- 10.20.193.96:0/3360665635 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f5620007980 con 0x7f562c115410 2026-02-13T03:36:38.619 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.616+0000 7f56137fe6c0 1 --2- 10.20.193.96:0/3360665635 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f56080b5680 0x7f56080d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:38.619 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.616+0000 7f56137fe6c0 1 -- 10.20.193.96:0/3360665635 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f5620107b70 con 0x7f562c115410 2026-02-13T03:36:38.620 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.616+0000 7f56324b56c0 1 --2- 10.20.193.96:0/3360665635 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f56080b5680 0x7f56080d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:38.620 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.617+0000 7f56137fe6c0 1 -- 10.20.193.96:0/3360665635 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f56200ca610 con 0x7f562c115410 2026-02-13T03:36:38.620 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.617+0000 7f56324b56c0 1 --2- 10.20.193.96:0/3360665635 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f56080b5680 0x7f56080d5b30 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f561c005980 tx=0x7f561c005ee0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:38.734 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.730+0000 7f56347446c0 1 -- 10.20.193.96:0/3360665635 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f562c10f5d0 con 0x7f562c115410 2026-02-13T03:36:38.734 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.730+0000 7f56137fe6c0 1 -- 10.20.193.96:0/3360665635 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f5620005c00 con 0x7f562c115410 2026-02-13T03:36:38.734 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:36:38.734 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:36:38.735 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.731+0000 7f56347446c0 1 -- 10.20.193.96:0/3360665635 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f56080b5680 msgr2=0x7f56080d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:38.736 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.731+0000 7f56347446c0 1 --2- 10.20.193.96:0/3360665635 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f56080b5680 0x7f56080d5b30 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f561c005980 tx=0x7f561c005ee0 comp rx=0 tx=0).stop 2026-02-13T03:36:38.736 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.731+0000 7f56347446c0 1 -- 10.20.193.96:0/3360665635 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f562c115410 msgr2=0x7f562c175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:38.736 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.731+0000 7f56347446c0 1 --2- 10.20.193.96:0/3360665635 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f562c115410 0x7f562c175cb0 secure :-1 s=READY pgs=400 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f562002f230 tx=0x7f562002fc60 comp rx=0 tx=0).stop 2026-02-13T03:36:38.736 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.731+0000 7f56347446c0 1 -- 10.20.193.96:0/3360665635 shutdown_connections 2026-02-13T03:36:38.736 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.731+0000 7f56347446c0 1 --2- 10.20.193.96:0/3360665635 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f56080b5680 0x7f56080d5b30 unknown :-1 s=CLOSED pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:38.736 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.731+0000 7f56347446c0 1 --2- 10.20.193.96:0/3360665635 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f562c0f5210 0x7f562c0fa4e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:38.736 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.731+0000 7f56347446c0 1 --2- 10.20.193.96:0/3360665635 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f562c115410 0x7f562c175cb0 unknown :-1 s=CLOSED pgs=400 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:38.736 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.731+0000 7f56347446c0 1 --2- 10.20.193.96:0/3360665635 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f562c10f200 0x7f562c0f4be0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:38.736 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.731+0000 7f56347446c0 1 -- 10.20.193.96:0/3360665635 >> 10.20.193.96:0/3360665635 conn(0x7f562c0ecb00 msgr2=0x7f562c10d820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:38.736 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.731+0000 7f56347446c0 1 -- 10.20.193.96:0/3360665635 shutdown_connections 2026-02-13T03:36:38.736 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:38.731+0000 7f56347446c0 1 -- 10.20.193.96:0/3360665635 wait complete. 2026-02-13T03:36:39.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:38 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3360665635' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:39.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:38 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3360665635' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:39.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:38 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3360665635' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:40.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:39 trial132 ceph-mon[26888]: pgmap v261: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:36:40.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:39 trial133 ceph-mon[26943]: pgmap v261: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:36:40.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:39 trial096 ceph-mon[24671]: pgmap v261: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:36:41.777 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:36:41.895 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:36:42.008 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6319c6b6c0 1 -- 10.20.193.96:0/231445387 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f631410bd00 msgr2=0x7f6314175a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:42.008 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6319c6b6c0 1 --2- 10.20.193.96:0/231445387 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f631410bd00 0x7f6314175a70 secure :-1 s=READY pgs=401 gs=1 cs=0 l=1 c_cookie=6506346614438724723 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f630800aa40 tx=0x7f630802fde0 comp rx=0 tx=0).stop 2026-02-13T03:36:42.008 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6319c6b6c0 1 -- 10.20.193.96:0/231445387 shutdown_connections 2026-02-13T03:36:42.008 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6319c6b6c0 1 --2- 10.20.193.96:0/231445387 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f631410bd00 0x7f6314175a70 unknown :-1 s=CLOSED pgs=401 gs=1 cs=0 l=1 c_cookie=6506346614438724723 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:42.008 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6319c6b6c0 1 --2- 10.20.193.96:0/231445387 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f631410b120 0x7f631410b550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:42.008 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6319c6b6c0 1 --2- 10.20.193.96:0/231445387 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f631410dad0 0x7f631410dea0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:42.008 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6319c6b6c0 1 -- 10.20.193.96:0/231445387 >> 10.20.193.96:0/231445387 conn(0x7f6314062e00 msgr2=0x7f6314109660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:42.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6319c6b6c0 1 -- 10.20.193.96:0/231445387 shutdown_connections 2026-02-13T03:36:42.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6319c6b6c0 1 -- 10.20.193.96:0/231445387 wait complete. 2026-02-13T03:36:42.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6319c6b6c0 1 Processor -- start 2026-02-13T03:36:42.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6319c6b6c0 1 -- start start 2026-02-13T03:36:42.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6319c6b6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f631410b120 0x7f63140f5120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:42.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6319c6b6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f631410bd00 0x7f63140f5660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:42.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6319c6b6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f631410dad0 0x7f63140faa20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:42.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6319c6b6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f63140fafe0 con 0x7f631410bd00 2026-02-13T03:36:42.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6319c6b6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f63140fb150 con 0x7f631410dad0 2026-02-13T03:36:42.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6319c6b6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f63140fb310 con 0x7f631410b120 2026-02-13T03:36:42.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6312ffd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f631410bd00 0x7f63140f5660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:42.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6312ffd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f631410bd00 0x7f63140f5660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:55418/0 (socket says 10.20.193.96:55418) 2026-02-13T03:36:42.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6312ffd6c0 1 -- 10.20.193.96:0/985875032 learned_addr learned my addr 10.20.193.96:0/985875032 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:36:42.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6312ffd6c0 1 -- 10.20.193.96:0/985875032 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f631410b120 msgr2=0x7f63140f5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:42.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6312ffd6c0 1 --2- 10.20.193.96:0/985875032 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f631410b120 0x7f63140f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:42.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6312ffd6c0 1 -- 10.20.193.96:0/985875032 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f631410dad0 msgr2=0x7f63140faa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:42.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6312ffd6c0 1 --2- 10.20.193.96:0/985875032 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f631410dad0 0x7f63140faa20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:42.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.005+0000 7f6312ffd6c0 1 -- 10.20.193.96:0/985875032 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f630800a660 con 0x7f631410bd00 2026-02-13T03:36:42.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.006+0000 7f6312ffd6c0 1 --2- 10.20.193.96:0/985875032 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f631410bd00 0x7f63140f5660 secure :-1 s=READY pgs=402 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6304009490 tx=0x7f630400bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:42.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.006+0000 7f6310ff96c0 1 -- 10.20.193.96:0/985875032 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6304004a80 con 0x7f631410bd00 2026-02-13T03:36:42.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.006+0000 7f6319c6b6c0 1 -- 10.20.193.96:0/985875032 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63140fb5f0 con 0x7f631410bd00 2026-02-13T03:36:42.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.006+0000 7f6310ff96c0 1 -- 10.20.193.96:0/985875032 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f6304009030 con 0x7f631410bd00 2026-02-13T03:36:42.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.006+0000 7f6310ff96c0 1 -- 10.20.193.96:0/985875032 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f630400cea0 con 0x7f631410bd00 2026-02-13T03:36:42.009 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.006+0000 7f6319c6b6c0 1 -- 10.20.193.96:0/985875032 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6314172bf0 con 0x7f631410bd00 2026-02-13T03:36:42.010 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.006+0000 7f6319c6b6c0 1 -- 10.20.193.96:0/985875032 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f631410c130 con 0x7f631410bd00 2026-02-13T03:36:42.011 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.008+0000 7f6310ff96c0 1 -- 10.20.193.96:0/985875032 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f6304004060 con 0x7f631410bd00 2026-02-13T03:36:42.011 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.008+0000 7f6310ff96c0 1 --2- 10.20.193.96:0/985875032 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f62e80b5680 0x7f62e80d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:42.012 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.008+0000 7f63137fe6c0 1 --2- 10.20.193.96:0/985875032 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f62e80b5680 0x7f62e80d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:42.012 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.009+0000 7f6310ff96c0 1 -- 10.20.193.96:0/985875032 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f63040e3ad0 con 0x7f631410bd00 2026-02-13T03:36:42.012 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.009+0000 7f63137fe6c0 1 --2- 10.20.193.96:0/985875032 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f62e80b5680 0x7f62e80d5b30 secure :-1 s=READY pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6300004750 tx=0x7f6300005d30 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:42.012 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.009+0000 7f6310ff96c0 1 -- 10.20.193.96:0/985875032 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f630411c5e0 con 0x7f631410bd00 2026-02-13T03:36:42.129 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.126+0000 7f6319c6b6c0 1 -- 10.20.193.96:0/985875032 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f631410dea0 con 0x7f631410bd00 2026-02-13T03:36:42.129 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:41 trial096 ceph-mon[24671]: pgmap v262: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:36:42.129 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.126+0000 7f6310ff96c0 1 -- 10.20.193.96:0/985875032 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f63040a6530 con 0x7f631410bd00 2026-02-13T03:36:42.129 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:36:42.129 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:36:42.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.127+0000 7f6319c6b6c0 1 -- 10.20.193.96:0/985875032 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f62e80b5680 msgr2=0x7f62e80d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:42.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.127+0000 7f6319c6b6c0 1 --2- 10.20.193.96:0/985875032 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f62e80b5680 0x7f62e80d5b30 secure :-1 s=READY pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6300004750 tx=0x7f6300005d30 comp rx=0 tx=0).stop 2026-02-13T03:36:42.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.127+0000 7f6319c6b6c0 1 -- 10.20.193.96:0/985875032 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f631410bd00 msgr2=0x7f63140f5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:42.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.127+0000 7f6319c6b6c0 1 --2- 10.20.193.96:0/985875032 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f631410bd00 0x7f63140f5660 secure :-1 s=READY pgs=402 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6304009490 tx=0x7f630400bca0 comp rx=0 tx=0).stop 2026-02-13T03:36:42.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.127+0000 7f6319c6b6c0 1 -- 10.20.193.96:0/985875032 shutdown_connections 2026-02-13T03:36:42.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.127+0000 7f6319c6b6c0 1 --2- 10.20.193.96:0/985875032 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f62e80b5680 0x7f62e80d5b30 unknown :-1 s=CLOSED pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:42.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.127+0000 7f6319c6b6c0 1 --2- 10.20.193.96:0/985875032 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f631410dad0 0x7f63140faa20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:42.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.127+0000 7f6319c6b6c0 1 --2- 10.20.193.96:0/985875032 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f631410bd00 0x7f63140f5660 unknown :-1 s=CLOSED pgs=402 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:42.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.127+0000 7f6319c6b6c0 1 --2- 10.20.193.96:0/985875032 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f631410b120 0x7f63140f5120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:42.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.127+0000 7f6319c6b6c0 1 -- 10.20.193.96:0/985875032 >> 10.20.193.96:0/985875032 conn(0x7f6314062e00 msgr2=0x7f63140efa00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:42.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.127+0000 7f6319c6b6c0 1 -- 10.20.193.96:0/985875032 shutdown_connections 2026-02-13T03:36:42.131 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:42.127+0000 7f6319c6b6c0 1 -- 10.20.193.96:0/985875032 wait complete. 2026-02-13T03:36:42.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:41 trial132 ceph-mon[26888]: pgmap v262: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:36:42.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:41 trial133 ceph-mon[26943]: pgmap v262: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:36:43.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:42 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/985875032' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:43.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:42 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/985875032' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:43.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:42 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/985875032' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:44.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:43 trial132 ceph-mon[26888]: pgmap v263: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:36:44.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:43 trial133 ceph-mon[26943]: pgmap v263: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:36:44.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:43 trial096 ceph-mon[24671]: pgmap v263: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:36:45.171 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:36:45.293 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:36:45.409 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.403+0000 7fdce517c6c0 1 -- 10.20.193.96:0/1141324298 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdce010f200 msgr2=0x7fdce010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:45.409 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.403+0000 7fdce517c6c0 1 --2- 10.20.193.96:0/1141324298 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdce010f200 0x7fdce010f5d0 secure :-1 s=READY pgs=403 gs=1 cs=0 l=1 c_cookie=5478801511549946416 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcd40099a0 tx=0x7fdcd402ed20 comp rx=0 tx=0).stop 2026-02-13T03:36:45.409 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.403+0000 7fdce517c6c0 1 -- 10.20.193.96:0/1141324298 shutdown_connections 2026-02-13T03:36:45.409 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.403+0000 7fdce517c6c0 1 --2- 10.20.193.96:0/1141324298 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fdce0115410 0x7fdce0175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:45.409 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.403+0000 7fdce517c6c0 1 --2- 10.20.193.96:0/1141324298 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fdce010fbf0 0x7fdce0114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:45.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.403+0000 7fdce517c6c0 1 --2- 10.20.193.96:0/1141324298 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdce010f200 0x7fdce010f5d0 unknown :-1 s=CLOSED pgs=403 gs=1 cs=0 l=1 c_cookie=5478801511549946416 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:45.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.403+0000 7fdce517c6c0 1 -- 10.20.193.96:0/1141324298 >> 10.20.193.96:0/1141324298 conn(0x7fdce00ecb00 msgr2=0x7fdce010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:45.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.403+0000 7fdce517c6c0 1 -- 10.20.193.96:0/1141324298 shutdown_connections 2026-02-13T03:36:45.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.403+0000 7fdce517c6c0 1 -- 10.20.193.96:0/1141324298 wait complete. 2026-02-13T03:36:45.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.404+0000 7fdce517c6c0 1 Processor -- start 2026-02-13T03:36:45.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.404+0000 7fdce517c6c0 1 -- start start 2026-02-13T03:36:45.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.404+0000 7fdce517c6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fdce010f200 0x7fdce011d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:45.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.404+0000 7fdce517c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdce0115410 0x7fdce011d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:45.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.404+0000 7fdce517c6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fdce0122b50 0x7fdce0122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:45.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.404+0000 7fdce517c6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fdce0123560 con 0x7fdce0115410 2026-02-13T03:36:45.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.404+0000 7fdce517c6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fdce01236d0 con 0x7fdce010f200 2026-02-13T03:36:45.410 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.404+0000 7fdce517c6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fdce0123890 con 0x7fdce0122b50 2026-02-13T03:36:45.411 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.404+0000 7fdcde5756c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdce0115410 0x7fdce011d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:45.411 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.404+0000 7fdcde5756c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdce0115410 0x7fdce011d790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:44504/0 (socket says 10.20.193.96:44504) 2026-02-13T03:36:45.411 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.404+0000 7fdcde5756c0 1 -- 10.20.193.96:0/3452405469 learned_addr learned my addr 10.20.193.96:0/3452405469 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:36:45.411 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.404+0000 7fdcded766c0 1 --2- 10.20.193.96:0/3452405469 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fdce010f200 0x7fdce011d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:45.411 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.404+0000 7fdcdf5776c0 1 --2- 10.20.193.96:0/3452405469 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fdce0122b50 0x7fdce0122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:45.411 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.404+0000 7fdcde5756c0 1 -- 10.20.193.96:0/3452405469 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fdce0122b50 msgr2=0x7fdce0122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:45.411 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.404+0000 7fdcde5756c0 1 --2- 10.20.193.96:0/3452405469 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fdce0122b50 0x7fdce0122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:45.411 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.404+0000 7fdcde5756c0 1 -- 10.20.193.96:0/3452405469 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fdce010f200 msgr2=0x7fdce011d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:45.411 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.404+0000 7fdcde5756c0 1 --2- 10.20.193.96:0/3452405469 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fdce010f200 0x7fdce011d250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:45.411 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.404+0000 7fdcde5756c0 1 -- 10.20.193.96:0/3452405469 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd4009590 con 0x7fdce0115410 2026-02-13T03:36:45.411 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.404+0000 7fdcde5756c0 1 --2- 10.20.193.96:0/3452405469 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdce0115410 0x7fdce011d790 secure :-1 s=READY pgs=404 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcc8005dc0 tx=0x7fdcc800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:45.411 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.404+0000 7fdcbffff6c0 1 -- 10.20.193.96:0/3452405469 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcc8004250 con 0x7fdce0115410 2026-02-13T03:36:45.412 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.404+0000 7fdcbffff6c0 1 -- 10.20.193.96:0/3452405469 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fdcc8009070 con 0x7fdce0115410 2026-02-13T03:36:45.412 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.404+0000 7fdce517c6c0 1 -- 10.20.193.96:0/3452405469 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdce0163d40 con 0x7fdce0115410 2026-02-13T03:36:45.412 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.404+0000 7fdcbffff6c0 1 -- 10.20.193.96:0/3452405469 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcc800cdb0 con 0x7fdce0115410 2026-02-13T03:36:45.412 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.404+0000 7fdce517c6c0 1 -- 10.20.193.96:0/3452405469 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdce0164220 con 0x7fdce0115410 2026-02-13T03:36:45.412 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.405+0000 7fdce517c6c0 1 -- 10.20.193.96:0/3452405469 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdce01104d0 con 0x7fdce0115410 2026-02-13T03:36:45.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.406+0000 7fdcbffff6c0 1 -- 10.20.193.96:0/3452405469 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fdcc80028c0 con 0x7fdce0115410 2026-02-13T03:36:45.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.407+0000 7fdcbffff6c0 1 --2- 10.20.193.96:0/3452405469 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fdcb40b5680 0x7fdcb40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:45.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.407+0000 7fdcded766c0 1 --2- 10.20.193.96:0/3452405469 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fdcb40b5680 0x7fdcb40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:45.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.407+0000 7fdcbffff6c0 1 -- 10.20.193.96:0/3452405469 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7fdcc80e3a60 con 0x7fdce0115410 2026-02-13T03:36:45.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.407+0000 7fdcded766c0 1 --2- 10.20.193.96:0/3452405469 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fdcb40b5680 0x7fdcb40d5b30 secure :-1 s=READY pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcd40023e0 tx=0x7fdcd4009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:45.413 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.407+0000 7fdcbffff6c0 1 -- 10.20.193.96:0/3452405469 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdcc80a9f20 con 0x7fdce0115410 2026-02-13T03:36:45.525 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.521+0000 7fdce517c6c0 1 -- 10.20.193.96:0/3452405469 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdce010f5d0 con 0x7fdce0115410 2026-02-13T03:36:45.525 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.521+0000 7fdcbffff6c0 1 -- 10.20.193.96:0/3452405469 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fdcc80704f0 con 0x7fdce0115410 2026-02-13T03:36:45.525 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:36:45.526 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:36:45.526 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.522+0000 7fdce517c6c0 1 -- 10.20.193.96:0/3452405469 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fdcb40b5680 msgr2=0x7fdcb40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:45.527 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.522+0000 7fdce517c6c0 1 --2- 10.20.193.96:0/3452405469 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fdcb40b5680 0x7fdcb40d5b30 secure :-1 s=READY pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcd40023e0 tx=0x7fdcd4009260 comp rx=0 tx=0).stop 2026-02-13T03:36:45.527 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.522+0000 7fdce517c6c0 1 -- 10.20.193.96:0/3452405469 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdce0115410 msgr2=0x7fdce011d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:45.527 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.522+0000 7fdce517c6c0 1 --2- 10.20.193.96:0/3452405469 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdce0115410 0x7fdce011d790 secure :-1 s=READY pgs=404 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcc8005dc0 tx=0x7fdcc800bbb0 comp rx=0 tx=0).stop 2026-02-13T03:36:45.527 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.522+0000 7fdce517c6c0 1 -- 10.20.193.96:0/3452405469 shutdown_connections 2026-02-13T03:36:45.527 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.522+0000 7fdce517c6c0 1 --2- 10.20.193.96:0/3452405469 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fdcb40b5680 0x7fdcb40d5b30 unknown :-1 s=CLOSED pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:45.527 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.522+0000 7fdce517c6c0 1 --2- 10.20.193.96:0/3452405469 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fdce0122b50 0x7fdce0122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:45.527 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.522+0000 7fdce517c6c0 1 --2- 10.20.193.96:0/3452405469 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fdce0115410 0x7fdce011d790 unknown :-1 s=CLOSED pgs=404 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:45.527 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.522+0000 7fdce517c6c0 1 --2- 10.20.193.96:0/3452405469 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fdce010f200 0x7fdce011d250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:45.527 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.522+0000 7fdce517c6c0 1 -- 10.20.193.96:0/3452405469 >> 10.20.193.96:0/3452405469 conn(0x7fdce00ecb00 msgr2=0x7fdce010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:45.527 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.522+0000 7fdce517c6c0 1 -- 10.20.193.96:0/3452405469 shutdown_connections 2026-02-13T03:36:45.528 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:45.522+0000 7fdce517c6c0 1 -- 10.20.193.96:0/3452405469 wait complete. 2026-02-13T03:36:46.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:45 trial132 ceph-mon[26888]: pgmap v264: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:36:46.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:45 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3452405469' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:46.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:45 trial133 ceph-mon[26943]: pgmap v264: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:36:46.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:45 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3452405469' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:46.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:45 trial096 ceph-mon[24671]: pgmap v264: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:36:46.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:45 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3452405469' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:48.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:47 trial132 ceph-mon[26888]: pgmap v265: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:36:48.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:47 trial133 ceph-mon[26943]: pgmap v265: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:36:48.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:47 trial096 ceph-mon[24671]: pgmap v265: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:36:48.566 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:36:48.684 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:36:48.805 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.800+0000 7eff72a506c0 1 -- 10.20.193.96:0/2917723852 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7eff6c10f200 msgr2=0x7eff6c10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:48.805 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.800+0000 7eff72a506c0 1 --2- 10.20.193.96:0/2917723852 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7eff6c10f200 0x7eff6c10f5d0 secure :-1 s=READY pgs=405 gs=1 cs=0 l=1 c_cookie=16255040744718790813 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff580099a0 tx=0x7eff5802ed20 comp rx=0 tx=0).stop 2026-02-13T03:36:48.806 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.800+0000 7eff72a506c0 1 -- 10.20.193.96:0/2917723852 shutdown_connections 2026-02-13T03:36:48.806 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.800+0000 7eff72a506c0 1 --2- 10.20.193.96:0/2917723852 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7eff6c115410 0x7eff6c175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:48.806 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.800+0000 7eff72a506c0 1 --2- 10.20.193.96:0/2917723852 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7eff6c10fbf0 0x7eff6c114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:48.806 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.800+0000 7eff72a506c0 1 --2- 10.20.193.96:0/2917723852 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7eff6c10f200 0x7eff6c10f5d0 unknown :-1 s=CLOSED pgs=405 gs=1 cs=0 l=1 c_cookie=16255040744718790813 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:48.806 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.800+0000 7eff72a506c0 1 -- 10.20.193.96:0/2917723852 >> 10.20.193.96:0/2917723852 conn(0x7eff6c0ecb00 msgr2=0x7eff6c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:48.806 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.800+0000 7eff72a506c0 1 -- 10.20.193.96:0/2917723852 shutdown_connections 2026-02-13T03:36:48.806 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.800+0000 7eff72a506c0 1 -- 10.20.193.96:0/2917723852 wait complete. 2026-02-13T03:36:48.806 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.800+0000 7eff72a506c0 1 Processor -- start 2026-02-13T03:36:48.806 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.800+0000 7eff72a506c0 1 -- start start 2026-02-13T03:36:48.806 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.800+0000 7eff72a506c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7eff6c10f200 0x7eff6c11d1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:48.806 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.800+0000 7eff72a506c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7eff6c115410 0x7eff6c11d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:48.807 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.800+0000 7eff72a506c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7eff6c122af0 0x7eff6c122f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:48.807 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.800+0000 7eff72a506c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7eff6c123500 con 0x7eff6c122af0 2026-02-13T03:36:48.807 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.800+0000 7eff72a506c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7eff6c123670 con 0x7eff6c10f200 2026-02-13T03:36:48.807 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.800+0000 7eff72a506c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7eff6c123830 con 0x7eff6c115410 2026-02-13T03:36:48.807 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.801+0000 7eff70fc66c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7eff6c122af0 0x7eff6c122f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:48.807 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.801+0000 7eff70fc66c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7eff6c122af0 0x7eff6c122f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:44528/0 (socket says 10.20.193.96:44528) 2026-02-13T03:36:48.807 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.801+0000 7eff70fc66c0 1 -- 10.20.193.96:0/1622172210 learned_addr learned my addr 10.20.193.96:0/1622172210 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:36:48.807 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.801+0000 7eff70fc66c0 1 -- 10.20.193.96:0/1622172210 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7eff6c115410 msgr2=0x7eff6c11d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:48.807 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.801+0000 7eff6bfff6c0 1 --2- 10.20.193.96:0/1622172210 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7eff6c10f200 0x7eff6c11d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:48.807 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.801+0000 7eff70fc66c0 1 --2- 10.20.193.96:0/1622172210 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7eff6c115410 0x7eff6c11d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:48.807 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.801+0000 7eff70fc66c0 1 -- 10.20.193.96:0/1622172210 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7eff6c10f200 msgr2=0x7eff6c11d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:48.808 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.801+0000 7eff70fc66c0 1 --2- 10.20.193.96:0/1622172210 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7eff6c10f200 0x7eff6c11d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:48.808 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.801+0000 7eff70fc66c0 1 -- 10.20.193.96:0/1622172210 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff58009590 con 0x7eff6c122af0 2026-02-13T03:36:48.808 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.801+0000 7eff6bfff6c0 1 --2- 10.20.193.96:0/1622172210 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7eff6c10f200 0x7eff6c11d1f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:36:48.808 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.801+0000 7eff70fc66c0 1 --2- 10.20.193.96:0/1622172210 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7eff6c122af0 0x7eff6c122f90 secure :-1 s=READY pgs=406 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff60006ea0 tx=0x7eff6000ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:48.808 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.801+0000 7eff697fa6c0 1 -- 10.20.193.96:0/1622172210 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7eff60003c40 con 0x7eff6c122af0 2026-02-13T03:36:48.808 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.801+0000 7eff697fa6c0 1 -- 10.20.193.96:0/1622172210 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7eff60003da0 con 0x7eff6c122af0 2026-02-13T03:36:48.808 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.801+0000 7eff72a506c0 1 -- 10.20.193.96:0/1622172210 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff6c163ce0 con 0x7eff6c122af0 2026-02-13T03:36:48.808 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.801+0000 7eff697fa6c0 1 -- 10.20.193.96:0/1622172210 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7eff600081c0 con 0x7eff6c122af0 2026-02-13T03:36:48.808 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.801+0000 7eff72a506c0 1 -- 10.20.193.96:0/1622172210 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff6c1641c0 con 0x7eff6c122af0 2026-02-13T03:36:48.808 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.801+0000 7eff72a506c0 1 -- 10.20.193.96:0/1622172210 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff6c1104d0 con 0x7eff6c122af0 2026-02-13T03:36:48.809 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.803+0000 7eff697fa6c0 1 -- 10.20.193.96:0/1622172210 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7eff60005860 con 0x7eff6c122af0 2026-02-13T03:36:48.809 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.803+0000 7eff697fa6c0 1 --2- 10.20.193.96:0/1622172210 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7eff400b5680 0x7eff400d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:48.810 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.803+0000 7eff6bfff6c0 1 --2- 10.20.193.96:0/1622172210 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7eff400b5680 0x7eff400d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:48.810 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.803+0000 7eff697fa6c0 1 -- 10.20.193.96:0/1622172210 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7eff600e4ac0 con 0x7eff6c122af0 2026-02-13T03:36:48.810 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.804+0000 7eff6bfff6c0 1 --2- 10.20.193.96:0/1622172210 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7eff400b5680 0x7eff400d5b30 secure :-1 s=READY pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff58009970 tx=0x7eff580023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:48.810 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.804+0000 7eff697fa6c0 1 -- 10.20.193.96:0/1622172210 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7eff600a7560 con 0x7eff6c122af0 2026-02-13T03:36:48.921 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.917+0000 7eff72a506c0 1 -- 10.20.193.96:0/1622172210 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7eff6c10f5d0 con 0x7eff6c122af0 2026-02-13T03:36:48.921 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.918+0000 7eff697fa6c0 1 -- 10.20.193.96:0/1622172210 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7eff600aa710 con 0x7eff6c122af0 2026-02-13T03:36:48.921 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:36:48.922 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:36:48.923 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.919+0000 7eff72a506c0 1 -- 10.20.193.96:0/1622172210 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7eff400b5680 msgr2=0x7eff400d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:48.923 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.919+0000 7eff72a506c0 1 --2- 10.20.193.96:0/1622172210 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7eff400b5680 0x7eff400d5b30 secure :-1 s=READY pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff58009970 tx=0x7eff580023a0 comp rx=0 tx=0).stop 2026-02-13T03:36:48.923 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.919+0000 7eff72a506c0 1 -- 10.20.193.96:0/1622172210 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7eff6c122af0 msgr2=0x7eff6c122f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:48.923 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.919+0000 7eff72a506c0 1 --2- 10.20.193.96:0/1622172210 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7eff6c122af0 0x7eff6c122f90 secure :-1 s=READY pgs=406 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff60006ea0 tx=0x7eff6000ce50 comp rx=0 tx=0).stop 2026-02-13T03:36:48.923 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.919+0000 7eff72a506c0 1 -- 10.20.193.96:0/1622172210 shutdown_connections 2026-02-13T03:36:48.923 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.919+0000 7eff72a506c0 1 --2- 10.20.193.96:0/1622172210 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7eff400b5680 0x7eff400d5b30 unknown :-1 s=CLOSED pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:48.923 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.919+0000 7eff72a506c0 1 --2- 10.20.193.96:0/1622172210 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7eff6c122af0 0x7eff6c122f90 unknown :-1 s=CLOSED pgs=406 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:48.923 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.919+0000 7eff72a506c0 1 --2- 10.20.193.96:0/1622172210 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7eff6c115410 0x7eff6c11d730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:48.923 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.919+0000 7eff72a506c0 1 --2- 10.20.193.96:0/1622172210 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7eff6c10f200 0x7eff6c11d1f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:48.924 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.919+0000 7eff72a506c0 1 -- 10.20.193.96:0/1622172210 >> 10.20.193.96:0/1622172210 conn(0x7eff6c0ecb00 msgr2=0x7eff6c10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:48.924 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.919+0000 7eff72a506c0 1 -- 10.20.193.96:0/1622172210 shutdown_connections 2026-02-13T03:36:48.924 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:48.919+0000 7eff72a506c0 1 -- 10.20.193.96:0/1622172210 wait complete. 2026-02-13T03:36:49.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:48 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1622172210' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:49.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:48 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1622172210' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:49.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:48 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1622172210' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:50.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:49 trial132 ceph-mon[26888]: pgmap v266: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:36:50.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:49 trial133 ceph-mon[26943]: pgmap v266: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:36:50.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:49 trial096 ceph-mon[24671]: pgmap v266: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:36:51.964 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:36:52.082 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:36:52.200 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.196+0000 7f7eff0306c0 1 -- 10.20.193.96:0/441101078 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7ef8115410 msgr2=0x7f7ef8175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:52.200 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.196+0000 7f7eff0306c0 1 --2- 10.20.193.96:0/441101078 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7ef8115410 0x7f7ef8175db0 secure :-1 s=READY pgs=407 gs=1 cs=0 l=1 c_cookie=16769351409310474733 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ef400aa70 tx=0x7f7ef402fde0 comp rx=0 tx=0).stop 2026-02-13T03:36:52.200 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.196+0000 7f7eff0306c0 1 -- 10.20.193.96:0/441101078 shutdown_connections 2026-02-13T03:36:52.201 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.196+0000 7f7eff0306c0 1 --2- 10.20.193.96:0/441101078 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7ef8115410 0x7f7ef8175db0 unknown :-1 s=CLOSED pgs=407 gs=1 cs=0 l=1 c_cookie=16769351409310474733 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:52.201 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.196+0000 7f7eff0306c0 1 --2- 10.20.193.96:0/441101078 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7ef810fbf0 0x7f7ef8114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:52.201 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.196+0000 7f7eff0306c0 1 --2- 10.20.193.96:0/441101078 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7ef810f200 0x7f7ef810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:52.201 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.196+0000 7f7eff0306c0 1 -- 10.20.193.96:0/441101078 >> 10.20.193.96:0/441101078 conn(0x7f7ef80ecb00 msgr2=0x7f7ef810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:52.201 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.196+0000 7f7eff0306c0 1 -- 10.20.193.96:0/441101078 shutdown_connections 2026-02-13T03:36:52.201 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.196+0000 7f7eff0306c0 1 -- 10.20.193.96:0/441101078 wait complete. 2026-02-13T03:36:52.201 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:51 trial096 ceph-mon[24671]: pgmap v267: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:36:52.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.197+0000 7f7eff0306c0 1 Processor -- start 2026-02-13T03:36:52.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.197+0000 7f7eff0306c0 1 -- start start 2026-02-13T03:36:52.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.197+0000 7f7eff0306c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7ef810f200 0x7f7ef811d100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:52.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.197+0000 7f7eff0306c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7ef8115410 0x7f7ef811d640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:52.204 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.197+0000 7f7eff0306c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7ef8122a00 0x7f7ef8122ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:52.205 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.197+0000 7f7eff0306c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef8123410 con 0x7f7ef8122a00 2026-02-13T03:36:52.205 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.197+0000 7f7eff0306c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef8123580 con 0x7f7ef810f200 2026-02-13T03:36:52.205 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.197+0000 7f7eff0306c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef8123740 con 0x7f7ef8115410 2026-02-13T03:36:52.205 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.197+0000 7f7efd5a26c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7ef8122a00 0x7f7ef8122ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:52.205 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.197+0000 7f7efd5a26c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7ef8122a00 0x7f7ef8122ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:44552/0 (socket says 10.20.193.96:44552) 2026-02-13T03:36:52.205 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.197+0000 7f7efd5a26c0 1 -- 10.20.193.96:0/3402241113 learned_addr learned my addr 10.20.193.96:0/3402241113 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:36:52.205 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.197+0000 7f7eeffff6c0 1 --2- 10.20.193.96:0/3402241113 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7ef8115410 0x7f7ef811d640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:52.205 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.197+0000 7f7efcda16c0 1 --2- 10.20.193.96:0/3402241113 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7ef810f200 0x7f7ef811d100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:52.205 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.197+0000 7f7efd5a26c0 1 -- 10.20.193.96:0/3402241113 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7ef8115410 msgr2=0x7f7ef811d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:52.205 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.197+0000 7f7efd5a26c0 1 --2- 10.20.193.96:0/3402241113 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7ef8115410 0x7f7ef811d640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:52.205 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.197+0000 7f7efd5a26c0 1 -- 10.20.193.96:0/3402241113 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7ef810f200 msgr2=0x7f7ef811d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:52.206 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.197+0000 7f7efd5a26c0 1 --2- 10.20.193.96:0/3402241113 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7ef810f200 0x7f7ef811d100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:52.206 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.197+0000 7f7efd5a26c0 1 -- 10.20.193.96:0/3402241113 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef400a660 con 0x7f7ef8122a00 2026-02-13T03:36:52.206 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.197+0000 7f7efd5a26c0 1 --2- 10.20.193.96:0/3402241113 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7ef8122a00 0x7f7ef8122ea0 secure :-1 s=READY pgs=408 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ef400ab70 tx=0x7f7ef40054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:52.206 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.197+0000 7f7eedffb6c0 1 -- 10.20.193.96:0/3402241113 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ef4030d10 con 0x7f7ef8122a00 2026-02-13T03:36:52.206 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.197+0000 7f7eedffb6c0 1 -- 10.20.193.96:0/3402241113 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f7ef4030e70 con 0x7f7ef8122a00 2026-02-13T03:36:52.206 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.197+0000 7f7eff0306c0 1 -- 10.20.193.96:0/3402241113 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ef8163b90 con 0x7f7ef8122a00 2026-02-13T03:36:52.206 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.197+0000 7f7eedffb6c0 1 -- 10.20.193.96:0/3402241113 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ef4032920 con 0x7f7ef8122a00 2026-02-13T03:36:52.206 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.197+0000 7f7eff0306c0 1 -- 10.20.193.96:0/3402241113 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ef8163fc0 con 0x7f7ef8122a00 2026-02-13T03:36:52.206 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.198+0000 7f7eff0306c0 1 -- 10.20.193.96:0/3402241113 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ef81104d0 con 0x7f7ef8122a00 2026-02-13T03:36:52.206 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.199+0000 7f7eedffb6c0 1 -- 10.20.193.96:0/3402241113 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f7ef4032030 con 0x7f7ef8122a00 2026-02-13T03:36:52.206 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.200+0000 7f7eedffb6c0 1 --2- 10.20.193.96:0/3402241113 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7ed40b5600 0x7f7ed40d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:52.206 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.200+0000 7f7efcda16c0 1 --2- 10.20.193.96:0/3402241113 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7ed40b5600 0x7f7ed40d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:52.206 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.200+0000 7f7eedffb6c0 1 -- 10.20.193.96:0/3402241113 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f7ef4108e60 con 0x7f7ef8122a00 2026-02-13T03:36:52.207 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.200+0000 7f7eedffb6c0 1 -- 10.20.193.96:0/3402241113 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7ef40ce890 con 0x7f7ef8122a00 2026-02-13T03:36:52.207 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.200+0000 7f7efcda16c0 1 --2- 10.20.193.96:0/3402241113 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7ed40b5600 0x7f7ed40d5ab0 secure :-1 s=READY pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ee8005980 tx=0x7f7ee8005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:52.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:51 trial132 ceph-mon[26888]: pgmap v267: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:36:52.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:51 trial133 ceph-mon[26943]: pgmap v267: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:36:52.319 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.315+0000 7f7eff0306c0 1 -- 10.20.193.96:0/3402241113 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7ef810f5d0 con 0x7f7ef8122a00 2026-02-13T03:36:52.319 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.315+0000 7f7eedffb6c0 1 -- 10.20.193.96:0/3402241113 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f7ef40cea70 con 0x7f7ef8122a00 2026-02-13T03:36:52.319 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:36:52.320 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:36:52.321 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.317+0000 7f7eff0306c0 1 -- 10.20.193.96:0/3402241113 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7ed40b5600 msgr2=0x7f7ed40d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:52.321 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.317+0000 7f7eff0306c0 1 --2- 10.20.193.96:0/3402241113 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7ed40b5600 0x7f7ed40d5ab0 secure :-1 s=READY pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ee8005980 tx=0x7f7ee8005910 comp rx=0 tx=0).stop 2026-02-13T03:36:52.321 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.317+0000 7f7eff0306c0 1 -- 10.20.193.96:0/3402241113 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7ef8122a00 msgr2=0x7f7ef8122ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:52.321 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.317+0000 7f7eff0306c0 1 --2- 10.20.193.96:0/3402241113 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7ef8122a00 0x7f7ef8122ea0 secure :-1 s=READY pgs=408 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ef400ab70 tx=0x7f7ef40054b0 comp rx=0 tx=0).stop 2026-02-13T03:36:52.321 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.317+0000 7f7eff0306c0 1 -- 10.20.193.96:0/3402241113 shutdown_connections 2026-02-13T03:36:52.321 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.317+0000 7f7eff0306c0 1 --2- 10.20.193.96:0/3402241113 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f7ed40b5600 0x7f7ed40d5ab0 unknown :-1 s=CLOSED pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:52.321 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.317+0000 7f7eff0306c0 1 --2- 10.20.193.96:0/3402241113 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7ef8122a00 0x7f7ef8122ea0 unknown :-1 s=CLOSED pgs=408 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:52.321 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.317+0000 7f7eff0306c0 1 --2- 10.20.193.96:0/3402241113 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7ef8115410 0x7f7ef811d640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:52.321 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.317+0000 7f7eff0306c0 1 --2- 10.20.193.96:0/3402241113 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7ef810f200 0x7f7ef811d100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:52.321 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.317+0000 7f7eff0306c0 1 -- 10.20.193.96:0/3402241113 >> 10.20.193.96:0/3402241113 conn(0x7f7ef80ecb00 msgr2=0x7f7ef810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:52.322 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.317+0000 7f7eff0306c0 1 -- 10.20.193.96:0/3402241113 shutdown_connections 2026-02-13T03:36:52.322 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:52.317+0000 7f7eff0306c0 1 -- 10.20.193.96:0/3402241113 wait complete. 2026-02-13T03:36:53.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:52 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3402241113' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:53.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:52 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3402241113' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:53.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:52 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3402241113' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:54.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:53 trial132 ceph-mon[26888]: pgmap v268: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:36:54.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:53 trial133 ceph-mon[26943]: pgmap v268: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:36:54.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:53 trial096 ceph-mon[24671]: pgmap v268: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:36:55.361 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:36:55.479 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:36:55.594 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.589+0000 7f84c1a976c0 1 -- 10.20.193.96:0/2248753347 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f84bc10fc20 msgr2=0x7f84bc114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:55.594 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.589+0000 7f84c1a976c0 1 --2- 10.20.193.96:0/2248753347 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f84bc10fc20 0x7f84bc114c60 secure :-1 s=READY pgs=409 gs=1 cs=0 l=1 c_cookie=10300580976110481541 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84ac0099a0 tx=0x7f84ac02ed20 comp rx=0 tx=0).stop 2026-02-13T03:36:55.594 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.589+0000 7f84c1a976c0 1 -- 10.20.193.96:0/2248753347 shutdown_connections 2026-02-13T03:36:55.594 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.589+0000 7f84c1a976c0 1 --2- 10.20.193.96:0/2248753347 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f84bc115440 0x7f84bc175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:55.594 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.589+0000 7f84c1a976c0 1 --2- 10.20.193.96:0/2248753347 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f84bc10fc20 0x7f84bc114c60 unknown :-1 s=CLOSED pgs=409 gs=1 cs=0 l=1 c_cookie=10300580976110481541 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:55.595 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.589+0000 7f84c1a976c0 1 --2- 10.20.193.96:0/2248753347 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f84bc10f230 0x7f84bc10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:55.595 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.589+0000 7f84c1a976c0 1 -- 10.20.193.96:0/2248753347 >> 10.20.193.96:0/2248753347 conn(0x7f84bc0ecb30 msgr2=0x7f84bc10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:55.595 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.589+0000 7f84c1a976c0 1 -- 10.20.193.96:0/2248753347 shutdown_connections 2026-02-13T03:36:55.595 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.589+0000 7f84c1a976c0 1 -- 10.20.193.96:0/2248753347 wait complete. 2026-02-13T03:36:55.595 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.590+0000 7f84c1a976c0 1 Processor -- start 2026-02-13T03:36:55.595 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.590+0000 7f84c1a976c0 1 -- start start 2026-02-13T03:36:55.595 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.590+0000 7f84c1a976c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f84bc10f230 0x7f84bc0f4ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:55.595 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.590+0000 7f84c1a976c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f84bc115440 0x7f84bc175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:55.595 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.590+0000 7f84c1a976c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f84bc0f51d0 0x7f84bc0fa4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:55.595 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.590+0000 7f84c1a976c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc0f58c0 con 0x7f84bc115440 2026-02-13T03:36:55.595 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.590+0000 7f84c1a976c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc0fa9e0 con 0x7f84bc0f51d0 2026-02-13T03:36:55.595 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.590+0000 7f84c1a976c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc0faba0 con 0x7f84bc10f230 2026-02-13T03:36:55.596 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.590+0000 7f84baffd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f84bc115440 0x7f84bc175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:55.596 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.590+0000 7f84baffd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f84bc115440 0x7f84bc175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:55824/0 (socket says 10.20.193.96:55824) 2026-02-13T03:36:55.596 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.590+0000 7f84baffd6c0 1 -- 10.20.193.96:0/1591373732 learned_addr learned my addr 10.20.193.96:0/1591373732 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:36:55.596 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.590+0000 7f84bb7fe6c0 1 --2- 10.20.193.96:0/1591373732 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f84bc10f230 0x7f84bc0f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:55.596 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.590+0000 7f84bbfff6c0 1 --2- 10.20.193.96:0/1591373732 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f84bc0f51d0 0x7f84bc0fa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:55.596 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.590+0000 7f84baffd6c0 1 -- 10.20.193.96:0/1591373732 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f84bc10f230 msgr2=0x7f84bc0f4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:55.596 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.590+0000 7f84baffd6c0 1 --2- 10.20.193.96:0/1591373732 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f84bc10f230 0x7f84bc0f4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:55.596 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.590+0000 7f84baffd6c0 1 -- 10.20.193.96:0/1591373732 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f84bc0f51d0 msgr2=0x7f84bc0fa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:55.596 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.590+0000 7f84baffd6c0 1 --2- 10.20.193.96:0/1591373732 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f84bc0f51d0 0x7f84bc0fa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:55.596 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.590+0000 7f84baffd6c0 1 -- 10.20.193.96:0/1591373732 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84ac009590 con 0x7f84bc115440 2026-02-13T03:36:55.596 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.590+0000 7f84baffd6c0 1 --2- 10.20.193.96:0/1591373732 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f84bc115440 0x7f84bc175ce0 secure :-1 s=READY pgs=410 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84ac005b40 tx=0x7f84ac02fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:55.596 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.590+0000 7f84b8ff96c0 1 -- 10.20.193.96:0/1591373732 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f84ac002ae0 con 0x7f84bc115440 2026-02-13T03:36:55.597 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.590+0000 7f84b8ff96c0 1 -- 10.20.193.96:0/1591373732 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f84ac002c40 con 0x7f84bc115440 2026-02-13T03:36:55.597 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.590+0000 7f84b8ff96c0 1 -- 10.20.193.96:0/1591373732 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f84ac0312b0 con 0x7f84bc115440 2026-02-13T03:36:55.597 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.590+0000 7f84c1a976c0 1 -- 10.20.193.96:0/1591373732 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84bc0fae20 con 0x7f84bc115440 2026-02-13T03:36:55.597 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.590+0000 7f84c1a976c0 1 -- 10.20.193.96:0/1591373732 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84bc0fb250 con 0x7f84bc115440 2026-02-13T03:36:55.597 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.591+0000 7f84c1a976c0 1 -- 10.20.193.96:0/1591373732 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84bc110500 con 0x7f84bc115440 2026-02-13T03:36:55.598 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.592+0000 7f84b8ff96c0 1 -- 10.20.193.96:0/1591373732 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f84ac007960 con 0x7f84bc115440 2026-02-13T03:36:55.598 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.593+0000 7f84b8ff96c0 1 --2- 10.20.193.96:0/1591373732 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f84900b5600 0x7f84900d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:55.598 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.593+0000 7f84bb7fe6c0 1 --2- 10.20.193.96:0/1591373732 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f84900b5600 0x7f84900d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:55.598 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.593+0000 7f84b8ff96c0 1 -- 10.20.193.96:0/1591373732 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f84ac107c10 con 0x7f84bc115440 2026-02-13T03:36:55.598 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.593+0000 7f84bb7fe6c0 1 --2- 10.20.193.96:0/1591373732 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f84900b5600 0x7f84900d5ab0 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84a8005980 tx=0x7f84a8005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:55.598 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.593+0000 7f84b8ff96c0 1 -- 10.20.193.96:0/1591373732 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f84ac0ca670 con 0x7f84bc115440 2026-02-13T03:36:55.712 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.709+0000 7f84c1a976c0 1 -- 10.20.193.96:0/1591373732 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f84bc10f600 con 0x7f84bc115440 2026-02-13T03:36:55.712 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.710+0000 7f84b8ff96c0 1 -- 10.20.193.96:0/1591373732 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f84ac0cd820 con 0x7f84bc115440 2026-02-13T03:36:55.713 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:36:55.713 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:36:55.714 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.710+0000 7f84c1a976c0 1 -- 10.20.193.96:0/1591373732 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f84900b5600 msgr2=0x7f84900d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:55.714 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.711+0000 7f84c1a976c0 1 --2- 10.20.193.96:0/1591373732 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f84900b5600 0x7f84900d5ab0 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84a8005980 tx=0x7f84a8005910 comp rx=0 tx=0).stop 2026-02-13T03:36:55.714 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.711+0000 7f84c1a976c0 1 -- 10.20.193.96:0/1591373732 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f84bc115440 msgr2=0x7f84bc175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:55.714 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.711+0000 7f84c1a976c0 1 --2- 10.20.193.96:0/1591373732 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f84bc115440 0x7f84bc175ce0 secure :-1 s=READY pgs=410 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84ac005b40 tx=0x7f84ac02fc60 comp rx=0 tx=0).stop 2026-02-13T03:36:55.714 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.711+0000 7f84c1a976c0 1 -- 10.20.193.96:0/1591373732 shutdown_connections 2026-02-13T03:36:55.714 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.711+0000 7f84c1a976c0 1 --2- 10.20.193.96:0/1591373732 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f84900b5600 0x7f84900d5ab0 unknown :-1 s=CLOSED pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:55.714 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.711+0000 7f84c1a976c0 1 --2- 10.20.193.96:0/1591373732 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f84bc0f51d0 0x7f84bc0fa4a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:55.714 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.711+0000 7f84c1a976c0 1 --2- 10.20.193.96:0/1591373732 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f84bc115440 0x7f84bc175ce0 unknown :-1 s=CLOSED pgs=410 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:55.714 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.711+0000 7f84c1a976c0 1 --2- 10.20.193.96:0/1591373732 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f84bc10f230 0x7f84bc0f4ba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:55.715 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.711+0000 7f84c1a976c0 1 -- 10.20.193.96:0/1591373732 >> 10.20.193.96:0/1591373732 conn(0x7f84bc0ecb30 msgr2=0x7f84bc113c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:55.715 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.711+0000 7f84c1a976c0 1 -- 10.20.193.96:0/1591373732 shutdown_connections 2026-02-13T03:36:55.715 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:55.711+0000 7f84c1a976c0 1 -- 10.20.193.96:0/1591373732 wait complete. 2026-02-13T03:36:56.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:55 trial096 ceph-mon[24671]: pgmap v269: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:36:56.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:55 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1591373732' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:56.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:55 trial132 ceph-mon[26888]: pgmap v269: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:36:56.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:55 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1591373732' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:56.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:55 trial133 ceph-mon[26943]: pgmap v269: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:36:56.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:55 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1591373732' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:36:58.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:57 trial132 ceph-mon[26888]: pgmap v270: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:36:58.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:57 trial133 ceph-mon[26943]: pgmap v270: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:36:58.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:57 trial096 ceph-mon[24671]: pgmap v270: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:36:58.756 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:36:58.876 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:36:58.993 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.988+0000 7f82aded56c0 1 -- 10.20.193.96:0/722928435 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f82a8115410 msgr2=0x7f82a8175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:58.993 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.988+0000 7f82aded56c0 1 --2- 10.20.193.96:0/722928435 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f82a8115410 0x7f82a8175db0 secure :-1 s=READY pgs=411 gs=1 cs=0 l=1 c_cookie=17232180571676857916 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f829c00aa70 tx=0x7f829c02fde0 comp rx=0 tx=0).stop 2026-02-13T03:36:58.993 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.988+0000 7f82aded56c0 1 -- 10.20.193.96:0/722928435 shutdown_connections 2026-02-13T03:36:58.993 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.988+0000 7f82aded56c0 1 --2- 10.20.193.96:0/722928435 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f82a8115410 0x7f82a8175db0 unknown :-1 s=CLOSED pgs=411 gs=1 cs=0 l=1 c_cookie=17232180571676857916 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:58.993 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.988+0000 7f82aded56c0 1 --2- 10.20.193.96:0/722928435 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f82a810fbf0 0x7f82a8114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:58.993 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.988+0000 7f82aded56c0 1 --2- 10.20.193.96:0/722928435 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f82a810f200 0x7f82a810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:58.994 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.988+0000 7f82aded56c0 1 -- 10.20.193.96:0/722928435 >> 10.20.193.96:0/722928435 conn(0x7f82a80ecb00 msgr2=0x7f82a810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:58.994 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.988+0000 7f82aded56c0 1 -- 10.20.193.96:0/722928435 shutdown_connections 2026-02-13T03:36:58.994 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.988+0000 7f82aded56c0 1 -- 10.20.193.96:0/722928435 wait complete. 2026-02-13T03:36:58.994 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.988+0000 7f82aded56c0 1 Processor -- start 2026-02-13T03:36:58.994 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.989+0000 7f82aded56c0 1 -- start start 2026-02-13T03:36:58.994 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.989+0000 7f82aded56c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f82a810f200 0x7f82a811d110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:58.994 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.989+0000 7f82aded56c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f82a8115410 0x7f82a811d650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:58.994 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.989+0000 7f82aded56c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f82a8122a10 0x7f82a8122eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:58.994 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.989+0000 7f82aded56c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f82a8123420 con 0x7f82a8122a10 2026-02-13T03:36:58.994 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.989+0000 7f82aded56c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f82a8123590 con 0x7f82a8115410 2026-02-13T03:36:58.994 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.989+0000 7f82aded56c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f82a8123750 con 0x7f82a810f200 2026-02-13T03:36:58.994 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.989+0000 7f82a7fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f82a8122a10 0x7f82a8122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:58.995 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.989+0000 7f82a7fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f82a8122a10 0x7f82a8122eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:55842/0 (socket says 10.20.193.96:55842) 2026-02-13T03:36:58.995 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.989+0000 7f82a7fff6c0 1 -- 10.20.193.96:0/1113457824 learned_addr learned my addr 10.20.193.96:0/1113457824 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:36:58.995 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.989+0000 7f82a77fe6c0 1 --2- 10.20.193.96:0/1113457824 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f82a810f200 0x7f82a811d110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:58.995 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.989+0000 7f82a7fff6c0 1 -- 10.20.193.96:0/1113457824 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f82a810f200 msgr2=0x7f82a811d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:58.995 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.989+0000 7f82a7fff6c0 1 --2- 10.20.193.96:0/1113457824 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f82a810f200 0x7f82a811d110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:58.995 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.989+0000 7f82a7fff6c0 1 -- 10.20.193.96:0/1113457824 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f82a8115410 msgr2=0x7f82a811d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:58.995 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.989+0000 7f82a7fff6c0 1 --2- 10.20.193.96:0/1113457824 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f82a8115410 0x7f82a811d650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:58.995 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.989+0000 7f82a7fff6c0 1 -- 10.20.193.96:0/1113457824 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829c00a660 con 0x7f82a8122a10 2026-02-13T03:36:58.995 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.989+0000 7f82a7fff6c0 1 --2- 10.20.193.96:0/1113457824 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f82a8122a10 0x7f82a8122eb0 secure :-1 s=READY pgs=412 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f829c00ab70 tx=0x7f829c0054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:58.995 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.989+0000 7f82a4ff96c0 1 -- 10.20.193.96:0/1113457824 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f829c030d10 con 0x7f82a8122a10 2026-02-13T03:36:58.995 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.989+0000 7f82a4ff96c0 1 -- 10.20.193.96:0/1113457824 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f829c032e80 con 0x7f82a8122a10 2026-02-13T03:36:58.995 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.989+0000 7f82aded56c0 1 -- 10.20.193.96:0/1113457824 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82a8163ba0 con 0x7f82a8122a10 2026-02-13T03:36:58.996 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.989+0000 7f82a4ff96c0 1 -- 10.20.193.96:0/1113457824 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f829c008430 con 0x7f82a8122a10 2026-02-13T03:36:58.996 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.989+0000 7f82aded56c0 1 -- 10.20.193.96:0/1113457824 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82a8163fd0 con 0x7f82a8122a10 2026-02-13T03:36:58.996 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.989+0000 7f82aded56c0 1 -- 10.20.193.96:0/1113457824 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82a81104d0 con 0x7f82a8122a10 2026-02-13T03:36:58.997 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.991+0000 7f82a4ff96c0 1 -- 10.20.193.96:0/1113457824 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f829c003810 con 0x7f82a8122a10 2026-02-13T03:36:58.997 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.991+0000 7f82a4ff96c0 1 --2- 10.20.193.96:0/1113457824 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f827c0b5600 0x7f827c0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:36:58.997 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.992+0000 7f82a4ff96c0 1 -- 10.20.193.96:0/1113457824 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f829c108ec0 con 0x7f82a8122a10 2026-02-13T03:36:58.997 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.992+0000 7f82a77fe6c0 1 --2- 10.20.193.96:0/1113457824 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f827c0b5600 0x7f827c0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:36:58.997 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.992+0000 7f82a4ff96c0 1 -- 10.20.193.96:0/1113457824 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f829c0cb920 con 0x7f82a8122a10 2026-02-13T03:36:58.997 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:58.992+0000 7f82a77fe6c0 1 --2- 10.20.193.96:0/1113457824 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f827c0b5600 0x7f827c0d5ab0 secure :-1 s=READY pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8294005980 tx=0x7f8294005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:36:59.109 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:59.107+0000 7f82aded56c0 1 -- 10.20.193.96:0/1113457824 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f82a810f5d0 con 0x7f82a8122a10 2026-02-13T03:36:59.110 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:59.107+0000 7f82a4ff96c0 1 -- 10.20.193.96:0/1113457824 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f829c0cead0 con 0x7f82a8122a10 2026-02-13T03:36:59.110 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:36:59.110 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:36:59.111 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:59.108+0000 7f82aded56c0 1 -- 10.20.193.96:0/1113457824 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f827c0b5600 msgr2=0x7f827c0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:59.111 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:59.108+0000 7f82aded56c0 1 --2- 10.20.193.96:0/1113457824 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f827c0b5600 0x7f827c0d5ab0 secure :-1 s=READY pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8294005980 tx=0x7f8294005910 comp rx=0 tx=0).stop 2026-02-13T03:36:59.112 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:59.108+0000 7f82aded56c0 1 -- 10.20.193.96:0/1113457824 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f82a8122a10 msgr2=0x7f82a8122eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:36:59.112 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:59.108+0000 7f82aded56c0 1 --2- 10.20.193.96:0/1113457824 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f82a8122a10 0x7f82a8122eb0 secure :-1 s=READY pgs=412 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f829c00ab70 tx=0x7f829c0054b0 comp rx=0 tx=0).stop 2026-02-13T03:36:59.112 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:59.108+0000 7f82aded56c0 1 -- 10.20.193.96:0/1113457824 shutdown_connections 2026-02-13T03:36:59.112 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:59.108+0000 7f82aded56c0 1 --2- 10.20.193.96:0/1113457824 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f827c0b5600 0x7f827c0d5ab0 unknown :-1 s=CLOSED pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:59.112 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:59.108+0000 7f82aded56c0 1 --2- 10.20.193.96:0/1113457824 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f82a8122a10 0x7f82a8122eb0 unknown :-1 s=CLOSED pgs=412 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:59.112 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:59.108+0000 7f82aded56c0 1 --2- 10.20.193.96:0/1113457824 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f82a8115410 0x7f82a811d650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:59.112 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:59.108+0000 7f82aded56c0 1 --2- 10.20.193.96:0/1113457824 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f82a810f200 0x7f82a811d110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:36:59.112 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:59.108+0000 7f82aded56c0 1 -- 10.20.193.96:0/1113457824 >> 10.20.193.96:0/1113457824 conn(0x7f82a80ecb00 msgr2=0x7f82a810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:36:59.112 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:59.108+0000 7f82aded56c0 1 -- 10.20.193.96:0/1113457824 shutdown_connections 2026-02-13T03:36:59.112 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:36:59.108+0000 7f82aded56c0 1 -- 10.20.193.96:0/1113457824 wait complete. 2026-02-13T03:37:00.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:59 trial132 ceph-mon[26888]: pgmap v271: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:00.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:36:59 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1113457824' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:00.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:59 trial133 ceph-mon[26943]: pgmap v271: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:00.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:36:59 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1113457824' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:00.326 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:59 trial096 ceph-mon[24671]: pgmap v271: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:00.327 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:36:59 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1113457824' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:02.153 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:37:02.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:01 trial132 ceph-mon[26888]: pgmap v272: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:02.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:01 trial133 ceph-mon[26943]: pgmap v272: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:02.272 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:37:02.294 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:01 trial096 ceph-mon[24671]: pgmap v272: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:02.393 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.388+0000 7f370e11b6c0 1 -- 10.20.193.96:0/3139156622 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3708115440 msgr2=0x7f3708175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:02.394 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.388+0000 7f370e11b6c0 1 --2- 10.20.193.96:0/3139156622 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3708115440 0x7f3708175de0 secure :-1 s=READY pgs=413 gs=1 cs=0 l=1 c_cookie=16135936914259888132 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36fc00aa70 tx=0x7f36fc02fde0 comp rx=0 tx=0).stop 2026-02-13T03:37:02.394 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.388+0000 7f370e11b6c0 1 -- 10.20.193.96:0/3139156622 shutdown_connections 2026-02-13T03:37:02.394 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.388+0000 7f370e11b6c0 1 --2- 10.20.193.96:0/3139156622 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3708115440 0x7f3708175de0 unknown :-1 s=CLOSED pgs=413 gs=1 cs=0 l=1 c_cookie=16135936914259888132 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:02.394 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.388+0000 7f370e11b6c0 1 --2- 10.20.193.96:0/3139156622 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f370810fc20 0x7f3708114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:02.394 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.388+0000 7f370e11b6c0 1 --2- 10.20.193.96:0/3139156622 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f370810f230 0x7f370810f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:02.394 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.388+0000 7f370e11b6c0 1 -- 10.20.193.96:0/3139156622 >> 10.20.193.96:0/3139156622 conn(0x7f37080ecb30 msgr2=0x7f370810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:02.394 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.388+0000 7f370e11b6c0 1 -- 10.20.193.96:0/3139156622 shutdown_connections 2026-02-13T03:37:02.394 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.388+0000 7f370e11b6c0 1 -- 10.20.193.96:0/3139156622 wait complete. 2026-02-13T03:37:02.395 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.388+0000 7f370e11b6c0 1 Processor -- start 2026-02-13T03:37:02.395 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.388+0000 7f370e11b6c0 1 -- start start 2026-02-13T03:37:02.395 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.389+0000 7f370e11b6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f370810f230 0x7f370811d230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:02.395 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.389+0000 7f370e11b6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3708115440 0x7f370811d770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:02.395 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.389+0000 7f370e11b6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3708122b30 0x7f3708122fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:02.395 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.389+0000 7f370e11b6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3708123540 con 0x7f370810f230 2026-02-13T03:37:02.395 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.389+0000 7f370e11b6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f37081236b0 con 0x7f3708122b30 2026-02-13T03:37:02.395 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.389+0000 7f370e11b6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3708123870 con 0x7f3708115440 2026-02-13T03:37:02.395 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.389+0000 7f37077fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f370810f230 0x7f370811d230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:02.395 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.389+0000 7f37077fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f370810f230 0x7f370811d230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:55870/0 (socket says 10.20.193.96:55870) 2026-02-13T03:37:02.395 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.389+0000 7f37077fe6c0 1 -- 10.20.193.96:0/3168233291 learned_addr learned my addr 10.20.193.96:0/3168233291 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:37:02.396 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.389+0000 7f3706ffd6c0 1 --2- 10.20.193.96:0/3168233291 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3708115440 0x7f370811d770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:02.396 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.389+0000 7f3707fff6c0 1 --2- 10.20.193.96:0/3168233291 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3708122b30 0x7f3708122fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:02.396 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.389+0000 7f37077fe6c0 1 -- 10.20.193.96:0/3168233291 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3708115440 msgr2=0x7f370811d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:02.396 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.389+0000 7f37077fe6c0 1 --2- 10.20.193.96:0/3168233291 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3708115440 0x7f370811d770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:02.396 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.389+0000 7f37077fe6c0 1 -- 10.20.193.96:0/3168233291 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3708122b30 msgr2=0x7f3708122fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:02.396 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.389+0000 7f37077fe6c0 1 --2- 10.20.193.96:0/3168233291 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3708122b30 0x7f3708122fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:02.396 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.389+0000 7f37077fe6c0 1 -- 10.20.193.96:0/3168233291 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36fc00a660 con 0x7f370810f230 2026-02-13T03:37:02.396 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.389+0000 7f3707fff6c0 1 --2- 10.20.193.96:0/3168233291 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3708122b30 0x7f3708122fd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:37:02.396 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.389+0000 7f37077fe6c0 1 --2- 10.20.193.96:0/3168233291 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f370810f230 0x7f370811d230 secure :-1 s=READY pgs=414 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36f400b710 tx=0x7f36f400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:02.396 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.389+0000 7f3704ff96c0 1 -- 10.20.193.96:0/3168233291 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f36f4004250 con 0x7f370810f230 2026-02-13T03:37:02.397 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.389+0000 7f3704ff96c0 1 -- 10.20.193.96:0/3168233291 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f36f4009070 con 0x7f370810f230 2026-02-13T03:37:02.397 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.389+0000 7f370e11b6c0 1 -- 10.20.193.96:0/3168233291 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3708163d20 con 0x7f370810f230 2026-02-13T03:37:02.397 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.389+0000 7f3704ff96c0 1 -- 10.20.193.96:0/3168233291 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f36f400cd50 con 0x7f370810f230 2026-02-13T03:37:02.397 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.389+0000 7f370e11b6c0 1 -- 10.20.193.96:0/3168233291 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37081641b0 con 0x7f370810f230 2026-02-13T03:37:02.397 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.389+0000 7f370e11b6c0 1 -- 10.20.193.96:0/3168233291 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3708110500 con 0x7f370810f230 2026-02-13T03:37:02.397 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.391+0000 7f3704ff96c0 1 -- 10.20.193.96:0/3168233291 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f36f40028c0 con 0x7f370810f230 2026-02-13T03:37:02.398 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.391+0000 7f3704ff96c0 1 --2- 10.20.193.96:0/3168233291 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f36dc0b5600 0x7f36dc0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:02.398 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.392+0000 7f3704ff96c0 1 -- 10.20.193.96:0/3168233291 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f36f40e3ba0 con 0x7f370810f230 2026-02-13T03:37:02.398 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.392+0000 7f3706ffd6c0 1 --2- 10.20.193.96:0/3168233291 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f36dc0b5600 0x7f36dc0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:02.399 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.392+0000 7f3704ff96c0 1 -- 10.20.193.96:0/3168233291 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f36f40a95d0 con 0x7f370810f230 2026-02-13T03:37:02.399 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.392+0000 7f3706ffd6c0 1 --2- 10.20.193.96:0/3168233291 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f36dc0b5600 0x7f36dc0d5ab0 secure :-1 s=READY pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3708123bc0 tx=0x7f36f80094f0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:02.508 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.506+0000 7f370e11b6c0 1 -- 10.20.193.96:0/3168233291 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f370810f600 con 0x7f370810f230 2026-02-13T03:37:02.509 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.506+0000 7f3704ff96c0 1 -- 10.20.193.96:0/3168233291 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f36f40a97b0 con 0x7f370810f230 2026-02-13T03:37:02.509 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:37:02.509 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:37:02.510 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.507+0000 7f370e11b6c0 1 -- 10.20.193.96:0/3168233291 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f36dc0b5600 msgr2=0x7f36dc0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:02.510 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.507+0000 7f370e11b6c0 1 --2- 10.20.193.96:0/3168233291 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f36dc0b5600 0x7f36dc0d5ab0 secure :-1 s=READY pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3708123bc0 tx=0x7f36f80094f0 comp rx=0 tx=0).stop 2026-02-13T03:37:02.511 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.507+0000 7f370e11b6c0 1 -- 10.20.193.96:0/3168233291 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f370810f230 msgr2=0x7f370811d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:02.511 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.507+0000 7f370e11b6c0 1 --2- 10.20.193.96:0/3168233291 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f370810f230 0x7f370811d230 secure :-1 s=READY pgs=414 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36f400b710 tx=0x7f36f400bbe0 comp rx=0 tx=0).stop 2026-02-13T03:37:02.511 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.507+0000 7f370e11b6c0 1 -- 10.20.193.96:0/3168233291 shutdown_connections 2026-02-13T03:37:02.511 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.507+0000 7f370e11b6c0 1 --2- 10.20.193.96:0/3168233291 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f36dc0b5600 0x7f36dc0d5ab0 unknown :-1 s=CLOSED pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:02.511 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.507+0000 7f370e11b6c0 1 --2- 10.20.193.96:0/3168233291 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3708122b30 0x7f3708122fd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:02.511 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.507+0000 7f370e11b6c0 1 --2- 10.20.193.96:0/3168233291 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3708115440 0x7f370811d770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:02.511 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.507+0000 7f370e11b6c0 1 --2- 10.20.193.96:0/3168233291 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f370810f230 0x7f370811d230 unknown :-1 s=CLOSED pgs=414 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:02.511 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.507+0000 7f370e11b6c0 1 -- 10.20.193.96:0/3168233291 >> 10.20.193.96:0/3168233291 conn(0x7f37080ecb30 msgr2=0x7f370810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:02.511 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.507+0000 7f370e11b6c0 1 -- 10.20.193.96:0/3168233291 shutdown_connections 2026-02-13T03:37:02.512 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:02.507+0000 7f370e11b6c0 1 -- 10.20.193.96:0/3168233291 wait complete. 2026-02-13T03:37:03.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:02 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3168233291' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:03.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:02 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3168233291' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:03.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:02 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3168233291' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:04.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:03 trial132 ceph-mon[26888]: pgmap v273: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:04.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:03 trial133 ceph-mon[26943]: pgmap v273: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:04.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:03 trial096 ceph-mon[24671]: pgmap v273: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:05.550 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:37:05.670 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:37:05.787 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.782+0000 7f23d9c346c0 1 -- 10.20.193.96:0/1224117614 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f23d4115410 msgr2=0x7f23d4175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:05.787 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.782+0000 7f23d9c346c0 1 --2- 10.20.193.96:0/1224117614 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f23d4115410 0x7f23d4175db0 secure :-1 s=READY pgs=415 gs=1 cs=0 l=1 c_cookie=4669856076171579397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23c800aa70 tx=0x7f23c802fde0 comp rx=0 tx=0).stop 2026-02-13T03:37:05.787 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.782+0000 7f23d9c346c0 1 -- 10.20.193.96:0/1224117614 shutdown_connections 2026-02-13T03:37:05.788 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.782+0000 7f23d9c346c0 1 --2- 10.20.193.96:0/1224117614 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f23d4115410 0x7f23d4175db0 unknown :-1 s=CLOSED pgs=415 gs=1 cs=0 l=1 c_cookie=4669856076171579397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:05.788 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.782+0000 7f23d9c346c0 1 --2- 10.20.193.96:0/1224117614 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f23d410fbf0 0x7f23d4114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:05.788 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.782+0000 7f23d9c346c0 1 --2- 10.20.193.96:0/1224117614 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f23d410f200 0x7f23d410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:05.788 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.782+0000 7f23d9c346c0 1 -- 10.20.193.96:0/1224117614 >> 10.20.193.96:0/1224117614 conn(0x7f23d40ecb00 msgr2=0x7f23d410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:05.788 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.782+0000 7f23d9c346c0 1 -- 10.20.193.96:0/1224117614 shutdown_connections 2026-02-13T03:37:05.788 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.782+0000 7f23d9c346c0 1 -- 10.20.193.96:0/1224117614 wait complete. 2026-02-13T03:37:05.788 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d9c346c0 1 Processor -- start 2026-02-13T03:37:05.788 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d9c346c0 1 -- start start 2026-02-13T03:37:05.788 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d9c346c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f23d410f200 0x7f23d411d0e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:05.788 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d9c346c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f23d4115410 0x7f23d411d620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:05.788 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d9c346c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f23d41229e0 0x7f23d4122e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:05.789 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d9c346c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f23d41233f0 con 0x7f23d41229e0 2026-02-13T03:37:05.789 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d9c346c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f23d4123560 con 0x7f23d4115410 2026-02-13T03:37:05.789 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d9c346c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f23d4123720 con 0x7f23d410f200 2026-02-13T03:37:05.789 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d3fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f23d41229e0 0x7f23d4122e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:05.789 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d3fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f23d41229e0 0x7f23d4122e80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:39036/0 (socket says 10.20.193.96:39036) 2026-02-13T03:37:05.789 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d3fff6c0 1 -- 10.20.193.96:0/3430505022 learned_addr learned my addr 10.20.193.96:0/3430505022 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:37:05.789 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d37fe6c0 1 --2- 10.20.193.96:0/3430505022 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f23d410f200 0x7f23d411d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:05.789 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d2ffd6c0 1 --2- 10.20.193.96:0/3430505022 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f23d4115410 0x7f23d411d620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:05.789 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d3fff6c0 1 -- 10.20.193.96:0/3430505022 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f23d410f200 msgr2=0x7f23d411d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:05.789 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d3fff6c0 1 --2- 10.20.193.96:0/3430505022 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f23d410f200 0x7f23d411d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:05.789 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d3fff6c0 1 -- 10.20.193.96:0/3430505022 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f23d4115410 msgr2=0x7f23d411d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:05.789 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d3fff6c0 1 --2- 10.20.193.96:0/3430505022 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f23d4115410 0x7f23d411d620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:05.790 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d3fff6c0 1 -- 10.20.193.96:0/3430505022 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c800a660 con 0x7f23d41229e0 2026-02-13T03:37:05.790 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d37fe6c0 1 --2- 10.20.193.96:0/3430505022 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f23d410f200 0x7f23d411d0e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:37:05.790 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d3fff6c0 1 --2- 10.20.193.96:0/3430505022 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f23d41229e0 0x7f23d4122e80 secure :-1 s=READY pgs=416 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23c800ab70 tx=0x7f23c80054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:05.790 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d0ff96c0 1 -- 10.20.193.96:0/3430505022 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f23c8030d10 con 0x7f23d41229e0 2026-02-13T03:37:05.790 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d0ff96c0 1 -- 10.20.193.96:0/3430505022 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f23c8032e80 con 0x7f23d41229e0 2026-02-13T03:37:05.790 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d9c346c0 1 -- 10.20.193.96:0/3430505022 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d4163b70 con 0x7f23d41229e0 2026-02-13T03:37:05.790 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d0ff96c0 1 -- 10.20.193.96:0/3430505022 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f23c8008430 con 0x7f23d41229e0 2026-02-13T03:37:05.790 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.783+0000 7f23d9c346c0 1 -- 10.20.193.96:0/3430505022 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d4163fa0 con 0x7f23d41229e0 2026-02-13T03:37:05.790 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.784+0000 7f23d9c346c0 1 -- 10.20.193.96:0/3430505022 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23d41104d0 con 0x7f23d41229e0 2026-02-13T03:37:05.791 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.785+0000 7f23d0ff96c0 1 -- 10.20.193.96:0/3430505022 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f23c8003810 con 0x7f23d41229e0 2026-02-13T03:37:05.791 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.786+0000 7f23d0ff96c0 1 --2- 10.20.193.96:0/3430505022 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f23a80b5680 0x7f23a80d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:05.791 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.786+0000 7f23d37fe6c0 1 --2- 10.20.193.96:0/3430505022 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f23a80b5680 0x7f23a80d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:05.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.786+0000 7f23d0ff96c0 1 -- 10.20.193.96:0/3430505022 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f23c8108e80 con 0x7f23d41229e0 2026-02-13T03:37:05.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.786+0000 7f23d0ff96c0 1 -- 10.20.193.96:0/3430505022 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f23c8109300 con 0x7f23d41229e0 2026-02-13T03:37:05.792 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.786+0000 7f23d37fe6c0 1 --2- 10.20.193.96:0/3430505022 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f23a80b5680 0x7f23a80d5b30 secure :-1 s=READY pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23c0004750 tx=0x7f23c0005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:05.902 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.900+0000 7f23d9c346c0 1 -- 10.20.193.96:0/3430505022 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f23d410f5d0 con 0x7f23d41229e0 2026-02-13T03:37:05.903 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.900+0000 7f23d0ff96c0 1 -- 10.20.193.96:0/3430505022 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f23c80cb8e0 con 0x7f23d41229e0 2026-02-13T03:37:05.903 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:37:05.903 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:37:05.904 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.901+0000 7f23d9c346c0 1 -- 10.20.193.96:0/3430505022 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f23a80b5680 msgr2=0x7f23a80d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:05.904 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.901+0000 7f23d9c346c0 1 --2- 10.20.193.96:0/3430505022 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f23a80b5680 0x7f23a80d5b30 secure :-1 s=READY pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23c0004750 tx=0x7f23c0005f10 comp rx=0 tx=0).stop 2026-02-13T03:37:05.904 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.901+0000 7f23d9c346c0 1 -- 10.20.193.96:0/3430505022 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f23d41229e0 msgr2=0x7f23d4122e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:05.904 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.901+0000 7f23d9c346c0 1 --2- 10.20.193.96:0/3430505022 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f23d41229e0 0x7f23d4122e80 secure :-1 s=READY pgs=416 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23c800ab70 tx=0x7f23c80054b0 comp rx=0 tx=0).stop 2026-02-13T03:37:05.904 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.901+0000 7f23d9c346c0 1 -- 10.20.193.96:0/3430505022 shutdown_connections 2026-02-13T03:37:05.905 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.901+0000 7f23d9c346c0 1 --2- 10.20.193.96:0/3430505022 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f23a80b5680 0x7f23a80d5b30 unknown :-1 s=CLOSED pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:05.905 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.901+0000 7f23d9c346c0 1 --2- 10.20.193.96:0/3430505022 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f23d41229e0 0x7f23d4122e80 unknown :-1 s=CLOSED pgs=416 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:05.905 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.901+0000 7f23d9c346c0 1 --2- 10.20.193.96:0/3430505022 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f23d4115410 0x7f23d411d620 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:05.905 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.901+0000 7f23d9c346c0 1 --2- 10.20.193.96:0/3430505022 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f23d410f200 0x7f23d411d0e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:05.905 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.901+0000 7f23d9c346c0 1 -- 10.20.193.96:0/3430505022 >> 10.20.193.96:0/3430505022 conn(0x7f23d40ecb00 msgr2=0x7f23d410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:05.905 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.901+0000 7f23d9c346c0 1 -- 10.20.193.96:0/3430505022 shutdown_connections 2026-02-13T03:37:05.905 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:05.901+0000 7f23d9c346c0 1 -- 10.20.193.96:0/3430505022 wait complete. 2026-02-13T03:37:06.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:05 trial096 ceph-mon[24671]: pgmap v274: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:37:06.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:05 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3430505022' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:06.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:05 trial132 ceph-mon[26888]: pgmap v274: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:37:06.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:05 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3430505022' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:06.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:05 trial133 ceph-mon[26943]: pgmap v274: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:37:06.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:05 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3430505022' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:08.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:07 trial132 ceph-mon[26888]: pgmap v275: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:08.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:07 trial133 ceph-mon[26943]: pgmap v275: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:08.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:07 trial096 ceph-mon[24671]: pgmap v275: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:08.946 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:37:09.064 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:37:09.180 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.175+0000 7fb6333176c0 1 -- 10.20.193.96:0/3215578382 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb62c10b1e0 msgr2=0x7fb62c10b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:09.181 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.175+0000 7fb6333176c0 1 --2- 10.20.193.96:0/3215578382 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb62c10b1e0 0x7fb62c10b5f0 secure :-1 s=READY pgs=417 gs=1 cs=0 l=1 c_cookie=9829584145813199323 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb620009970 tx=0x7fb62002eda0 comp rx=0 tx=0).stop 2026-02-13T03:37:09.181 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.175+0000 7fb6333176c0 1 -- 10.20.193.96:0/3215578382 shutdown_connections 2026-02-13T03:37:09.181 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.175+0000 7fb6333176c0 1 --2- 10.20.193.96:0/3215578382 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb62c10bbf0 0x7fb62c175b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:09.181 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.175+0000 7fb6333176c0 1 --2- 10.20.193.96:0/3215578382 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb62c10b1e0 0x7fb62c10b5f0 unknown :-1 s=CLOSED pgs=417 gs=1 cs=0 l=1 c_cookie=9829584145813199323 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:09.181 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.175+0000 7fb6333176c0 1 --2- 10.20.193.96:0/3215578382 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb62c10db00 0x7fb62c10ded0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:09.181 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.175+0000 7fb6333176c0 1 -- 10.20.193.96:0/3215578382 >> 10.20.193.96:0/3215578382 conn(0x7fb62c062e00 msgr2=0x7fb62c109660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:09.181 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.175+0000 7fb6333176c0 1 -- 10.20.193.96:0/3215578382 shutdown_connections 2026-02-13T03:37:09.181 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.175+0000 7fb6333176c0 1 -- 10.20.193.96:0/3215578382 wait complete. 2026-02-13T03:37:09.181 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.175+0000 7fb6333176c0 1 Processor -- start 2026-02-13T03:37:09.182 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.175+0000 7fb6333176c0 1 -- start start 2026-02-13T03:37:09.182 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.175+0000 7fb6333176c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb62c10b1e0 0x7fb62c0f51f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:09.182 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.175+0000 7fb6333176c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb62c10bbf0 0x7fb62c0f5730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:09.182 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.175+0000 7fb6333176c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb62c10db00 0x7fb62c0faaf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:09.182 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.175+0000 7fb6333176c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb62c0fb140 con 0x7fb62c10db00 2026-02-13T03:37:09.182 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.175+0000 7fb6333176c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb62c0fb2b0 con 0x7fb62c10b1e0 2026-02-13T03:37:09.182 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.175+0000 7fb6333176c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb62c0fb470 con 0x7fb62c10bbf0 2026-02-13T03:37:09.182 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.175+0000 7fb6318896c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb62c10db00 0x7fb62c0faaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:09.182 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.176+0000 7fb6318896c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb62c10db00 0x7fb62c0faaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:39050/0 (socket says 10.20.193.96:39050) 2026-02-13T03:37:09.182 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.176+0000 7fb6318896c0 1 -- 10.20.193.96:0/134937333 learned_addr learned my addr 10.20.193.96:0/134937333 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:37:09.182 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.176+0000 7fb6308876c0 1 --2- 10.20.193.96:0/134937333 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb62c10bbf0 0x7fb62c0f5730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:09.183 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.176+0000 7fb6310886c0 1 --2- 10.20.193.96:0/134937333 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb62c10b1e0 0x7fb62c0f51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:09.183 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.176+0000 7fb6318896c0 1 -- 10.20.193.96:0/134937333 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb62c10bbf0 msgr2=0x7fb62c0f5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:09.183 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.176+0000 7fb6318896c0 1 --2- 10.20.193.96:0/134937333 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb62c10bbf0 0x7fb62c0f5730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:09.183 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.176+0000 7fb6318896c0 1 -- 10.20.193.96:0/134937333 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb62c10b1e0 msgr2=0x7fb62c0f51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:09.183 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.176+0000 7fb6318896c0 1 --2- 10.20.193.96:0/134937333 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb62c10b1e0 0x7fb62c0f51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:09.183 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.176+0000 7fb6318896c0 1 -- 10.20.193.96:0/134937333 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb620009590 con 0x7fb62c10db00 2026-02-13T03:37:09.183 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.176+0000 7fb6318896c0 1 --2- 10.20.193.96:0/134937333 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb62c10db00 0x7fb62c0faaf0 secure :-1 s=READY pgs=418 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb62800c6c0 tx=0x7fb62800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:09.183 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.176+0000 7fb61a7fc6c0 1 -- 10.20.193.96:0/134937333 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb628003c40 con 0x7fb62c10db00 2026-02-13T03:37:09.183 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.176+0000 7fb61a7fc6c0 1 -- 10.20.193.96:0/134937333 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fb62800a030 con 0x7fb62c10db00 2026-02-13T03:37:09.183 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.176+0000 7fb61a7fc6c0 1 -- 10.20.193.96:0/134937333 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb62800dbe0 con 0x7fb62c10db00 2026-02-13T03:37:09.183 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.176+0000 7fb6333176c0 1 -- 10.20.193.96:0/134937333 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb62c0fb750 con 0x7fb62c10db00 2026-02-13T03:37:09.183 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.176+0000 7fb6333176c0 1 -- 10.20.193.96:0/134937333 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb62c172cb0 con 0x7fb62c10db00 2026-02-13T03:37:09.184 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.176+0000 7fb6333176c0 1 -- 10.20.193.96:0/134937333 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb62c10c1f0 con 0x7fb62c10db00 2026-02-13T03:37:09.185 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.178+0000 7fb61a7fc6c0 1 -- 10.20.193.96:0/134937333 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fb628005030 con 0x7fb62c10db00 2026-02-13T03:37:09.185 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.178+0000 7fb61a7fc6c0 1 --2- 10.20.193.96:0/134937333 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb6080b5600 0x7fb6080d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:09.185 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.179+0000 7fb6310886c0 1 --2- 10.20.193.96:0/134937333 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb6080b5600 0x7fb6080d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:09.185 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.179+0000 7fb61a7fc6c0 1 -- 10.20.193.96:0/134937333 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7fb6280e4960 con 0x7fb62c10db00 2026-02-13T03:37:09.185 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.179+0000 7fb6310886c0 1 --2- 10.20.193.96:0/134937333 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb6080b5600 0x7fb6080d5ab0 secure :-1 s=READY pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb61c005980 tx=0x7fb61c005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:09.185 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.179+0000 7fb61a7fc6c0 1 -- 10.20.193.96:0/134937333 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb6280a73c0 con 0x7fb62c10db00 2026-02-13T03:37:09.303 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.299+0000 7fb6333176c0 1 -- 10.20.193.96:0/134937333 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb62c10ded0 con 0x7fb62c10db00 2026-02-13T03:37:09.303 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.299+0000 7fb61a7fc6c0 1 -- 10.20.193.96:0/134937333 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb628005310 con 0x7fb62c10db00 2026-02-13T03:37:09.303 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:37:09.303 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:37:09.304 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.300+0000 7fb6333176c0 1 -- 10.20.193.96:0/134937333 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb6080b5600 msgr2=0x7fb6080d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:09.304 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.300+0000 7fb6333176c0 1 --2- 10.20.193.96:0/134937333 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb6080b5600 0x7fb6080d5ab0 secure :-1 s=READY pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb61c005980 tx=0x7fb61c005910 comp rx=0 tx=0).stop 2026-02-13T03:37:09.304 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.300+0000 7fb6333176c0 1 -- 10.20.193.96:0/134937333 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb62c10db00 msgr2=0x7fb62c0faaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:09.304 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.300+0000 7fb6333176c0 1 --2- 10.20.193.96:0/134937333 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb62c10db00 0x7fb62c0faaf0 secure :-1 s=READY pgs=418 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb62800c6c0 tx=0x7fb62800cb90 comp rx=0 tx=0).stop 2026-02-13T03:37:09.304 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.300+0000 7fb6333176c0 1 -- 10.20.193.96:0/134937333 shutdown_connections 2026-02-13T03:37:09.304 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.300+0000 7fb6333176c0 1 --2- 10.20.193.96:0/134937333 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb6080b5600 0x7fb6080d5ab0 unknown :-1 s=CLOSED pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:09.304 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.300+0000 7fb6333176c0 1 --2- 10.20.193.96:0/134937333 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb62c10db00 0x7fb62c0faaf0 unknown :-1 s=CLOSED pgs=418 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:09.304 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.300+0000 7fb6333176c0 1 --2- 10.20.193.96:0/134937333 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb62c10bbf0 0x7fb62c0f5730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:09.304 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.300+0000 7fb6333176c0 1 --2- 10.20.193.96:0/134937333 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb62c10b1e0 0x7fb62c0f51f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:09.304 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.300+0000 7fb6333176c0 1 -- 10.20.193.96:0/134937333 >> 10.20.193.96:0/134937333 conn(0x7fb62c062e00 msgr2=0x7fb62c0eb980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:09.304 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.300+0000 7fb6333176c0 1 -- 10.20.193.96:0/134937333 shutdown_connections 2026-02-13T03:37:09.304 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:09.300+0000 7fb6333176c0 1 -- 10.20.193.96:0/134937333 wait complete. 2026-02-13T03:37:10.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:09 trial132 ceph-mon[26888]: pgmap v276: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:10.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:09 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/134937333' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:10.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:09 trial133 ceph-mon[26943]: pgmap v276: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:10.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:09 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/134937333' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:10.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:09 trial096 ceph-mon[24671]: pgmap v276: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:10.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:09 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/134937333' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:12.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:11 trial132 ceph-mon[26888]: pgmap v277: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:12.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:11 trial133 ceph-mon[26943]: pgmap v277: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:12.345 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:37:12.371 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:11 trial096 ceph-mon[24671]: pgmap v277: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:12.465 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:37:12.579 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.574+0000 7faebf7506c0 1 -- 10.20.193.96:0/4274624612 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faeb8115410 msgr2=0x7faeb8175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:12.579 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.574+0000 7faebf7506c0 1 --2- 10.20.193.96:0/4274624612 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faeb8115410 0x7faeb8175db0 secure :-1 s=READY pgs=419 gs=1 cs=0 l=1 c_cookie=10987013374668079482 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faeb400aa70 tx=0x7faeb402fde0 comp rx=0 tx=0).stop 2026-02-13T03:37:12.580 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.574+0000 7faebf7506c0 1 -- 10.20.193.96:0/4274624612 shutdown_connections 2026-02-13T03:37:12.580 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.574+0000 7faebf7506c0 1 --2- 10.20.193.96:0/4274624612 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faeb8115410 0x7faeb8175db0 unknown :-1 s=CLOSED pgs=419 gs=1 cs=0 l=1 c_cookie=10987013374668079482 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:12.580 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.574+0000 7faebf7506c0 1 --2- 10.20.193.96:0/4274624612 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7faeb810fbf0 0x7faeb8114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:12.580 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.574+0000 7faebf7506c0 1 --2- 10.20.193.96:0/4274624612 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7faeb810f200 0x7faeb810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:12.580 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.574+0000 7faebf7506c0 1 -- 10.20.193.96:0/4274624612 >> 10.20.193.96:0/4274624612 conn(0x7faeb80ecb00 msgr2=0x7faeb810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:12.580 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.574+0000 7faebf7506c0 1 -- 10.20.193.96:0/4274624612 shutdown_connections 2026-02-13T03:37:12.580 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.574+0000 7faebf7506c0 1 -- 10.20.193.96:0/4274624612 wait complete. 2026-02-13T03:37:12.580 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.574+0000 7faebf7506c0 1 Processor -- start 2026-02-13T03:37:12.581 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.574+0000 7faebf7506c0 1 -- start start 2026-02-13T03:37:12.581 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.574+0000 7faebf7506c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7faeb810f200 0x7faeb811d110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:12.581 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.574+0000 7faebf7506c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faeb8115410 0x7faeb811d650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:12.581 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.574+0000 7faebf7506c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7faeb8122a10 0x7faeb8122eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:12.581 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.574+0000 7faebf7506c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7faeb81233f0 con 0x7faeb8115410 2026-02-13T03:37:12.581 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.574+0000 7faebf7506c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7faeb8123560 con 0x7faeb8122a10 2026-02-13T03:37:12.582 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.574+0000 7faebf7506c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7faeb8123720 con 0x7faeb810f200 2026-02-13T03:37:12.582 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.575+0000 7faebccc46c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faeb8115410 0x7faeb811d650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:12.582 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.575+0000 7faebccc46c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faeb8115410 0x7faeb811d650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:39060/0 (socket says 10.20.193.96:39060) 2026-02-13T03:37:12.582 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.575+0000 7faebccc46c0 1 -- 10.20.193.96:0/2115335702 learned_addr learned my addr 10.20.193.96:0/2115335702 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:37:12.582 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.575+0000 7faebd4c56c0 1 --2- 10.20.193.96:0/2115335702 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7faeb810f200 0x7faeb811d110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:12.582 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.575+0000 7faebccc46c0 1 -- 10.20.193.96:0/2115335702 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7faeb810f200 msgr2=0x7faeb811d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:12.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.575+0000 7faebccc46c0 1 --2- 10.20.193.96:0/2115335702 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7faeb810f200 0x7faeb811d110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:12.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.575+0000 7faebccc46c0 1 -- 10.20.193.96:0/2115335702 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7faeb8122a10 msgr2=0x7faeb8122eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:12.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.575+0000 7faebdcc66c0 1 --2- 10.20.193.96:0/2115335702 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7faeb8122a10 0x7faeb8122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:12.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.575+0000 7faebccc46c0 1 --2- 10.20.193.96:0/2115335702 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7faeb8122a10 0x7faeb8122eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:12.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.575+0000 7faebccc46c0 1 -- 10.20.193.96:0/2115335702 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb400a660 con 0x7faeb8115410 2026-02-13T03:37:12.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.575+0000 7faebd4c56c0 1 --2- 10.20.193.96:0/2115335702 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7faeb810f200 0x7faeb811d110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:37:12.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.575+0000 7faebdcc66c0 1 --2- 10.20.193.96:0/2115335702 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7faeb8122a10 0x7faeb8122eb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:37:12.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.575+0000 7faebccc46c0 1 --2- 10.20.193.96:0/2115335702 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faeb8115410 0x7faeb811d650 secure :-1 s=READY pgs=420 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faeac00b750 tx=0x7faeac00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:12.583 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.575+0000 7faea67fc6c0 1 -- 10.20.193.96:0/2115335702 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faeac004a80 con 0x7faeb8115410 2026-02-13T03:37:12.584 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.575+0000 7faea67fc6c0 1 -- 10.20.193.96:0/2115335702 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7faeac009030 con 0x7faeb8115410 2026-02-13T03:37:12.584 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.575+0000 7faebf7506c0 1 -- 10.20.193.96:0/2115335702 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeb8163ba0 con 0x7faeb8115410 2026-02-13T03:37:12.584 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.575+0000 7faea67fc6c0 1 -- 10.20.193.96:0/2115335702 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faeac00cdd0 con 0x7faeb8115410 2026-02-13T03:37:12.584 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.575+0000 7faebf7506c0 1 -- 10.20.193.96:0/2115335702 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeb8164030 con 0x7faeb8115410 2026-02-13T03:37:12.584 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.575+0000 7faebf7506c0 1 -- 10.20.193.96:0/2115335702 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeb81104d0 con 0x7faeb8115410 2026-02-13T03:37:12.585 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.576+0000 7faea67fc6c0 1 -- 10.20.193.96:0/2115335702 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7faeac005020 con 0x7faeb8115410 2026-02-13T03:37:12.585 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.577+0000 7faea67fc6c0 1 --2- 10.20.193.96:0/2115335702 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fae940b5600 0x7fae940d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:12.585 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.577+0000 7faebd4c56c0 1 --2- 10.20.193.96:0/2115335702 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fae940b5600 0x7fae940d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:12.585 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.577+0000 7faea67fc6c0 1 -- 10.20.193.96:0/2115335702 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7faeac0e3b30 con 0x7faeb8115410 2026-02-13T03:37:12.585 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.577+0000 7faebd4c56c0 1 --2- 10.20.193.96:0/2115335702 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fae940b5600 0x7fae940d5ab0 secure :-1 s=READY pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faea8004750 tx=0x7faea8005e50 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:12.585 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.578+0000 7faea67fc6c0 1 -- 10.20.193.96:0/2115335702 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7faeac0a6590 con 0x7faeb8115410 2026-02-13T03:37:12.698 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.694+0000 7faebf7506c0 1 -- 10.20.193.96:0/2115335702 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7faeb811e260 con 0x7faeb8115410 2026-02-13T03:37:12.698 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.694+0000 7faea67fc6c0 1 -- 10.20.193.96:0/2115335702 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7faeac0a9740 con 0x7faeb8115410 2026-02-13T03:37:12.699 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:37:12.699 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:37:12.700 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.696+0000 7faebf7506c0 1 -- 10.20.193.96:0/2115335702 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fae940b5600 msgr2=0x7fae940d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:12.700 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.696+0000 7faebf7506c0 1 --2- 10.20.193.96:0/2115335702 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fae940b5600 0x7fae940d5ab0 secure :-1 s=READY pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faea8004750 tx=0x7faea8005e50 comp rx=0 tx=0).stop 2026-02-13T03:37:12.700 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.696+0000 7faebf7506c0 1 -- 10.20.193.96:0/2115335702 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faeb8115410 msgr2=0x7faeb811d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:12.700 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.696+0000 7faebf7506c0 1 --2- 10.20.193.96:0/2115335702 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faeb8115410 0x7faeb811d650 secure :-1 s=READY pgs=420 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faeac00b750 tx=0x7faeac00bc20 comp rx=0 tx=0).stop 2026-02-13T03:37:12.700 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.696+0000 7faebf7506c0 1 -- 10.20.193.96:0/2115335702 shutdown_connections 2026-02-13T03:37:12.700 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.696+0000 7faebf7506c0 1 --2- 10.20.193.96:0/2115335702 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fae940b5600 0x7fae940d5ab0 unknown :-1 s=CLOSED pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:12.700 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.696+0000 7faebf7506c0 1 --2- 10.20.193.96:0/2115335702 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7faeb8122a10 0x7faeb8122eb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:12.701 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.696+0000 7faebf7506c0 1 --2- 10.20.193.96:0/2115335702 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7faeb8115410 0x7faeb811d650 unknown :-1 s=CLOSED pgs=420 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:12.701 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.696+0000 7faebf7506c0 1 --2- 10.20.193.96:0/2115335702 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7faeb810f200 0x7faeb811d110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:12.701 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.696+0000 7faebf7506c0 1 -- 10.20.193.96:0/2115335702 >> 10.20.193.96:0/2115335702 conn(0x7faeb80ecb00 msgr2=0x7faeb810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:12.701 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.696+0000 7faebf7506c0 1 -- 10.20.193.96:0/2115335702 shutdown_connections 2026-02-13T03:37:12.701 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:12.696+0000 7faebf7506c0 1 -- 10.20.193.96:0/2115335702 wait complete. 2026-02-13T03:37:13.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:12 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2115335702' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:13.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:12 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2115335702' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:13.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:12 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2115335702' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:14.135 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:13 trial132 ceph-mon[26888]: pgmap v278: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:14.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:13 trial133 ceph-mon[26943]: pgmap v278: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:14.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:13 trial096 ceph-mon[24671]: pgmap v278: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:15.740 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:37:15.858 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:37:15.973 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.968+0000 7f246dd296c0 1 -- 10.20.193.96:0/2694616644 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2468115410 msgr2=0x7f2468175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:15.974 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.968+0000 7f246dd296c0 1 --2- 10.20.193.96:0/2694616644 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2468115410 0x7f2468175db0 secure :-1 s=READY pgs=421 gs=1 cs=0 l=1 c_cookie=10365005856559402865 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f245c00aa70 tx=0x7f245c02fde0 comp rx=0 tx=0).stop 2026-02-13T03:37:15.974 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.968+0000 7f246dd296c0 1 -- 10.20.193.96:0/2694616644 shutdown_connections 2026-02-13T03:37:15.974 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.968+0000 7f246dd296c0 1 --2- 10.20.193.96:0/2694616644 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2468115410 0x7f2468175db0 unknown :-1 s=CLOSED pgs=421 gs=1 cs=0 l=1 c_cookie=10365005856559402865 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:15.974 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.968+0000 7f246dd296c0 1 --2- 10.20.193.96:0/2694616644 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f246810fbf0 0x7f2468114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:15.974 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.968+0000 7f246dd296c0 1 --2- 10.20.193.96:0/2694616644 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f246810f200 0x7f246810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:15.974 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.968+0000 7f246dd296c0 1 -- 10.20.193.96:0/2694616644 >> 10.20.193.96:0/2694616644 conn(0x7f24680ecb00 msgr2=0x7f246810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:15.974 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.968+0000 7f246dd296c0 1 -- 10.20.193.96:0/2694616644 shutdown_connections 2026-02-13T03:37:15.974 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.968+0000 7f246dd296c0 1 -- 10.20.193.96:0/2694616644 wait complete. 2026-02-13T03:37:15.974 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.968+0000 7f246dd296c0 1 Processor -- start 2026-02-13T03:37:15.975 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.968+0000 7f246dd296c0 1 -- start start 2026-02-13T03:37:15.975 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.968+0000 7f246dd296c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f246810f200 0x7f246811d110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:15.975 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.968+0000 7f246dd296c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2468115410 0x7f246811d650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:15.975 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.968+0000 7f246dd296c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2468122a10 0x7f2468122eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:15.975 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.968+0000 7f246dd296c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f24681233f0 con 0x7f246810f200 2026-02-13T03:37:15.975 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.968+0000 7f246dd296c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2468123560 con 0x7f2468122a10 2026-02-13T03:37:15.975 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.968+0000 7f246dd296c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2468123720 con 0x7f2468115410 2026-02-13T03:37:15.975 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.969+0000 7f24677fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f246810f200 0x7f246811d110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:15.975 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.969+0000 7f24677fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f246810f200 0x7f246811d110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:35888/0 (socket says 10.20.193.96:35888) 2026-02-13T03:37:15.975 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.969+0000 7f24677fe6c0 1 -- 10.20.193.96:0/4087186751 learned_addr learned my addr 10.20.193.96:0/4087186751 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:37:15.975 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.969+0000 7f2466ffd6c0 1 --2- 10.20.193.96:0/4087186751 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2468115410 0x7f246811d650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:15.975 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.969+0000 7f2467fff6c0 1 --2- 10.20.193.96:0/4087186751 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2468122a10 0x7f2468122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:15.976 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.969+0000 7f24677fe6c0 1 -- 10.20.193.96:0/4087186751 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2468115410 msgr2=0x7f246811d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:15.976 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.969+0000 7f24677fe6c0 1 --2- 10.20.193.96:0/4087186751 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2468115410 0x7f246811d650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:15.976 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.969+0000 7f24677fe6c0 1 -- 10.20.193.96:0/4087186751 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2468122a10 msgr2=0x7f2468122eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:15.976 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.969+0000 7f24677fe6c0 1 --2- 10.20.193.96:0/4087186751 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2468122a10 0x7f2468122eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:15.976 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.969+0000 7f24677fe6c0 1 -- 10.20.193.96:0/4087186751 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245c00a660 con 0x7f246810f200 2026-02-13T03:37:15.976 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.969+0000 7f24677fe6c0 1 --2- 10.20.193.96:0/4087186751 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f246810f200 0x7f246811d110 secure :-1 s=READY pgs=422 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f245400b6c0 tx=0x7f245400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:15.976 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.969+0000 7f2464ff96c0 1 -- 10.20.193.96:0/4087186751 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2454004560 con 0x7f246810f200 2026-02-13T03:37:15.976 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.969+0000 7f2464ff96c0 1 -- 10.20.193.96:0/4087186751 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f2454009030 con 0x7f246810f200 2026-02-13T03:37:15.976 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.969+0000 7f246dd296c0 1 -- 10.20.193.96:0/4087186751 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2468163ba0 con 0x7f246810f200 2026-02-13T03:37:15.976 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.969+0000 7f2464ff96c0 1 -- 10.20.193.96:0/4087186751 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f245400ce20 con 0x7f246810f200 2026-02-13T03:37:15.976 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.969+0000 7f246dd296c0 1 -- 10.20.193.96:0/4087186751 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24681640d0 con 0x7f246810f200 2026-02-13T03:37:15.976 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.969+0000 7f246dd296c0 1 -- 10.20.193.96:0/4087186751 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24681104d0 con 0x7f246810f200 2026-02-13T03:37:15.978 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.970+0000 7f2464ff96c0 1 -- 10.20.193.96:0/4087186751 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f24540026b0 con 0x7f246810f200 2026-02-13T03:37:15.978 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.971+0000 7f2464ff96c0 1 --2- 10.20.193.96:0/4087186751 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f243c0b5680 0x7f243c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:15.978 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.971+0000 7f2466ffd6c0 1 --2- 10.20.193.96:0/4087186751 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f243c0b5680 0x7f243c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:15.978 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.971+0000 7f2464ff96c0 1 -- 10.20.193.96:0/4087186751 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f24540e38f0 con 0x7f246810f200 2026-02-13T03:37:15.978 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.972+0000 7f2466ffd6c0 1 --2- 10.20.193.96:0/4087186751 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f243c0b5680 0x7f243c0d5b30 secure :-1 s=READY pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2468123aa0 tx=0x7f2458005ee0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:15.978 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:15.972+0000 7f2464ff96c0 1 -- 10.20.193.96:0/4087186751 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f24540a6350 con 0x7f246810f200 2026-02-13T03:37:16.089 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:16.085+0000 7f246dd296c0 1 -- 10.20.193.96:0/4087186751 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f246811e260 con 0x7f246810f200 2026-02-13T03:37:16.090 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:15 trial096 ceph-mon[24671]: pgmap v279: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:37:16.090 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:16.086+0000 7f2464ff96c0 1 -- 10.20.193.96:0/4087186751 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f24540a9500 con 0x7f246810f200 2026-02-13T03:37:16.090 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:37:16.090 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:37:16.091 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:16.087+0000 7f246dd296c0 1 -- 10.20.193.96:0/4087186751 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f243c0b5680 msgr2=0x7f243c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:16.091 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:16.087+0000 7f246dd296c0 1 --2- 10.20.193.96:0/4087186751 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f243c0b5680 0x7f243c0d5b30 secure :-1 s=READY pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2468123aa0 tx=0x7f2458005ee0 comp rx=0 tx=0).stop 2026-02-13T03:37:16.091 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:16.087+0000 7f246dd296c0 1 -- 10.20.193.96:0/4087186751 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f246810f200 msgr2=0x7f246811d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:16.091 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:16.087+0000 7f246dd296c0 1 --2- 10.20.193.96:0/4087186751 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f246810f200 0x7f246811d110 secure :-1 s=READY pgs=422 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f245400b6c0 tx=0x7f245400bb90 comp rx=0 tx=0).stop 2026-02-13T03:37:16.092 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:16.087+0000 7f246dd296c0 1 -- 10.20.193.96:0/4087186751 shutdown_connections 2026-02-13T03:37:16.092 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:16.087+0000 7f246dd296c0 1 --2- 10.20.193.96:0/4087186751 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f243c0b5680 0x7f243c0d5b30 unknown :-1 s=CLOSED pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:16.092 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:16.087+0000 7f246dd296c0 1 --2- 10.20.193.96:0/4087186751 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2468122a10 0x7f2468122eb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:16.092 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:16.087+0000 7f246dd296c0 1 --2- 10.20.193.96:0/4087186751 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2468115410 0x7f246811d650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:16.092 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:16.087+0000 7f246dd296c0 1 --2- 10.20.193.96:0/4087186751 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f246810f200 0x7f246811d110 unknown :-1 s=CLOSED pgs=422 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:16.092 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:16.087+0000 7f246dd296c0 1 -- 10.20.193.96:0/4087186751 >> 10.20.193.96:0/4087186751 conn(0x7f24680ecb00 msgr2=0x7f246810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:16.092 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:16.087+0000 7f246dd296c0 1 -- 10.20.193.96:0/4087186751 shutdown_connections 2026-02-13T03:37:16.092 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:16.087+0000 7f246dd296c0 1 -- 10.20.193.96:0/4087186751 wait complete. 2026-02-13T03:37:16.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:15 trial132 ceph-mon[26888]: pgmap v279: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:37:16.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:15 trial133 ceph-mon[26943]: pgmap v279: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:37:17.208 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:16 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/4087186751' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:17.208 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:16 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:37:17.209 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:16 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:37:17.209 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:16 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:37:17.209 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:16 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:37:17.209 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:16 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:37:17.209 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:16 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:37:17.209 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:16 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:37:17.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:16 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/4087186751' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:17.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:16 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:37:17.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:16 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:37:17.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:16 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:37:17.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:16 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:37:17.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:16 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:37:17.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:16 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:37:17.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:16 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:37:17.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:16 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/4087186751' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:17.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:16 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:37:17.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:16 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:37:17.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:16 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:37:17.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:16 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:37:17.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:16 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:37:17.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:16 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:37:17.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:16 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:37:18.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:17 trial133 ceph-mon[26943]: pgmap v280: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:18.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:17 trial133 ceph-mon[26943]: pgmap v281: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T03:37:18.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:17 trial133 ceph-mon[26943]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:37:18.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:17 trial133 ceph-mon[26943]: Cluster is now healthy 2026-02-13T03:37:18.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:17 trial096 ceph-mon[24671]: pgmap v280: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:18.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:17 trial096 ceph-mon[24671]: pgmap v281: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T03:37:18.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:17 trial096 ceph-mon[24671]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:37:18.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:17 trial096 ceph-mon[24671]: Cluster is now healthy 2026-02-13T03:37:18.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:17 trial132 ceph-mon[26888]: pgmap v280: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:18.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:17 trial132 ceph-mon[26888]: pgmap v281: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T03:37:18.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:17 trial132 ceph-mon[26888]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:37:18.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:17 trial132 ceph-mon[26888]: Cluster is now healthy 2026-02-13T03:37:19.133 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:37:19.251 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:37:19.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:18 trial133 ceph-mon[26943]: pgmap v282: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:37:19.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:18 trial133 ceph-mon[26943]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:37:19.273 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:18 trial096 ceph-mon[24671]: pgmap v282: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:37:19.273 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:18 trial096 ceph-mon[24671]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:37:19.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50cad286c0 1 -- 10.20.193.96:0/333633531 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f50c410fc20 msgr2=0x7f50c4114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:19.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50cad286c0 1 --2- 10.20.193.96:0/333633531 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f50c410fc20 0x7f50c4114c60 secure :-1 s=READY pgs=423 gs=1 cs=0 l=1 c_cookie=15495383603712965237 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50ac0099a0 tx=0x7f50ac02ed20 comp rx=0 tx=0).stop 2026-02-13T03:37:19.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50cad286c0 1 -- 10.20.193.96:0/333633531 shutdown_connections 2026-02-13T03:37:19.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50cad286c0 1 --2- 10.20.193.96:0/333633531 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f50c4115440 0x7f50c4175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:19.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50cad286c0 1 --2- 10.20.193.96:0/333633531 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f50c410fc20 0x7f50c4114c60 unknown :-1 s=CLOSED pgs=423 gs=1 cs=0 l=1 c_cookie=15495383603712965237 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:19.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50cad286c0 1 --2- 10.20.193.96:0/333633531 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f50c410f230 0x7f50c410f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:19.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50cad286c0 1 -- 10.20.193.96:0/333633531 >> 10.20.193.96:0/333633531 conn(0x7f50c40ecb30 msgr2=0x7f50c410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:19.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50cad286c0 1 -- 10.20.193.96:0/333633531 shutdown_connections 2026-02-13T03:37:19.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50cad286c0 1 -- 10.20.193.96:0/333633531 wait complete. 2026-02-13T03:37:19.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50cad286c0 1 Processor -- start 2026-02-13T03:37:19.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50cad286c0 1 -- start start 2026-02-13T03:37:19.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50cad286c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f50c410f230 0x7f50c411d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:19.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50cad286c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f50c4115440 0x7f50c411d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:19.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50cad286c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f50c4122ae0 0x7f50c4122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:19.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50cad286c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f50c41234f0 con 0x7f50c4122ae0 2026-02-13T03:37:19.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50cad286c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f50c4123660 con 0x7f50c410f230 2026-02-13T03:37:19.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50cad286c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f50c4123820 con 0x7f50c4115440 2026-02-13T03:37:19.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50c929e6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f50c4122ae0 0x7f50c4122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:19.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50c929e6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f50c4122ae0 0x7f50c4122f80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:35896/0 (socket says 10.20.193.96:35896) 2026-02-13T03:37:19.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50c929e6c0 1 -- 10.20.193.96:0/376047941 learned_addr learned my addr 10.20.193.96:0/376047941 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:37:19.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50c8a9d6c0 1 --2- 10.20.193.96:0/376047941 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f50c410f230 0x7f50c411d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:19.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50bbfff6c0 1 --2- 10.20.193.96:0/376047941 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f50c4115440 0x7f50c411d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:19.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50c929e6c0 1 -- 10.20.193.96:0/376047941 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f50c4115440 msgr2=0x7f50c411d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:19.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50c929e6c0 1 --2- 10.20.193.96:0/376047941 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f50c4115440 0x7f50c411d720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:19.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50c929e6c0 1 -- 10.20.193.96:0/376047941 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f50c410f230 msgr2=0x7f50c411d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:19.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50c929e6c0 1 --2- 10.20.193.96:0/376047941 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f50c410f230 0x7f50c411d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:19.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50c929e6c0 1 -- 10.20.193.96:0/376047941 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50ac009590 con 0x7f50c4122ae0 2026-02-13T03:37:19.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.366+0000 7f50bbfff6c0 1 --2- 10.20.193.96:0/376047941 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f50c4115440 0x7f50c411d720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:37:19.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.367+0000 7f50c929e6c0 1 --2- 10.20.193.96:0/376047941 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f50c4122ae0 0x7f50c4122f80 secure :-1 s=READY pgs=424 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50c0006ea0 tx=0x7f50c000ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:19.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.367+0000 7f50b9ffb6c0 1 -- 10.20.193.96:0/376047941 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50c0003c40 con 0x7f50c4122ae0 2026-02-13T03:37:19.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.367+0000 7f50cad286c0 1 -- 10.20.193.96:0/376047941 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c4163cd0 con 0x7f50c4122ae0 2026-02-13T03:37:19.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.367+0000 7f50b9ffb6c0 1 -- 10.20.193.96:0/376047941 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f50c0003da0 con 0x7f50c4122ae0 2026-02-13T03:37:19.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.367+0000 7f50b9ffb6c0 1 -- 10.20.193.96:0/376047941 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50c00081c0 con 0x7f50c4122ae0 2026-02-13T03:37:19.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.367+0000 7f50cad286c0 1 -- 10.20.193.96:0/376047941 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c41641b0 con 0x7f50c4122ae0 2026-02-13T03:37:19.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.367+0000 7f50cad286c0 1 -- 10.20.193.96:0/376047941 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c4110500 con 0x7f50c4122ae0 2026-02-13T03:37:19.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.368+0000 7f50b9ffb6c0 1 -- 10.20.193.96:0/376047941 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f50c0005860 con 0x7f50c4122ae0 2026-02-13T03:37:19.376 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.369+0000 7f50b9ffb6c0 1 --2- 10.20.193.96:0/376047941 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f50a00b5600 0x7f50a00d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:19.376 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.369+0000 7f50b9ffb6c0 1 -- 10.20.193.96:0/376047941 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f50c00e4bc0 con 0x7f50c4122ae0 2026-02-13T03:37:19.376 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.369+0000 7f50c8a9d6c0 1 --2- 10.20.193.96:0/376047941 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f50a00b5600 0x7f50a00d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:19.376 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.369+0000 7f50c8a9d6c0 1 --2- 10.20.193.96:0/376047941 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f50a00b5600 0x7f50a00d5ab0 secure :-1 s=READY pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50b4005980 tx=0x7f50b4005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:19.376 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.369+0000 7f50b9ffb6c0 1 -- 10.20.193.96:0/376047941 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f50c00a7620 con 0x7f50c4122ae0 2026-02-13T03:37:19.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:18 trial132 ceph-mon[26888]: pgmap v282: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:37:19.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:18 trial132 ceph-mon[26888]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:37:19.488 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.485+0000 7f50cad286c0 1 -- 10.20.193.96:0/376047941 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f50c410f600 con 0x7f50c4122ae0 2026-02-13T03:37:19.489 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.485+0000 7f50b9ffb6c0 1 -- 10.20.193.96:0/376047941 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f50c00aa7d0 con 0x7f50c4122ae0 2026-02-13T03:37:19.489 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:37:19.489 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:37:19.490 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.486+0000 7f50cad286c0 1 -- 10.20.193.96:0/376047941 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f50a00b5600 msgr2=0x7f50a00d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:19.490 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.486+0000 7f50cad286c0 1 --2- 10.20.193.96:0/376047941 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f50a00b5600 0x7f50a00d5ab0 secure :-1 s=READY pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50b4005980 tx=0x7f50b4005910 comp rx=0 tx=0).stop 2026-02-13T03:37:19.490 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.486+0000 7f50cad286c0 1 -- 10.20.193.96:0/376047941 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f50c4122ae0 msgr2=0x7f50c4122f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:19.490 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.486+0000 7f50cad286c0 1 --2- 10.20.193.96:0/376047941 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f50c4122ae0 0x7f50c4122f80 secure :-1 s=READY pgs=424 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50c0006ea0 tx=0x7f50c000ce50 comp rx=0 tx=0).stop 2026-02-13T03:37:19.490 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.486+0000 7f50cad286c0 1 -- 10.20.193.96:0/376047941 shutdown_connections 2026-02-13T03:37:19.491 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.486+0000 7f50cad286c0 1 --2- 10.20.193.96:0/376047941 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f50a00b5600 0x7f50a00d5ab0 unknown :-1 s=CLOSED pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:19.491 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.486+0000 7f50cad286c0 1 --2- 10.20.193.96:0/376047941 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f50c4122ae0 0x7f50c4122f80 unknown :-1 s=CLOSED pgs=424 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:19.491 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.486+0000 7f50cad286c0 1 --2- 10.20.193.96:0/376047941 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f50c4115440 0x7f50c411d720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:19.491 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.486+0000 7f50cad286c0 1 --2- 10.20.193.96:0/376047941 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f50c410f230 0x7f50c411d1e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:19.491 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.486+0000 7f50cad286c0 1 -- 10.20.193.96:0/376047941 >> 10.20.193.96:0/376047941 conn(0x7f50c40ecb30 msgr2=0x7f50c410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:19.491 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.486+0000 7f50cad286c0 1 -- 10.20.193.96:0/376047941 shutdown_connections 2026-02-13T03:37:19.491 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:19.486+0000 7f50cad286c0 1 -- 10.20.193.96:0/376047941 wait complete. 2026-02-13T03:37:20.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:19 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/376047941' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:20.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:19 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/376047941' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:20.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:20 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/376047941' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:21.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:20 trial133 ceph-mon[26943]: pgmap v283: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s rd, 3 op/s 2026-02-13T03:37:21.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:20 trial096 ceph-mon[24671]: pgmap v283: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s rd, 3 op/s 2026-02-13T03:37:21.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:21 trial132 ceph-mon[26888]: pgmap v283: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s rd, 3 op/s 2026-02-13T03:37:22.530 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:37:22.648 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:37:22.771 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.765+0000 7fb1aac746c0 1 -- 10.20.193.96:0/722734562 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb1a410f230 msgr2=0x7fb1a410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:22.771 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.765+0000 7fb1aac746c0 1 --2- 10.20.193.96:0/722734562 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb1a410f230 0x7fb1a410f600 secure :-1 s=READY pgs=425 gs=1 cs=0 l=1 c_cookie=3604505464765660983 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1940099a0 tx=0x7fb19402ed20 comp rx=0 tx=0).stop 2026-02-13T03:37:22.772 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.765+0000 7fb1aac746c0 1 -- 10.20.193.96:0/722734562 shutdown_connections 2026-02-13T03:37:22.772 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.765+0000 7fb1aac746c0 1 --2- 10.20.193.96:0/722734562 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb1a4115440 0x7fb1a4175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:22.772 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.765+0000 7fb1aac746c0 1 --2- 10.20.193.96:0/722734562 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb1a410fc20 0x7fb1a4114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:22.772 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.765+0000 7fb1aac746c0 1 --2- 10.20.193.96:0/722734562 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb1a410f230 0x7fb1a410f600 unknown :-1 s=CLOSED pgs=425 gs=1 cs=0 l=1 c_cookie=3604505464765660983 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:22.772 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.765+0000 7fb1aac746c0 1 -- 10.20.193.96:0/722734562 >> 10.20.193.96:0/722734562 conn(0x7fb1a40ecb30 msgr2=0x7fb1a410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:22.772 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.765+0000 7fb1aac746c0 1 -- 10.20.193.96:0/722734562 shutdown_connections 2026-02-13T03:37:22.772 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.765+0000 7fb1aac746c0 1 -- 10.20.193.96:0/722734562 wait complete. 2026-02-13T03:37:22.772 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb1aac746c0 1 Processor -- start 2026-02-13T03:37:22.772 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb1aac746c0 1 -- start start 2026-02-13T03:37:22.772 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb1aac746c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb1a410f230 0x7fb1a411d1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:22.772 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb1aac746c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb1a4115440 0x7fb1a411d700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:22.773 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb1aac746c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb1a4122ac0 0x7fb1a4122f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:22.773 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb1aac746c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a41234d0 con 0x7fb1a410f230 2026-02-13T03:37:22.773 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb1aac746c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a4123640 con 0x7fb1a4122ac0 2026-02-13T03:37:22.773 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb1aac746c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a4123800 con 0x7fb1a4115440 2026-02-13T03:37:22.773 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb1a89e56c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb1a410f230 0x7fb1a411d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:22.773 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb1a89e56c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb1a410f230 0x7fb1a411d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:35904/0 (socket says 10.20.193.96:35904) 2026-02-13T03:37:22.773 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb1a89e56c0 1 -- 10.20.193.96:0/3872921504 learned_addr learned my addr 10.20.193.96:0/3872921504 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:37:22.773 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb1a91e66c0 1 --2- 10.20.193.96:0/3872921504 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb1a4122ac0 0x7fb1a4122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:22.773 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb1a89e56c0 1 -- 10.20.193.96:0/3872921504 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb1a4115440 msgr2=0x7fb1a411d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:22.773 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb19bfff6c0 1 --2- 10.20.193.96:0/3872921504 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb1a4115440 0x7fb1a411d700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:22.773 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb1a89e56c0 1 --2- 10.20.193.96:0/3872921504 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb1a4115440 0x7fb1a411d700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:22.773 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb1a89e56c0 1 -- 10.20.193.96:0/3872921504 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb1a4122ac0 msgr2=0x7fb1a4122f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:22.774 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb1a89e56c0 1 --2- 10.20.193.96:0/3872921504 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb1a4122ac0 0x7fb1a4122f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:22.774 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb1a89e56c0 1 -- 10.20.193.96:0/3872921504 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb194009590 con 0x7fb1a410f230 2026-02-13T03:37:22.774 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb19bfff6c0 1 --2- 10.20.193.96:0/3872921504 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb1a4115440 0x7fb1a411d700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:37:22.774 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb1a91e66c0 1 --2- 10.20.193.96:0/3872921504 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb1a4122ac0 0x7fb1a4122f60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:37:22.774 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb1a89e56c0 1 --2- 10.20.193.96:0/3872921504 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb1a410f230 0x7fb1a411d1c0 secure :-1 s=READY pgs=426 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb19402f230 tx=0x7fb19402fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:22.774 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb199ffb6c0 1 -- 10.20.193.96:0/3872921504 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb194002ae0 con 0x7fb1a410f230 2026-02-13T03:37:22.774 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb199ffb6c0 1 -- 10.20.193.96:0/3872921504 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fb194002c40 con 0x7fb1a410f230 2026-02-13T03:37:22.774 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb1aac746c0 1 -- 10.20.193.96:0/3872921504 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1a4163c50 con 0x7fb1a410f230 2026-02-13T03:37:22.774 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb199ffb6c0 1 -- 10.20.193.96:0/3872921504 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb1940372f0 con 0x7fb1a410f230 2026-02-13T03:37:22.774 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.766+0000 7fb1aac746c0 1 -- 10.20.193.96:0/3872921504 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1a41640d0 con 0x7fb1a410f230 2026-02-13T03:37:22.774 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.767+0000 7fb1aac746c0 1 -- 10.20.193.96:0/3872921504 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1a4110500 con 0x7fb1a410f230 2026-02-13T03:37:22.776 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.768+0000 7fb199ffb6c0 1 -- 10.20.193.96:0/3872921504 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fb1940078f0 con 0x7fb1a410f230 2026-02-13T03:37:22.776 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.769+0000 7fb199ffb6c0 1 --2- 10.20.193.96:0/3872921504 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb1800b5680 0x7fb1800d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:22.776 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.769+0000 7fb19bfff6c0 1 --2- 10.20.193.96:0/3872921504 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb1800b5680 0x7fb1800d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:22.776 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.769+0000 7fb199ffb6c0 1 -- 10.20.193.96:0/3872921504 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7fb194107ce0 con 0x7fb1a410f230 2026-02-13T03:37:22.776 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.769+0000 7fb199ffb6c0 1 -- 10.20.193.96:0/3872921504 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb1940ca740 con 0x7fb1a410f230 2026-02-13T03:37:22.776 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.769+0000 7fb19bfff6c0 1 --2- 10.20.193.96:0/3872921504 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb1800b5680 0x7fb1800d5b30 secure :-1 s=READY pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1a4123b50 tx=0x7fb18c009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:22.886 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.883+0000 7fb1aac746c0 1 -- 10.20.193.96:0/3872921504 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb1a410f600 con 0x7fb1a410f230 2026-02-13T03:37:22.887 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.883+0000 7fb199ffb6c0 1 -- 10.20.193.96:0/3872921504 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb1940cd8f0 con 0x7fb1a410f230 2026-02-13T03:37:22.887 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:37:22.887 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:37:22.888 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.884+0000 7fb1aac746c0 1 -- 10.20.193.96:0/3872921504 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb1800b5680 msgr2=0x7fb1800d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:22.888 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.884+0000 7fb1aac746c0 1 --2- 10.20.193.96:0/3872921504 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb1800b5680 0x7fb1800d5b30 secure :-1 s=READY pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1a4123b50 tx=0x7fb18c009260 comp rx=0 tx=0).stop 2026-02-13T03:37:22.888 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.884+0000 7fb1aac746c0 1 -- 10.20.193.96:0/3872921504 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb1a410f230 msgr2=0x7fb1a411d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:22.888 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.884+0000 7fb1aac746c0 1 --2- 10.20.193.96:0/3872921504 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb1a410f230 0x7fb1a411d1c0 secure :-1 s=READY pgs=426 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb19402f230 tx=0x7fb19402fc70 comp rx=0 tx=0).stop 2026-02-13T03:37:22.888 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.884+0000 7fb1aac746c0 1 -- 10.20.193.96:0/3872921504 shutdown_connections 2026-02-13T03:37:22.889 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.884+0000 7fb1aac746c0 1 --2- 10.20.193.96:0/3872921504 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fb1800b5680 0x7fb1800d5b30 unknown :-1 s=CLOSED pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:22.889 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.884+0000 7fb1aac746c0 1 --2- 10.20.193.96:0/3872921504 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fb1a4122ac0 0x7fb1a4122f60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:22.889 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.884+0000 7fb1aac746c0 1 --2- 10.20.193.96:0/3872921504 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fb1a4115440 0x7fb1a411d700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:22.889 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.884+0000 7fb1aac746c0 1 --2- 10.20.193.96:0/3872921504 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fb1a410f230 0x7fb1a411d1c0 unknown :-1 s=CLOSED pgs=426 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:22.889 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.884+0000 7fb1aac746c0 1 -- 10.20.193.96:0/3872921504 >> 10.20.193.96:0/3872921504 conn(0x7fb1a40ecb30 msgr2=0x7fb1a410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:22.889 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.884+0000 7fb1aac746c0 1 -- 10.20.193.96:0/3872921504 shutdown_connections 2026-02-13T03:37:22.889 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:22.884+0000 7fb1aac746c0 1 -- 10.20.193.96:0/3872921504 wait complete. 2026-02-13T03:37:23.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:22 trial096 ceph-mon[24671]: pgmap v284: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:37:23.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3872921504' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:23.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:22 trial133 ceph-mon[26943]: pgmap v284: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:37:23.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3872921504' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:23.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:23 trial132 ceph-mon[26888]: pgmap v284: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:37:23.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:23 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3872921504' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:25.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:24 trial133 ceph-mon[26943]: pgmap v285: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:37:25.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:24 trial096 ceph-mon[24671]: pgmap v285: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:37:25.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:25 trial132 ceph-mon[26888]: pgmap v285: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:37:25.928 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:37:26.045 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:37:26.167 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.162+0000 7f9dbe4ef6c0 1 -- 10.20.193.96:0/3466885228 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9db810f230 msgr2=0x7f9db810f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:26.167 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.162+0000 7f9dbe4ef6c0 1 --2- 10.20.193.96:0/3466885228 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9db810f230 0x7f9db810f600 secure :-1 s=READY pgs=427 gs=1 cs=0 l=1 c_cookie=15241742726776191204 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9da40099a0 tx=0x7f9da402ed20 comp rx=0 tx=0).stop 2026-02-13T03:37:26.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.162+0000 7f9dbe4ef6c0 1 -- 10.20.193.96:0/3466885228 shutdown_connections 2026-02-13T03:37:26.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.162+0000 7f9dbe4ef6c0 1 --2- 10.20.193.96:0/3466885228 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9db8115440 0x7f9db8175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:26.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.162+0000 7f9dbe4ef6c0 1 --2- 10.20.193.96:0/3466885228 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9db810fc20 0x7f9db8114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:26.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.162+0000 7f9dbe4ef6c0 1 --2- 10.20.193.96:0/3466885228 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9db810f230 0x7f9db810f600 unknown :-1 s=CLOSED pgs=427 gs=1 cs=0 l=1 c_cookie=15241742726776191204 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:26.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.162+0000 7f9dbe4ef6c0 1 -- 10.20.193.96:0/3466885228 >> 10.20.193.96:0/3466885228 conn(0x7f9db80ecb30 msgr2=0x7f9db810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:26.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.162+0000 7f9dbe4ef6c0 1 -- 10.20.193.96:0/3466885228 shutdown_connections 2026-02-13T03:37:26.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.162+0000 7f9dbe4ef6c0 1 -- 10.20.193.96:0/3466885228 wait complete. 2026-02-13T03:37:26.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.162+0000 7f9dbe4ef6c0 1 Processor -- start 2026-02-13T03:37:26.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.162+0000 7f9dbe4ef6c0 1 -- start start 2026-02-13T03:37:26.168 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.162+0000 7f9dbe4ef6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9db810f230 0x7f9db811d220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:26.169 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.162+0000 7f9dbe4ef6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9db8115440 0x7f9db811d760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:26.169 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.162+0000 7f9dbe4ef6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9db8122b20 0x7f9db8122fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:26.169 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.162+0000 7f9dbe4ef6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9db8123530 con 0x7f9db810f230 2026-02-13T03:37:26.169 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.162+0000 7f9dbe4ef6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9db81236a0 con 0x7f9db8115440 2026-02-13T03:37:26.169 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.162+0000 7f9dbe4ef6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9db8123860 con 0x7f9db8122b20 2026-02-13T03:37:26.169 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.162+0000 7f9db7fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9db810f230 0x7f9db811d220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:26.169 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.162+0000 7f9db7fff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9db810f230 0x7f9db811d220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:56356/0 (socket says 10.20.193.96:56356) 2026-02-13T03:37:26.169 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.162+0000 7f9db7fff6c0 1 -- 10.20.193.96:0/964918663 learned_addr learned my addr 10.20.193.96:0/964918663 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:37:26.169 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.162+0000 7f9dbca616c0 1 --2- 10.20.193.96:0/964918663 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9db8122b20 0x7f9db8122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:26.169 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.163+0000 7f9db77fe6c0 1 --2- 10.20.193.96:0/964918663 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9db8115440 0x7f9db811d760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:26.169 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.163+0000 7f9db7fff6c0 1 -- 10.20.193.96:0/964918663 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9db8122b20 msgr2=0x7f9db8122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:26.169 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.163+0000 7f9db7fff6c0 1 --2- 10.20.193.96:0/964918663 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9db8122b20 0x7f9db8122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:26.170 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.163+0000 7f9db7fff6c0 1 -- 10.20.193.96:0/964918663 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9db8115440 msgr2=0x7f9db811d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:26.170 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.163+0000 7f9db7fff6c0 1 --2- 10.20.193.96:0/964918663 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9db8115440 0x7f9db811d760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:26.170 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.163+0000 7f9db7fff6c0 1 -- 10.20.193.96:0/964918663 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da4009590 con 0x7f9db810f230 2026-02-13T03:37:26.170 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.163+0000 7f9db7fff6c0 1 --2- 10.20.193.96:0/964918663 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9db810f230 0x7f9db811d220 secure :-1 s=READY pgs=428 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9da40098c0 tx=0x7f9da40047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:26.170 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.163+0000 7f9db57fa6c0 1 -- 10.20.193.96:0/964918663 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9da4002ae0 con 0x7f9db810f230 2026-02-13T03:37:26.170 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.163+0000 7f9db57fa6c0 1 -- 10.20.193.96:0/964918663 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f9da4007740 con 0x7f9db810f230 2026-02-13T03:37:26.170 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.163+0000 7f9dbe4ef6c0 1 -- 10.20.193.96:0/964918663 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9db8163cb0 con 0x7f9db810f230 2026-02-13T03:37:26.170 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.163+0000 7f9db57fa6c0 1 -- 10.20.193.96:0/964918663 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9da4037690 con 0x7f9db810f230 2026-02-13T03:37:26.170 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.163+0000 7f9dbe4ef6c0 1 -- 10.20.193.96:0/964918663 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9db81640e0 con 0x7f9db810f230 2026-02-13T03:37:26.170 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.163+0000 7f9dbe4ef6c0 1 -- 10.20.193.96:0/964918663 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9db8110500 con 0x7f9db810f230 2026-02-13T03:37:26.171 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.165+0000 7f9db57fa6c0 1 -- 10.20.193.96:0/964918663 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f9da4002c80 con 0x7f9db810f230 2026-02-13T03:37:26.172 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.165+0000 7f9db57fa6c0 1 --2- 10.20.193.96:0/964918663 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9d8c0b5600 0x7f9d8c0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:26.172 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.165+0000 7f9db57fa6c0 1 -- 10.20.193.96:0/964918663 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f9da4107c70 con 0x7f9db810f230 2026-02-13T03:37:26.172 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.165+0000 7f9db77fe6c0 1 --2- 10.20.193.96:0/964918663 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9d8c0b5600 0x7f9d8c0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:26.172 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.165+0000 7f9db77fe6c0 1 --2- 10.20.193.96:0/964918663 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9d8c0b5600 0x7f9d8c0d5ab0 secure :-1 s=READY pgs=278 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9da8005980 tx=0x7f9da8005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:26.172 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.166+0000 7f9db57fa6c0 1 -- 10.20.193.96:0/964918663 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9da40ca710 con 0x7f9db810f230 2026-02-13T03:37:26.286 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.282+0000 7f9dbe4ef6c0 1 -- 10.20.193.96:0/964918663 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9db810fc20 con 0x7f9db810f230 2026-02-13T03:37:26.286 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.282+0000 7f9db57fa6c0 1 -- 10.20.193.96:0/964918663 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f9da40cd8c0 con 0x7f9db810f230 2026-02-13T03:37:26.286 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:37:26.286 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:37:26.288 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.284+0000 7f9dbe4ef6c0 1 -- 10.20.193.96:0/964918663 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9d8c0b5600 msgr2=0x7f9d8c0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:26.288 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.284+0000 7f9dbe4ef6c0 1 --2- 10.20.193.96:0/964918663 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9d8c0b5600 0x7f9d8c0d5ab0 secure :-1 s=READY pgs=278 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9da8005980 tx=0x7f9da8005910 comp rx=0 tx=0).stop 2026-02-13T03:37:26.288 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.284+0000 7f9dbe4ef6c0 1 -- 10.20.193.96:0/964918663 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9db810f230 msgr2=0x7f9db811d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:26.288 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.284+0000 7f9dbe4ef6c0 1 --2- 10.20.193.96:0/964918663 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9db810f230 0x7f9db811d220 secure :-1 s=READY pgs=428 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9da40098c0 tx=0x7f9da40047f0 comp rx=0 tx=0).stop 2026-02-13T03:37:26.288 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.284+0000 7f9dbe4ef6c0 1 -- 10.20.193.96:0/964918663 shutdown_connections 2026-02-13T03:37:26.288 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.284+0000 7f9dbe4ef6c0 1 --2- 10.20.193.96:0/964918663 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f9d8c0b5600 0x7f9d8c0d5ab0 unknown :-1 s=CLOSED pgs=278 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:26.288 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.284+0000 7f9dbe4ef6c0 1 --2- 10.20.193.96:0/964918663 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f9db8122b20 0x7f9db8122fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:26.288 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.284+0000 7f9dbe4ef6c0 1 --2- 10.20.193.96:0/964918663 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f9db8115440 0x7f9db811d760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:26.288 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.284+0000 7f9dbe4ef6c0 1 --2- 10.20.193.96:0/964918663 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f9db810f230 0x7f9db811d220 unknown :-1 s=CLOSED pgs=428 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:26.289 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.284+0000 7f9dbe4ef6c0 1 -- 10.20.193.96:0/964918663 >> 10.20.193.96:0/964918663 conn(0x7f9db80ecb30 msgr2=0x7f9db810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:26.289 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.284+0000 7f9dbe4ef6c0 1 -- 10.20.193.96:0/964918663 shutdown_connections 2026-02-13T03:37:26.289 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:26.284+0000 7f9dbe4ef6c0 1 -- 10.20.193.96:0/964918663 wait complete. 2026-02-13T03:37:27.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:26 trial133 ceph-mon[26943]: pgmap v286: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:37:27.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:26 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/964918663' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:27.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:26 trial096 ceph-mon[24671]: pgmap v286: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:37:27.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:26 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/964918663' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:27.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:27 trial132 ceph-mon[26888]: pgmap v286: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:37:27.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:27 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/964918663' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:29.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:28 trial133 ceph-mon[26943]: pgmap v287: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 6 op/s 2026-02-13T03:37:29.327 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:37:29.350 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:28 trial096 ceph-mon[24671]: pgmap v287: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 6 op/s 2026-02-13T03:37:29.444 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:37:29.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:29 trial132 ceph-mon[26888]: pgmap v287: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 6 op/s 2026-02-13T03:37:29.565 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.560+0000 7fd05bbf06c0 1 -- 10.20.193.96:0/4083960871 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd05410fbf0 msgr2=0x7fd054114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:29.566 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.560+0000 7fd05bbf06c0 1 --2- 10.20.193.96:0/4083960871 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd05410fbf0 0x7fd054114c30 secure :-1 s=READY pgs=429 gs=1 cs=0 l=1 c_cookie=13223449354995384312 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0480099a0 tx=0x7fd04802ed20 comp rx=0 tx=0).stop 2026-02-13T03:37:29.566 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.560+0000 7fd05bbf06c0 1 -- 10.20.193.96:0/4083960871 shutdown_connections 2026-02-13T03:37:29.566 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.560+0000 7fd05bbf06c0 1 --2- 10.20.193.96:0/4083960871 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd054115410 0x7fd054175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:29.566 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.560+0000 7fd05bbf06c0 1 --2- 10.20.193.96:0/4083960871 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd05410fbf0 0x7fd054114c30 unknown :-1 s=CLOSED pgs=429 gs=1 cs=0 l=1 c_cookie=13223449354995384312 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:29.566 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.560+0000 7fd05bbf06c0 1 --2- 10.20.193.96:0/4083960871 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd05410f200 0x7fd05410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:29.566 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.560+0000 7fd05bbf06c0 1 -- 10.20.193.96:0/4083960871 >> 10.20.193.96:0/4083960871 conn(0x7fd0540ecb00 msgr2=0x7fd05410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:29.566 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.560+0000 7fd05bbf06c0 1 -- 10.20.193.96:0/4083960871 shutdown_connections 2026-02-13T03:37:29.566 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.560+0000 7fd05bbf06c0 1 -- 10.20.193.96:0/4083960871 wait complete. 2026-02-13T03:37:29.566 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.560+0000 7fd05bbf06c0 1 Processor -- start 2026-02-13T03:37:29.566 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.560+0000 7fd05bbf06c0 1 -- start start 2026-02-13T03:37:29.566 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.560+0000 7fd05bbf06c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd05410f200 0x7fd0540f4c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:29.567 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.560+0000 7fd05bbf06c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd054115410 0x7fd054175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:29.567 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.560+0000 7fd05bbf06c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd0540f5280 0x7fd0540fa550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:29.567 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.560+0000 7fd05bbf06c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd0540f5970 con 0x7fd05410f200 2026-02-13T03:37:29.567 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.560+0000 7fd05bbf06c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd0540faa90 con 0x7fd0540f5280 2026-02-13T03:37:29.567 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.560+0000 7fd05bbf06c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd0540fac50 con 0x7fd054115410 2026-02-13T03:37:29.567 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.560+0000 7fd0599656c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd05410f200 0x7fd0540f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:29.567 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.560+0000 7fd0599656c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd05410f200 0x7fd0540f4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:56382/0 (socket says 10.20.193.96:56382) 2026-02-13T03:37:29.567 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.560+0000 7fd0599656c0 1 -- 10.20.193.96:0/3214885168 learned_addr learned my addr 10.20.193.96:0/3214885168 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:37:29.567 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.560+0000 7fd05a1666c0 1 --2- 10.20.193.96:0/3214885168 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd0540f5280 0x7fd0540fa550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:29.567 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.560+0000 7fd0591646c0 1 --2- 10.20.193.96:0/3214885168 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd054115410 0x7fd054175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:29.567 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.561+0000 7fd0599656c0 1 -- 10.20.193.96:0/3214885168 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd054115410 msgr2=0x7fd054175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:29.567 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.561+0000 7fd0599656c0 1 --2- 10.20.193.96:0/3214885168 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd054115410 0x7fd054175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:29.567 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.561+0000 7fd0599656c0 1 -- 10.20.193.96:0/3214885168 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd0540f5280 msgr2=0x7fd0540fa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:29.568 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.561+0000 7fd0599656c0 1 --2- 10.20.193.96:0/3214885168 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd0540f5280 0x7fd0540fa550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:29.568 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.561+0000 7fd0599656c0 1 -- 10.20.193.96:0/3214885168 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd048009590 con 0x7fd05410f200 2026-02-13T03:37:29.568 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.561+0000 7fd0599656c0 1 --2- 10.20.193.96:0/3214885168 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd05410f200 0x7fd0540f4c50 secure :-1 s=READY pgs=430 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd04400b710 tx=0x7fd04400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:29.568 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.561+0000 7fd042ffd6c0 1 -- 10.20.193.96:0/3214885168 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd044004250 con 0x7fd05410f200 2026-02-13T03:37:29.568 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.561+0000 7fd05bbf06c0 1 -- 10.20.193.96:0/3214885168 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0540faf30 con 0x7fd05410f200 2026-02-13T03:37:29.568 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.561+0000 7fd042ffd6c0 1 -- 10.20.193.96:0/3214885168 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fd044002da0 con 0x7fd05410f200 2026-02-13T03:37:29.568 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.561+0000 7fd042ffd6c0 1 -- 10.20.193.96:0/3214885168 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd04400ce50 con 0x7fd05410f200 2026-02-13T03:37:29.568 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.561+0000 7fd05bbf06c0 1 -- 10.20.193.96:0/3214885168 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0540fb6c0 con 0x7fd05410f200 2026-02-13T03:37:29.568 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.561+0000 7fd05bbf06c0 1 -- 10.20.193.96:0/3214885168 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0541104d0 con 0x7fd05410f200 2026-02-13T03:37:29.569 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.563+0000 7fd042ffd6c0 1 -- 10.20.193.96:0/3214885168 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fd0440043b0 con 0x7fd05410f200 2026-02-13T03:37:29.569 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.563+0000 7fd042ffd6c0 1 --2- 10.20.193.96:0/3214885168 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd0300b55f0 0x7fd0300d5aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:29.570 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.563+0000 7fd042ffd6c0 1 -- 10.20.193.96:0/3214885168 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7fd0440e39b0 con 0x7fd05410f200 2026-02-13T03:37:29.570 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.563+0000 7fd0591646c0 1 --2- 10.20.193.96:0/3214885168 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd0300b55f0 0x7fd0300d5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:29.570 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.563+0000 7fd042ffd6c0 1 -- 10.20.193.96:0/3214885168 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd0440a9420 con 0x7fd05410f200 2026-02-13T03:37:29.570 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.564+0000 7fd0591646c0 1 --2- 10.20.193.96:0/3214885168 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd0300b55f0 0x7fd0300d5aa0 secure :-1 s=READY pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0540fb5e0 tx=0x7fd0480023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:29.681 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.677+0000 7fd05bbf06c0 1 -- 10.20.193.96:0/3214885168 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd0540f5da0 con 0x7fd05410f200 2026-02-13T03:37:29.681 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.677+0000 7fd042ffd6c0 1 -- 10.20.193.96:0/3214885168 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd0440a9600 con 0x7fd05410f200 2026-02-13T03:37:29.681 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:37:29.681 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:37:29.682 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.678+0000 7fd05bbf06c0 1 -- 10.20.193.96:0/3214885168 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd0300b55f0 msgr2=0x7fd0300d5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:29.682 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.678+0000 7fd05bbf06c0 1 --2- 10.20.193.96:0/3214885168 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd0300b55f0 0x7fd0300d5aa0 secure :-1 s=READY pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0540fb5e0 tx=0x7fd0480023a0 comp rx=0 tx=0).stop 2026-02-13T03:37:29.682 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.678+0000 7fd05bbf06c0 1 -- 10.20.193.96:0/3214885168 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd05410f200 msgr2=0x7fd0540f4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:29.683 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.678+0000 7fd05bbf06c0 1 --2- 10.20.193.96:0/3214885168 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd05410f200 0x7fd0540f4c50 secure :-1 s=READY pgs=430 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd04400b710 tx=0x7fd04400bbe0 comp rx=0 tx=0).stop 2026-02-13T03:37:29.683 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.678+0000 7fd05bbf06c0 1 -- 10.20.193.96:0/3214885168 shutdown_connections 2026-02-13T03:37:29.683 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.678+0000 7fd05bbf06c0 1 --2- 10.20.193.96:0/3214885168 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fd0300b55f0 0x7fd0300d5aa0 unknown :-1 s=CLOSED pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:29.683 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.678+0000 7fd05bbf06c0 1 --2- 10.20.193.96:0/3214885168 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fd0540f5280 0x7fd0540fa550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:29.683 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.678+0000 7fd05bbf06c0 1 --2- 10.20.193.96:0/3214885168 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fd054115410 0x7fd054175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:29.683 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.678+0000 7fd05bbf06c0 1 --2- 10.20.193.96:0/3214885168 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fd05410f200 0x7fd0540f4c50 unknown :-1 s=CLOSED pgs=430 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:29.683 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.678+0000 7fd05bbf06c0 1 -- 10.20.193.96:0/3214885168 >> 10.20.193.96:0/3214885168 conn(0x7fd0540ecb00 msgr2=0x7fd05410d900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:29.683 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.678+0000 7fd05bbf06c0 1 -- 10.20.193.96:0/3214885168 shutdown_connections 2026-02-13T03:37:29.683 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:29.678+0000 7fd05bbf06c0 1 -- 10.20.193.96:0/3214885168 wait complete. 2026-02-13T03:37:30.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:30 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3214885168' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:30.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:30 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3214885168' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:30.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:30 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3214885168' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:31.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:31 trial133 ceph-mon[26943]: pgmap v288: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:37:31.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:31 trial096 ceph-mon[24671]: pgmap v288: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:37:31.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:31 trial132 ceph-mon[26888]: pgmap v288: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:37:32.722 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:37:32.843 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:37:32.968 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.963+0000 7ff87c1646c0 1 -- 10.20.193.96:0/2063377800 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff874060200 msgr2=0x7ff8741129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:32.968 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.963+0000 7ff87c1646c0 1 --2- 10.20.193.96:0/2063377800 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff874060200 0x7ff8741129e0 secure :-1 s=READY pgs=431 gs=1 cs=0 l=1 c_cookie=2778267065090923739 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8680099a0 tx=0x7ff86802ed20 comp rx=0 tx=0).stop 2026-02-13T03:37:32.968 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.963+0000 7ff87c1646c0 1 -- 10.20.193.96:0/2063377800 shutdown_connections 2026-02-13T03:37:32.969 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.963+0000 7ff87c1646c0 1 --2- 10.20.193.96:0/2063377800 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff8741131c0 0x7ff874173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:32.969 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.963+0000 7ff87c1646c0 1 --2- 10.20.193.96:0/2063377800 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff874060200 0x7ff8741129e0 unknown :-1 s=CLOSED pgs=431 gs=1 cs=0 l=1 c_cookie=2778267065090923739 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:32.969 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.963+0000 7ff87c1646c0 1 --2- 10.20.193.96:0/2063377800 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff87405f810 0x7ff87405fbe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:32.969 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.963+0000 7ff87c1646c0 1 -- 10.20.193.96:0/2063377800 >> 10.20.193.96:0/2063377800 conn(0x7ff8740e9770 msgr2=0x7ff874109b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:32.969 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.963+0000 7ff87c1646c0 1 -- 10.20.193.96:0/2063377800 shutdown_connections 2026-02-13T03:37:32.969 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.963+0000 7ff87c1646c0 1 -- 10.20.193.96:0/2063377800 wait complete. 2026-02-13T03:37:32.969 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.964+0000 7ff87c1646c0 1 Processor -- start 2026-02-13T03:37:32.969 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.964+0000 7ff87c1646c0 1 -- start start 2026-02-13T03:37:32.969 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.964+0000 7ff87c1646c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff87405f810 0x7ff8740f3b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:32.969 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.964+0000 7ff87c1646c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff8741131c0 0x7ff874173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:32.969 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.964+0000 7ff87c1646c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8740f4150 0x7ff8740f9420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.964+0000 7ff87c1646c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff8740f4840 con 0x7ff8740f4150 2026-02-13T03:37:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.964+0000 7ff87c1646c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff8740f9960 con 0x7ff8741131c0 2026-02-13T03:37:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.964+0000 7ff87c1646c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff8740f9b20 con 0x7ff87405f810 2026-02-13T03:37:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.964+0000 7ff87a6da6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8740f4150 0x7ff8740f9420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.964+0000 7ff87a6da6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8740f4150 0x7ff8740f9420 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:56396/0 (socket says 10.20.193.96:56396) 2026-02-13T03:37:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.964+0000 7ff87a6da6c0 1 -- 10.20.193.96:0/1767434042 learned_addr learned my addr 10.20.193.96:0/1767434042 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:37:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.964+0000 7ff879ed96c0 1 --2- 10.20.193.96:0/1767434042 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff87405f810 0x7ff8740f3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.964+0000 7ff87a6da6c0 1 -- 10.20.193.96:0/1767434042 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff87405f810 msgr2=0x7ff8740f3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.964+0000 7ff87a6da6c0 1 --2- 10.20.193.96:0/1767434042 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff87405f810 0x7ff8740f3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.964+0000 7ff87a6da6c0 1 -- 10.20.193.96:0/1767434042 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff8741131c0 msgr2=0x7ff874173a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.964+0000 7ff87a6da6c0 1 --2- 10.20.193.96:0/1767434042 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff8741131c0 0x7ff874173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.964+0000 7ff87a6da6c0 1 -- 10.20.193.96:0/1767434042 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff868009590 con 0x7ff8740f4150 2026-02-13T03:37:32.970 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.964+0000 7ff879ed96c0 1 --2- 10.20.193.96:0/1767434042 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff87405f810 0x7ff8740f3b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:37:32.971 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.964+0000 7ff87a6da6c0 1 --2- 10.20.193.96:0/1767434042 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8740f4150 0x7ff8740f9420 secure :-1 s=READY pgs=432 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff870006ea0 tx=0x7ff87000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:32.971 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.964+0000 7ff862ffd6c0 1 -- 10.20.193.96:0/1767434042 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff870003a30 con 0x7ff8740f4150 2026-02-13T03:37:32.971 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.964+0000 7ff862ffd6c0 1 -- 10.20.193.96:0/1767434042 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7ff870005510 con 0x7ff8740f4150 2026-02-13T03:37:32.971 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.964+0000 7ff87c1646c0 1 -- 10.20.193.96:0/1767434042 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8740f9e00 con 0x7ff8740f4150 2026-02-13T03:37:32.971 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.964+0000 7ff862ffd6c0 1 -- 10.20.193.96:0/1767434042 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff87000dd70 con 0x7ff8740f4150 2026-02-13T03:37:32.971 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.964+0000 7ff87c1646c0 1 -- 10.20.193.96:0/1767434042 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8740fa590 con 0x7ff8740f4150 2026-02-13T03:37:32.971 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.965+0000 7ff87c1646c0 1 -- 10.20.193.96:0/1767434042 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8740fa2e0 con 0x7ff8740f4150 2026-02-13T03:37:32.972 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.966+0000 7ff862ffd6c0 1 -- 10.20.193.96:0/1767434042 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7ff870003b90 con 0x7ff8740f4150 2026-02-13T03:37:32.972 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.967+0000 7ff862ffd6c0 1 --2- 10.20.193.96:0/1767434042 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff8500b5600 0x7ff8500d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:32.972 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.967+0000 7ff879ed96c0 1 --2- 10.20.193.96:0/1767434042 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff8500b5600 0x7ff8500d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:32.972 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.967+0000 7ff862ffd6c0 1 -- 10.20.193.96:0/1767434042 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7ff8700e4a60 con 0x7ff8740f4150 2026-02-13T03:37:32.973 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.967+0000 7ff862ffd6c0 1 -- 10.20.193.96:0/1767434042 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff8700aaf20 con 0x7ff8740f4150 2026-02-13T03:37:32.973 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:32.967+0000 7ff879ed96c0 1 --2- 10.20.193.96:0/1767434042 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff8500b5600 0x7ff8500d5ab0 secure :-1 s=READY pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff864004750 tx=0x7ff864009630 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:33.085 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:33.082+0000 7ff87c1646c0 1 -- 10.20.193.96:0/1767434042 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff87410e280 con 0x7ff8740f4150 2026-02-13T03:37:33.085 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:37:33.086 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:37:33.087 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:33.082+0000 7ff862ffd6c0 1 -- 10.20.193.96:0/1767434042 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff8700aa670 con 0x7ff8740f4150 2026-02-13T03:37:33.087 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:33.083+0000 7ff87c1646c0 1 -- 10.20.193.96:0/1767434042 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff8500b5600 msgr2=0x7ff8500d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:33.087 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:33.083+0000 7ff87c1646c0 1 --2- 10.20.193.96:0/1767434042 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff8500b5600 0x7ff8500d5ab0 secure :-1 s=READY pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff864004750 tx=0x7ff864009630 comp rx=0 tx=0).stop 2026-02-13T03:37:33.087 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:33.083+0000 7ff87c1646c0 1 -- 10.20.193.96:0/1767434042 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8740f4150 msgr2=0x7ff8740f9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:33.087 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:33.083+0000 7ff87c1646c0 1 --2- 10.20.193.96:0/1767434042 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8740f4150 0x7ff8740f9420 secure :-1 s=READY pgs=432 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff870006ea0 tx=0x7ff87000cca0 comp rx=0 tx=0).stop 2026-02-13T03:37:33.087 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:33.083+0000 7ff87c1646c0 1 -- 10.20.193.96:0/1767434042 shutdown_connections 2026-02-13T03:37:33.087 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:33.083+0000 7ff87c1646c0 1 --2- 10.20.193.96:0/1767434042 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff8500b5600 0x7ff8500d5ab0 unknown :-1 s=CLOSED pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:33.087 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:33.083+0000 7ff87c1646c0 1 --2- 10.20.193.96:0/1767434042 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8740f4150 0x7ff8740f9420 unknown :-1 s=CLOSED pgs=432 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:33.087 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:33.083+0000 7ff87c1646c0 1 --2- 10.20.193.96:0/1767434042 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff8741131c0 0x7ff874173a60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:33.087 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:33.083+0000 7ff87c1646c0 1 --2- 10.20.193.96:0/1767434042 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff87405f810 0x7ff8740f3b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:33.087 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:33.083+0000 7ff87c1646c0 1 -- 10.20.193.96:0/1767434042 >> 10.20.193.96:0/1767434042 conn(0x7ff8740e9770 msgr2=0x7ff874111900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:33.088 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:33.083+0000 7ff87c1646c0 1 -- 10.20.193.96:0/1767434042 shutdown_connections 2026-02-13T03:37:33.088 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:33.084+0000 7ff87c1646c0 1 -- 10.20.193.96:0/1767434042 wait complete. 2026-02-13T03:37:33.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:33 trial133 ceph-mon[26943]: pgmap v289: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:33.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:33 trial096 ceph-mon[24671]: pgmap v289: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:33.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:33 trial132 ceph-mon[26888]: pgmap v289: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:34.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:34 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1767434042' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:34.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:34 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1767434042' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:34.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:34 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1767434042' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:35.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:35 trial133 ceph-mon[26943]: pgmap v290: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:35.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:35 trial096 ceph-mon[24671]: pgmap v290: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:35.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:35 trial132 ceph-mon[26888]: pgmap v290: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:36.130 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:37:36.250 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:37:36.367 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.364+0000 7f69a54876c0 1 -- 10.20.193.96:0/3552124453 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f69a015e130 msgr2=0x7f69a017e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:36.367 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.364+0000 7f69a54876c0 1 --2- 10.20.193.96:0/3552124453 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f69a015e130 0x7f69a017e510 secure :-1 s=READY pgs=433 gs=1 cs=0 l=1 c_cookie=18404414007225488075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f699000aa40 tx=0x7f699002fde0 comp rx=0 tx=0).stop 2026-02-13T03:37:36.367 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.364+0000 7f69a54876c0 1 -- 10.20.193.96:0/3552124453 shutdown_connections 2026-02-13T03:37:36.367 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.364+0000 7f69a54876c0 1 --2- 10.20.193.96:0/3552124453 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f69a015e130 0x7f69a017e510 unknown :-1 s=CLOSED pgs=433 gs=1 cs=0 l=1 c_cookie=18404414007225488075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:36.367 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.364+0000 7f69a54876c0 1 --2- 10.20.193.96:0/3552124453 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f69a0114d10 0x7f69a015dbf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:36.367 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.364+0000 7f69a54876c0 1 --2- 10.20.193.96:0/3552124453 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f69a0114400 0x7f69a01147d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:36.367 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.364+0000 7f69a54876c0 1 -- 10.20.193.96:0/3552124453 >> 10.20.193.96:0/3552124453 conn(0x7f69a005cef0 msgr2=0x7f69a005d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:36.367 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.364+0000 7f69a54876c0 1 -- 10.20.193.96:0/3552124453 shutdown_connections 2026-02-13T03:37:36.367 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.364+0000 7f69a54876c0 1 -- 10.20.193.96:0/3552124453 wait complete. 2026-02-13T03:37:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.365+0000 7f69a54876c0 1 Processor -- start 2026-02-13T03:37:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.365+0000 7f69a54876c0 1 -- start start 2026-02-13T03:37:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.365+0000 7f69a54876c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f69a0114400 0x7f69a00fe160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.365+0000 7f69a54876c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f69a0114d10 0x7f69a00fe6a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.365+0000 7f69a54876c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f69a015e130 0x7f69a0103a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.365+0000 7f69a54876c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f69a01040b0 con 0x7f69a015e130 2026-02-13T03:37:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.365+0000 7f69a54876c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f69a0104220 con 0x7f69a0114400 2026-02-13T03:37:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.365+0000 7f69a54876c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f69a01043e0 con 0x7f69a0114d10 2026-02-13T03:37:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.365+0000 7f699f7fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f69a015e130 0x7f69a0103a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.365+0000 7f699f7fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f69a015e130 0x7f69a0103a60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:33056/0 (socket says 10.20.193.96:33056) 2026-02-13T03:37:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.365+0000 7f699f7fe6c0 1 -- 10.20.193.96:0/3165954873 learned_addr learned my addr 10.20.193.96:0/3165954873 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:37:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.365+0000 7f699effd6c0 1 --2- 10.20.193.96:0/3165954873 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f69a0114400 0x7f69a00fe160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.365+0000 7f699e7fc6c0 1 --2- 10.20.193.96:0/3165954873 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f69a0114d10 0x7f69a00fe6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.365+0000 7f699f7fe6c0 1 -- 10.20.193.96:0/3165954873 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f69a0114d10 msgr2=0x7f69a00fe6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.365+0000 7f699f7fe6c0 1 --2- 10.20.193.96:0/3165954873 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f69a0114d10 0x7f69a00fe6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.365+0000 7f699f7fe6c0 1 -- 10.20.193.96:0/3165954873 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f69a0114400 msgr2=0x7f69a00fe160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.365+0000 7f699f7fe6c0 1 --2- 10.20.193.96:0/3165954873 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f69a0114400 0x7f69a00fe160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.365+0000 7f699f7fe6c0 1 -- 10.20.193.96:0/3165954873 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f699000a660 con 0x7f69a015e130 2026-02-13T03:37:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.365+0000 7f699e7fc6c0 1 --2- 10.20.193.96:0/3165954873 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f69a0114d10 0x7f69a00fe6a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:37:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.365+0000 7f699f7fe6c0 1 --2- 10.20.193.96:0/3165954873 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f69a015e130 0x7f69a0103a60 secure :-1 s=READY pgs=434 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69900054b0 tx=0x7f69900054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:36.368 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.366+0000 7f697ffff6c0 1 -- 10.20.193.96:0/3165954873 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6990030d10 con 0x7f69a015e130 2026-02-13T03:37:36.369 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.366+0000 7f69a54876c0 1 -- 10.20.193.96:0/3165954873 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69a0104660 con 0x7f69a015e130 2026-02-13T03:37:36.369 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.366+0000 7f697ffff6c0 1 -- 10.20.193.96:0/3165954873 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f6990030e70 con 0x7f69a015e130 2026-02-13T03:37:36.369 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.366+0000 7f697ffff6c0 1 -- 10.20.193.96:0/3165954873 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6990008430 con 0x7f69a015e130 2026-02-13T03:37:36.369 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.366+0000 7f69a54876c0 1 -- 10.20.193.96:0/3165954873 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69a01048e0 con 0x7f69a015e130 2026-02-13T03:37:36.369 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.366+0000 7f69a54876c0 1 -- 10.20.193.96:0/3165954873 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69a00570b0 con 0x7f69a015e130 2026-02-13T03:37:36.370 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.367+0000 7f697ffff6c0 1 -- 10.20.193.96:0/3165954873 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f6990032030 con 0x7f69a015e130 2026-02-13T03:37:36.370 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.368+0000 7f697ffff6c0 1 --2- 10.20.193.96:0/3165954873 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f69740b5600 0x7f69740d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:36.370 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.368+0000 7f697ffff6c0 1 -- 10.20.193.96:0/3165954873 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f6990108ef0 con 0x7f69a015e130 2026-02-13T03:37:36.370 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.368+0000 7f699effd6c0 1 --2- 10.20.193.96:0/3165954873 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f69740b5600 0x7f69740d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:36.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.368+0000 7f697ffff6c0 1 -- 10.20.193.96:0/3165954873 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f69900cb990 con 0x7f69a015e130 2026-02-13T03:37:36.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.368+0000 7f699effd6c0 1 --2- 10.20.193.96:0/3165954873 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f69740b5600 0x7f69740d5ab0 secure :-1 s=READY pgs=281 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6994005980 tx=0x7f6994005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:36.484 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.481+0000 7f69a54876c0 1 -- 10.20.193.96:0/3165954873 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f69a00ff2b0 con 0x7f69a015e130 2026-02-13T03:37:36.484 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.481+0000 7f697ffff6c0 1 -- 10.20.193.96:0/3165954873 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f69900ceb40 con 0x7f69a015e130 2026-02-13T03:37:36.485 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:37:36.485 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:37:36.486 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.483+0000 7f69a54876c0 1 -- 10.20.193.96:0/3165954873 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f69740b5600 msgr2=0x7f69740d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:36.486 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.483+0000 7f69a54876c0 1 --2- 10.20.193.96:0/3165954873 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f69740b5600 0x7f69740d5ab0 secure :-1 s=READY pgs=281 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6994005980 tx=0x7f6994005910 comp rx=0 tx=0).stop 2026-02-13T03:37:36.486 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.483+0000 7f69a54876c0 1 -- 10.20.193.96:0/3165954873 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f69a015e130 msgr2=0x7f69a0103a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:36.486 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.483+0000 7f69a54876c0 1 --2- 10.20.193.96:0/3165954873 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f69a015e130 0x7f69a0103a60 secure :-1 s=READY pgs=434 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69900054b0 tx=0x7f69900054e0 comp rx=0 tx=0).stop 2026-02-13T03:37:36.486 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.483+0000 7f69a54876c0 1 -- 10.20.193.96:0/3165954873 shutdown_connections 2026-02-13T03:37:36.486 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.483+0000 7f69a54876c0 1 --2- 10.20.193.96:0/3165954873 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f69740b5600 0x7f69740d5ab0 unknown :-1 s=CLOSED pgs=281 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:36.487 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.483+0000 7f69a54876c0 1 --2- 10.20.193.96:0/3165954873 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f69a015e130 0x7f69a0103a60 unknown :-1 s=CLOSED pgs=434 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:36.487 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.483+0000 7f69a54876c0 1 --2- 10.20.193.96:0/3165954873 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f69a0114d10 0x7f69a00fe6a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:36.487 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.483+0000 7f69a54876c0 1 --2- 10.20.193.96:0/3165954873 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f69a0114400 0x7f69a00fe160 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:36.487 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.483+0000 7f69a54876c0 1 -- 10.20.193.96:0/3165954873 >> 10.20.193.96:0/3165954873 conn(0x7f69a005cef0 msgr2=0x7f69a00f8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:36.487 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.483+0000 7f69a54876c0 1 -- 10.20.193.96:0/3165954873 shutdown_connections 2026-02-13T03:37:36.487 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:36.483+0000 7f69a54876c0 1 -- 10.20.193.96:0/3165954873 wait complete. 2026-02-13T03:37:37.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:37 trial133 ceph-mon[26943]: pgmap v291: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:37.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:37 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3165954873' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:37.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:37 trial096 ceph-mon[24671]: pgmap v291: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:37.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:37 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3165954873' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:37.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:37 trial132 ceph-mon[26888]: pgmap v291: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:37.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:37 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3165954873' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:39.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:39 trial096 ceph-mon[24671]: pgmap v292: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:39.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:39 trial132 ceph-mon[26888]: pgmap v292: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:39.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:39 trial133 ceph-mon[26943]: pgmap v292: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:39.527 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:37:39.645 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:37:39.761 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.756+0000 7fea05a406c0 1 -- 10.20.193.96:0/1418981884 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fea00060ce0 msgr2=0x7fea00061110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:39.761 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.756+0000 7fea05a406c0 1 --2- 10.20.193.96:0/1418981884 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fea00060ce0 0x7fea00061110 secure :-1 s=READY pgs=435 gs=1 cs=0 l=1 c_cookie=14208769219486976537 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9e8009970 tx=0x7fe9e802ed20 comp rx=0 tx=0).stop 2026-02-13T03:37:39.761 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.756+0000 7fea05a406c0 1 -- 10.20.193.96:0/1418981884 shutdown_connections 2026-02-13T03:37:39.761 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.756+0000 7fea05a406c0 1 --2- 10.20.193.96:0/1418981884 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fea00159ac0 0x7fea00179ea0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:39.762 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.756+0000 7fea05a406c0 1 --2- 10.20.193.96:0/1418981884 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fea00060ce0 0x7fea00061110 unknown :-1 s=CLOSED pgs=435 gs=1 cs=0 l=1 c_cookie=14208769219486976537 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:39.762 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.756+0000 7fea05a406c0 1 --2- 10.20.193.96:0/1418981884 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fea000622d0 0x7fea000607a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:39.762 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.756+0000 7fea05a406c0 1 -- 10.20.193.96:0/1418981884 >> 10.20.193.96:0/1418981884 conn(0x7fea000ea880 msgr2=0x7fea0010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:39.762 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.756+0000 7fea05a406c0 1 -- 10.20.193.96:0/1418981884 shutdown_connections 2026-02-13T03:37:39.762 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.756+0000 7fea05a406c0 1 -- 10.20.193.96:0/1418981884 wait complete. 2026-02-13T03:37:39.762 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.756+0000 7fea05a406c0 1 Processor -- start 2026-02-13T03:37:39.762 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.757+0000 7fea05a406c0 1 -- start start 2026-02-13T03:37:39.762 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.757+0000 7fea05a406c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fea00060ce0 0x7fea000f22f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:39.762 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.757+0000 7fea05a406c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fea000622d0 0x7fea000f2830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:39.762 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.757+0000 7fea05a406c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fea00159ac0 0x7fea000f7bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:39.762 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.757+0000 7fea05a406c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fea000f8240 con 0x7fea000622d0 2026-02-13T03:37:39.763 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.757+0000 7fea05a406c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fea000f83b0 con 0x7fea00060ce0 2026-02-13T03:37:39.763 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.757+0000 7fea05a406c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fea000f8570 con 0x7fea00159ac0 2026-02-13T03:37:39.763 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.757+0000 7fe9fe7fc6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fea000622d0 0x7fea000f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:39.763 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.757+0000 7fe9fe7fc6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fea000622d0 0x7fea000f2830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:33074/0 (socket says 10.20.193.96:33074) 2026-02-13T03:37:39.763 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.757+0000 7fe9fe7fc6c0 1 -- 10.20.193.96:0/1869832595 learned_addr learned my addr 10.20.193.96:0/1869832595 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:37:39.763 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.757+0000 7fe9feffd6c0 1 --2- 10.20.193.96:0/1869832595 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fea00060ce0 0x7fea000f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:39.763 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.757+0000 7fe9ff7fe6c0 1 --2- 10.20.193.96:0/1869832595 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fea00159ac0 0x7fea000f7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:39.763 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.757+0000 7fe9fe7fc6c0 1 -- 10.20.193.96:0/1869832595 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fea00159ac0 msgr2=0x7fea000f7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:39.763 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.757+0000 7fe9fe7fc6c0 1 --2- 10.20.193.96:0/1869832595 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fea00159ac0 0x7fea000f7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:39.763 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.757+0000 7fe9fe7fc6c0 1 -- 10.20.193.96:0/1869832595 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fea00060ce0 msgr2=0x7fea000f22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:39.763 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.757+0000 7fe9fe7fc6c0 1 --2- 10.20.193.96:0/1869832595 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fea00060ce0 0x7fea000f22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:39.763 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.757+0000 7fe9fe7fc6c0 1 -- 10.20.193.96:0/1869832595 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e8009590 con 0x7fea000622d0 2026-02-13T03:37:39.764 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.757+0000 7fe9fe7fc6c0 1 --2- 10.20.193.96:0/1869832595 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fea000622d0 0x7fea000f2830 secure :-1 s=READY pgs=436 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9e80098c0 tx=0x7fe9e80047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:39.764 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.757+0000 7fea04a3a6c0 1 -- 10.20.193.96:0/1869832595 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9e8002ae0 con 0x7fea000622d0 2026-02-13T03:37:39.764 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.757+0000 7fea04a3a6c0 1 -- 10.20.193.96:0/1869832595 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fe9e8002c40 con 0x7fea000622d0 2026-02-13T03:37:39.764 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.757+0000 7fea05a406c0 1 -- 10.20.193.96:0/1869832595 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea000f87f0 con 0x7fea000622d0 2026-02-13T03:37:39.764 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.757+0000 7fea04a3a6c0 1 -- 10.20.193.96:0/1869832595 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9e80312b0 con 0x7fea000622d0 2026-02-13T03:37:39.764 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.757+0000 7fea05a406c0 1 -- 10.20.193.96:0/1869832595 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea000f8f10 con 0x7fea000622d0 2026-02-13T03:37:39.764 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.758+0000 7fea05a406c0 1 -- 10.20.193.96:0/1869832595 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea00061cb0 con 0x7fea000622d0 2026-02-13T03:37:39.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.759+0000 7fea04a3a6c0 1 -- 10.20.193.96:0/1869832595 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fe9e80078f0 con 0x7fea000622d0 2026-02-13T03:37:39.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.760+0000 7fea04a3a6c0 1 --2- 10.20.193.96:0/1869832595 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe9d40b5600 0x7fe9d40d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:39.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.760+0000 7fea04a3a6c0 1 -- 10.20.193.96:0/1869832595 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7fe9e8107d10 con 0x7fea000622d0 2026-02-13T03:37:39.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.760+0000 7fe9feffd6c0 1 --2- 10.20.193.96:0/1869832595 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe9d40b5600 0x7fe9d40d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:39.765 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.760+0000 7fea04a3a6c0 1 -- 10.20.193.96:0/1869832595 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe9e80ca770 con 0x7fea000622d0 2026-02-13T03:37:39.766 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.760+0000 7fe9feffd6c0 1 --2- 10.20.193.96:0/1869832595 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe9d40b5600 0x7fe9d40d5ab0 secure :-1 s=READY pgs=282 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9f4005980 tx=0x7fe9f4005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:39.877 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.875+0000 7fea05a406c0 1 -- 10.20.193.96:0/1869832595 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fea000f3440 con 0x7fea000622d0 2026-02-13T03:37:39.878 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.875+0000 7fea04a3a6c0 1 -- 10.20.193.96:0/1869832595 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe9e8002db0 con 0x7fea000622d0 2026-02-13T03:37:39.878 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:37:39.878 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:37:39.879 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.876+0000 7fea05a406c0 1 -- 10.20.193.96:0/1869832595 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe9d40b5600 msgr2=0x7fe9d40d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:39.879 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.876+0000 7fea05a406c0 1 --2- 10.20.193.96:0/1869832595 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe9d40b5600 0x7fe9d40d5ab0 secure :-1 s=READY pgs=282 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9f4005980 tx=0x7fe9f4005910 comp rx=0 tx=0).stop 2026-02-13T03:37:39.879 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.876+0000 7fea05a406c0 1 -- 10.20.193.96:0/1869832595 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fea000622d0 msgr2=0x7fea000f2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:39.879 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.876+0000 7fea05a406c0 1 --2- 10.20.193.96:0/1869832595 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fea000622d0 0x7fea000f2830 secure :-1 s=READY pgs=436 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9e80098c0 tx=0x7fe9e80047f0 comp rx=0 tx=0).stop 2026-02-13T03:37:39.879 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.876+0000 7fea05a406c0 1 -- 10.20.193.96:0/1869832595 shutdown_connections 2026-02-13T03:37:39.879 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.876+0000 7fea05a406c0 1 --2- 10.20.193.96:0/1869832595 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe9d40b5600 0x7fe9d40d5ab0 unknown :-1 s=CLOSED pgs=282 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:39.879 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.876+0000 7fea05a406c0 1 --2- 10.20.193.96:0/1869832595 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fea00159ac0 0x7fea000f7bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:39.880 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.876+0000 7fea05a406c0 1 --2- 10.20.193.96:0/1869832595 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fea000622d0 0x7fea000f2830 unknown :-1 s=CLOSED pgs=436 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:39.880 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.876+0000 7fea05a406c0 1 --2- 10.20.193.96:0/1869832595 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fea00060ce0 0x7fea000f22f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:39.880 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.876+0000 7fea05a406c0 1 -- 10.20.193.96:0/1869832595 >> 10.20.193.96:0/1869832595 conn(0x7fea000ea880 msgr2=0x7fea0010dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:39.880 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.876+0000 7fea05a406c0 1 -- 10.20.193.96:0/1869832595 shutdown_connections 2026-02-13T03:37:39.880 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:39.876+0000 7fea05a406c0 1 -- 10.20.193.96:0/1869832595 wait complete. 2026-02-13T03:37:40.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:40 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1869832595' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:40.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:40 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1869832595' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:40.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:40 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1869832595' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:41.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:41 trial096 ceph-mon[24671]: pgmap v293: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:37:41.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:41 trial132 ceph-mon[26888]: pgmap v293: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:37:41.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:41 trial133 ceph-mon[26943]: pgmap v293: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:37:42.920 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:37:43.037 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:37:43.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.152+0000 7f4142f886c0 1 -- 10.20.193.96:0/1037391563 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f413c10fbf0 msgr2=0x7f413c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:43.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.152+0000 7f4142f886c0 1 --2- 10.20.193.96:0/1037391563 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f413c10fbf0 0x7f413c114c30 secure :-1 s=READY pgs=437 gs=1 cs=0 l=1 c_cookie=11721457281941305951 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41240099a0 tx=0x7f412402ed50 comp rx=0 tx=0).stop 2026-02-13T03:37:43.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.152+0000 7f4142f886c0 1 -- 10.20.193.96:0/1037391563 shutdown_connections 2026-02-13T03:37:43.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.152+0000 7f4142f886c0 1 --2- 10.20.193.96:0/1037391563 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f413c115410 0x7f413c175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:43.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.152+0000 7f4142f886c0 1 --2- 10.20.193.96:0/1037391563 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f413c10fbf0 0x7f413c114c30 unknown :-1 s=CLOSED pgs=437 gs=1 cs=0 l=1 c_cookie=11721457281941305951 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:43.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.152+0000 7f4142f886c0 1 --2- 10.20.193.96:0/1037391563 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f413c10f200 0x7f413c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:43.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.152+0000 7f4142f886c0 1 -- 10.20.193.96:0/1037391563 >> 10.20.193.96:0/1037391563 conn(0x7f413c0ecb00 msgr2=0x7f413c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:43.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.152+0000 7f4142f886c0 1 -- 10.20.193.96:0/1037391563 shutdown_connections 2026-02-13T03:37:43.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.152+0000 7f4142f886c0 1 -- 10.20.193.96:0/1037391563 wait complete. 2026-02-13T03:37:43.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f4142f886c0 1 Processor -- start 2026-02-13T03:37:43.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f4142f886c0 1 -- start start 2026-02-13T03:37:43.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f4142f886c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f413c10f200 0x7f413c0f4d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:43.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f4142f886c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f413c115410 0x7f413c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:43.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f4142f886c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f413c0f53a0 0x7f413c0fa620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:43.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f4142f886c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f413c0f5a90 con 0x7f413c0f53a0 2026-02-13T03:37:43.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f4142f886c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f413c0fab60 con 0x7f413c10f200 2026-02-13T03:37:43.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f4142f886c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f413c0fad20 con 0x7f413c115410 2026-02-13T03:37:43.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f41414fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f413c0f53a0 0x7f413c0fa620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:43.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f41414fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f413c0f53a0 0x7f413c0fa620 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:50132/0 (socket says 10.20.193.96:50132) 2026-02-13T03:37:43.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f41414fe6c0 1 -- 10.20.193.96:0/3633141763 learned_addr learned my addr 10.20.193.96:0/3633141763 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:37:43.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f4133fff6c0 1 --2- 10.20.193.96:0/3633141763 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f413c115410 0x7f413c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:43.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f4140cfd6c0 1 --2- 10.20.193.96:0/3633141763 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f413c10f200 0x7f413c0f4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:43.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f41414fe6c0 1 -- 10.20.193.96:0/3633141763 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f413c115410 msgr2=0x7f413c175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:43.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f41414fe6c0 1 --2- 10.20.193.96:0/3633141763 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f413c115410 0x7f413c175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:43.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f41414fe6c0 1 -- 10.20.193.96:0/3633141763 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f413c10f200 msgr2=0x7f413c0f4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:43.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f41414fe6c0 1 --2- 10.20.193.96:0/3633141763 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f413c10f200 0x7f413c0f4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:43.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f41414fe6c0 1 -- 10.20.193.96:0/3633141763 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4124009590 con 0x7f413c0f53a0 2026-02-13T03:37:43.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f4133fff6c0 1 --2- 10.20.193.96:0/3633141763 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f413c115410 0x7f413c175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:37:43.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f41414fe6c0 1 --2- 10.20.193.96:0/3633141763 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f413c0f53a0 0x7f413c0fa620 secure :-1 s=READY pgs=438 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4138006ea0 tx=0x7f413800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:43.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f4131ffb6c0 1 -- 10.20.193.96:0/3633141763 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4138003a30 con 0x7f413c0f53a0 2026-02-13T03:37:43.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f4131ffb6c0 1 -- 10.20.193.96:0/3633141763 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f4138005510 con 0x7f413c0f53a0 2026-02-13T03:37:43.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f4142f886c0 1 -- 10.20.193.96:0/3633141763 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f413c0fb000 con 0x7f413c0f53a0 2026-02-13T03:37:43.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f4131ffb6c0 1 -- 10.20.193.96:0/3633141763 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f413800dd70 con 0x7f413c0f53a0 2026-02-13T03:37:43.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.153+0000 7f4142f886c0 1 -- 10.20.193.96:0/3633141763 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f413c0fb790 con 0x7f413c0f53a0 2026-02-13T03:37:43.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.154+0000 7f4142f886c0 1 -- 10.20.193.96:0/3633141763 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f413c0fb4e0 con 0x7f413c0f53a0 2026-02-13T03:37:43.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.155+0000 7f4131ffb6c0 1 -- 10.20.193.96:0/3633141763 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f4138003b90 con 0x7f413c0f53a0 2026-02-13T03:37:43.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.156+0000 7f4131ffb6c0 1 --2- 10.20.193.96:0/3633141763 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f41180b5680 0x7f41180d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:43.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.156+0000 7f4140cfd6c0 1 --2- 10.20.193.96:0/3633141763 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f41180b5680 0x7f41180d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:43.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.156+0000 7f4131ffb6c0 1 -- 10.20.193.96:0/3633141763 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f41380e4a50 con 0x7f413c0f53a0 2026-02-13T03:37:43.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.156+0000 7f4131ffb6c0 1 -- 10.20.193.96:0/3633141763 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f41380a74b0 con 0x7f413c0f53a0 2026-02-13T03:37:43.162 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.156+0000 7f4140cfd6c0 1 --2- 10.20.193.96:0/3633141763 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f41180b5680 0x7f41180d5b30 secure :-1 s=READY pgs=283 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f412c005980 tx=0x7f412c005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:43.273 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.270+0000 7f4142f886c0 1 -- 10.20.193.96:0/3633141763 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f413c10f600 con 0x7f413c0f53a0 2026-02-13T03:37:43.273 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:43 trial096 ceph-mon[24671]: pgmap v294: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:43.273 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.270+0000 7f4131ffb6c0 1 -- 10.20.193.96:0/3633141763 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f41380aaf10 con 0x7f413c0f53a0 2026-02-13T03:37:43.274 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:37:43.274 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:37:43.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.271+0000 7f4142f886c0 1 -- 10.20.193.96:0/3633141763 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f41180b5680 msgr2=0x7f41180d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:43.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.271+0000 7f4142f886c0 1 --2- 10.20.193.96:0/3633141763 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f41180b5680 0x7f41180d5b30 secure :-1 s=READY pgs=283 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f412c005980 tx=0x7f412c005910 comp rx=0 tx=0).stop 2026-02-13T03:37:43.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.271+0000 7f4142f886c0 1 -- 10.20.193.96:0/3633141763 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f413c0f53a0 msgr2=0x7f413c0fa620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:43.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.271+0000 7f4142f886c0 1 --2- 10.20.193.96:0/3633141763 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f413c0f53a0 0x7f413c0fa620 secure :-1 s=READY pgs=438 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4138006ea0 tx=0x7f413800cca0 comp rx=0 tx=0).stop 2026-02-13T03:37:43.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.271+0000 7f4142f886c0 1 -- 10.20.193.96:0/3633141763 shutdown_connections 2026-02-13T03:37:43.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.271+0000 7f4142f886c0 1 --2- 10.20.193.96:0/3633141763 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f41180b5680 0x7f41180d5b30 unknown :-1 s=CLOSED pgs=283 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:43.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.271+0000 7f4142f886c0 1 --2- 10.20.193.96:0/3633141763 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f413c0f53a0 0x7f413c0fa620 unknown :-1 s=CLOSED pgs=438 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:43.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.271+0000 7f4142f886c0 1 --2- 10.20.193.96:0/3633141763 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f413c115410 0x7f413c175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:43.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.271+0000 7f4142f886c0 1 --2- 10.20.193.96:0/3633141763 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f413c10f200 0x7f413c0f4d70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:43.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.271+0000 7f4142f886c0 1 -- 10.20.193.96:0/3633141763 >> 10.20.193.96:0/3633141763 conn(0x7f413c0ecb00 msgr2=0x7f413c111c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:43.276 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.271+0000 7f4142f886c0 1 -- 10.20.193.96:0/3633141763 shutdown_connections 2026-02-13T03:37:43.276 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:43.271+0000 7f4142f886c0 1 -- 10.20.193.96:0/3633141763 wait complete. 2026-02-13T03:37:43.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:43 trial132 ceph-mon[26888]: pgmap v294: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:43.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:43 trial133 ceph-mon[26943]: pgmap v294: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:44.383 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:44 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3633141763' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:44.414 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:44 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3633141763' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:44.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:44 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3633141763' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:45.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:45 trial096 ceph-mon[24671]: pgmap v295: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:45.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:45 trial132 ceph-mon[26888]: pgmap v295: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:45.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:45 trial133 ceph-mon[26943]: pgmap v295: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:46.315 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:37:46.433 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:37:46.552 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.547+0000 7fe66cea16c0 1 -- 10.20.193.96:0/1844007002 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe668115410 msgr2=0x7fe668175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:46.552 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.547+0000 7fe66cea16c0 1 --2- 10.20.193.96:0/1844007002 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe668115410 0x7fe668175db0 secure :-1 s=READY pgs=439 gs=1 cs=0 l=1 c_cookie=10220955310059137901 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe65800aa70 tx=0x7fe65802fde0 comp rx=0 tx=0).stop 2026-02-13T03:37:46.552 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.547+0000 7fe66cea16c0 1 -- 10.20.193.96:0/1844007002 shutdown_connections 2026-02-13T03:37:46.552 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.547+0000 7fe66cea16c0 1 --2- 10.20.193.96:0/1844007002 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe668115410 0x7fe668175db0 unknown :-1 s=CLOSED pgs=439 gs=1 cs=0 l=1 c_cookie=10220955310059137901 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:46.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.547+0000 7fe66cea16c0 1 --2- 10.20.193.96:0/1844007002 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe66810fbf0 0x7fe668114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:46.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.547+0000 7fe66cea16c0 1 --2- 10.20.193.96:0/1844007002 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe66810f200 0x7fe66810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:46.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.547+0000 7fe66cea16c0 1 -- 10.20.193.96:0/1844007002 >> 10.20.193.96:0/1844007002 conn(0x7fe6680ecb00 msgr2=0x7fe66810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:46.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.547+0000 7fe66cea16c0 1 -- 10.20.193.96:0/1844007002 shutdown_connections 2026-02-13T03:37:46.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.547+0000 7fe66cea16c0 1 -- 10.20.193.96:0/1844007002 wait complete. 2026-02-13T03:37:46.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.548+0000 7fe66cea16c0 1 Processor -- start 2026-02-13T03:37:46.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.548+0000 7fe66cea16c0 1 -- start start 2026-02-13T03:37:46.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.548+0000 7fe66cea16c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe66810f200 0x7fe66811d110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:46.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.548+0000 7fe66cea16c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe668115410 0x7fe66811d650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:46.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.548+0000 7fe66cea16c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe668122a10 0x7fe668122eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:46.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.548+0000 7fe66cea16c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe668123420 con 0x7fe66810f200 2026-02-13T03:37:46.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.548+0000 7fe66cea16c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe668123590 con 0x7fe668115410 2026-02-13T03:37:46.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.548+0000 7fe66cea16c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe668123750 con 0x7fe668122a10 2026-02-13T03:37:46.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.548+0000 7fe6665756c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe66810f200 0x7fe66811d110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:46.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.548+0000 7fe6665756c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe66810f200 0x7fe66811d110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:50140/0 (socket says 10.20.193.96:50140) 2026-02-13T03:37:46.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.548+0000 7fe6665756c0 1 -- 10.20.193.96:0/3057259630 learned_addr learned my addr 10.20.193.96:0/3057259630 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:37:46.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.548+0000 7fe665d746c0 1 --2- 10.20.193.96:0/3057259630 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe668115410 0x7fe66811d650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:46.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.548+0000 7fe666d766c0 1 --2- 10.20.193.96:0/3057259630 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe668122a10 0x7fe668122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:46.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.548+0000 7fe6665756c0 1 -- 10.20.193.96:0/3057259630 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe668122a10 msgr2=0x7fe668122eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:46.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.548+0000 7fe6665756c0 1 --2- 10.20.193.96:0/3057259630 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe668122a10 0x7fe668122eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:46.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.548+0000 7fe6665756c0 1 -- 10.20.193.96:0/3057259630 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe668115410 msgr2=0x7fe66811d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:46.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.548+0000 7fe6665756c0 1 --2- 10.20.193.96:0/3057259630 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe668115410 0x7fe66811d650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:46.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.548+0000 7fe6665756c0 1 -- 10.20.193.96:0/3057259630 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65800a660 con 0x7fe66810f200 2026-02-13T03:37:46.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.548+0000 7fe6665756c0 1 --2- 10.20.193.96:0/3057259630 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe66810f200 0x7fe66811d110 secure :-1 s=READY pgs=440 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe65c00b710 tx=0x7fe65c00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:46.555 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.548+0000 7fe64f7fe6c0 1 -- 10.20.193.96:0/3057259630 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe65c004250 con 0x7fe66810f200 2026-02-13T03:37:46.555 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.548+0000 7fe64f7fe6c0 1 -- 10.20.193.96:0/3057259630 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fe65c002da0 con 0x7fe66810f200 2026-02-13T03:37:46.555 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.548+0000 7fe66cea16c0 1 -- 10.20.193.96:0/3057259630 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe668163c00 con 0x7fe66810f200 2026-02-13T03:37:46.555 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.548+0000 7fe64f7fe6c0 1 -- 10.20.193.96:0/3057259630 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe65c00ce30 con 0x7fe66810f200 2026-02-13T03:37:46.555 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.548+0000 7fe66cea16c0 1 -- 10.20.193.96:0/3057259630 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe668164090 con 0x7fe66810f200 2026-02-13T03:37:46.555 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.549+0000 7fe66cea16c0 1 -- 10.20.193.96:0/3057259630 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6681104d0 con 0x7fe66810f200 2026-02-13T03:37:46.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.550+0000 7fe64f7fe6c0 1 -- 10.20.193.96:0/3057259630 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fe65c0028c0 con 0x7fe66810f200 2026-02-13T03:37:46.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.551+0000 7fe64f7fe6c0 1 --2- 10.20.193.96:0/3057259630 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe6400b5600 0x7fe6400d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:46.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.551+0000 7fe64f7fe6c0 1 -- 10.20.193.96:0/3057259630 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7fe65c0e3c70 con 0x7fe66810f200 2026-02-13T03:37:46.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.551+0000 7fe665d746c0 1 --2- 10.20.193.96:0/3057259630 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe6400b5600 0x7fe6400d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:46.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.551+0000 7fe665d746c0 1 --2- 10.20.193.96:0/3057259630 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe6400b5600 0x7fe6400d5ab0 secure :-1 s=READY pgs=284 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe650005980 tx=0x7fe650005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:46.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.551+0000 7fe64f7fe6c0 1 -- 10.20.193.96:0/3057259630 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe65c0a66d0 con 0x7fe66810f200 2026-02-13T03:37:46.668 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.665+0000 7fe66cea16c0 1 -- 10.20.193.96:0/3057259630 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe66810f5d0 con 0x7fe66810f200 2026-02-13T03:37:46.668 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.665+0000 7fe64f7fe6c0 1 -- 10.20.193.96:0/3057259630 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe65c0a9880 con 0x7fe66810f200 2026-02-13T03:37:46.668 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:37:46.669 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:37:46.669 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.666+0000 7fe66cea16c0 1 -- 10.20.193.96:0/3057259630 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe6400b5600 msgr2=0x7fe6400d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:46.669 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.666+0000 7fe66cea16c0 1 --2- 10.20.193.96:0/3057259630 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe6400b5600 0x7fe6400d5ab0 secure :-1 s=READY pgs=284 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe650005980 tx=0x7fe650005910 comp rx=0 tx=0).stop 2026-02-13T03:37:46.670 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.666+0000 7fe66cea16c0 1 -- 10.20.193.96:0/3057259630 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe66810f200 msgr2=0x7fe66811d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:46.670 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.666+0000 7fe66cea16c0 1 --2- 10.20.193.96:0/3057259630 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe66810f200 0x7fe66811d110 secure :-1 s=READY pgs=440 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe65c00b710 tx=0x7fe65c00bbe0 comp rx=0 tx=0).stop 2026-02-13T03:37:46.670 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.667+0000 7fe66cea16c0 1 -- 10.20.193.96:0/3057259630 shutdown_connections 2026-02-13T03:37:46.670 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.667+0000 7fe66cea16c0 1 --2- 10.20.193.96:0/3057259630 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe6400b5600 0x7fe6400d5ab0 unknown :-1 s=CLOSED pgs=284 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:46.670 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.667+0000 7fe66cea16c0 1 --2- 10.20.193.96:0/3057259630 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe668122a10 0x7fe668122eb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:46.670 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.667+0000 7fe66cea16c0 1 --2- 10.20.193.96:0/3057259630 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe668115410 0x7fe66811d650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:46.670 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.667+0000 7fe66cea16c0 1 --2- 10.20.193.96:0/3057259630 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe66810f200 0x7fe66811d110 unknown :-1 s=CLOSED pgs=440 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:46.670 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.667+0000 7fe66cea16c0 1 -- 10.20.193.96:0/3057259630 >> 10.20.193.96:0/3057259630 conn(0x7fe6680ecb00 msgr2=0x7fe66810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:46.670 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.667+0000 7fe66cea16c0 1 -- 10.20.193.96:0/3057259630 shutdown_connections 2026-02-13T03:37:46.670 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:46.667+0000 7fe66cea16c0 1 -- 10.20.193.96:0/3057259630 wait complete. 2026-02-13T03:37:47.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:47 trial096 ceph-mon[24671]: pgmap v296: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:47.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:47 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3057259630' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:47.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:47 trial132 ceph-mon[26888]: pgmap v296: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:47.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:47 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3057259630' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:47.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:47 trial133 ceph-mon[26943]: pgmap v296: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:47.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:47 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3057259630' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:49.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:49 trial096 ceph-mon[24671]: pgmap v297: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:49.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:49 trial132 ceph-mon[26888]: pgmap v297: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:49.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:49 trial133 ceph-mon[26943]: pgmap v297: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:49.710 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:37:49.828 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:37:49.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.943+0000 7fbd59a276c0 1 -- 10.20.193.96:0/2510968702 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbd540622d0 msgr2=0x7fbd540607a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:49.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.943+0000 7fbd59a276c0 1 --2- 10.20.193.96:0/2510968702 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbd540622d0 0x7fbd540607a0 secure :-1 s=READY pgs=441 gs=1 cs=0 l=1 c_cookie=8893893869351142019 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd48009970 tx=0x7fbd4802ed20 comp rx=0 tx=0).stop 2026-02-13T03:37:49.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.943+0000 7fbd59a276c0 1 -- 10.20.193.96:0/2510968702 shutdown_connections 2026-02-13T03:37:49.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.943+0000 7fbd59a276c0 1 --2- 10.20.193.96:0/2510968702 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fbd54159ac0 0x7fbd54179ea0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:49.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.943+0000 7fbd59a276c0 1 --2- 10.20.193.96:0/2510968702 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fbd54060ce0 0x7fbd54061110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:49.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.943+0000 7fbd59a276c0 1 --2- 10.20.193.96:0/2510968702 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbd540622d0 0x7fbd540607a0 unknown :-1 s=CLOSED pgs=441 gs=1 cs=0 l=1 c_cookie=8893893869351142019 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:49.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.943+0000 7fbd59a276c0 1 -- 10.20.193.96:0/2510968702 >> 10.20.193.96:0/2510968702 conn(0x7fbd540ea880 msgr2=0x7fbd5410ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:49.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.943+0000 7fbd59a276c0 1 -- 10.20.193.96:0/2510968702 shutdown_connections 2026-02-13T03:37:49.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.943+0000 7fbd59a276c0 1 -- 10.20.193.96:0/2510968702 wait complete. 2026-02-13T03:37:49.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.944+0000 7fbd59a276c0 1 Processor -- start 2026-02-13T03:37:49.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.944+0000 7fbd59a276c0 1 -- start start 2026-02-13T03:37:49.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.944+0000 7fbd59a276c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fbd54060ce0 0x7fbd540f22d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:49.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.944+0000 7fbd59a276c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbd540622d0 0x7fbd540f2810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:49.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.944+0000 7fbd59a276c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fbd54159ac0 0x7fbd540f7bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:49.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.944+0000 7fbd59a276c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fbd540f8220 con 0x7fbd540622d0 2026-02-13T03:37:49.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.944+0000 7fbd59a276c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbd540f8390 con 0x7fbd54060ce0 2026-02-13T03:37:49.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.944+0000 7fbd59a276c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbd540f8550 con 0x7fbd54159ac0 2026-02-13T03:37:49.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.944+0000 7fbd527fc6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbd540622d0 0x7fbd540f2810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:49.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.944+0000 7fbd527fc6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbd540622d0 0x7fbd540f2810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:50164/0 (socket says 10.20.193.96:50164) 2026-02-13T03:37:49.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.944+0000 7fbd527fc6c0 1 -- 10.20.193.96:0/14322038 learned_addr learned my addr 10.20.193.96:0/14322038 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:37:49.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.944+0000 7fbd537fe6c0 1 --2- 10.20.193.96:0/14322038 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fbd54159ac0 0x7fbd540f7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:49.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.944+0000 7fbd52ffd6c0 1 --2- 10.20.193.96:0/14322038 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fbd54060ce0 0x7fbd540f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:49.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.944+0000 7fbd527fc6c0 1 -- 10.20.193.96:0/14322038 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fbd54159ac0 msgr2=0x7fbd540f7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:49.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.944+0000 7fbd527fc6c0 1 --2- 10.20.193.96:0/14322038 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fbd54159ac0 0x7fbd540f7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:49.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.944+0000 7fbd527fc6c0 1 -- 10.20.193.96:0/14322038 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fbd54060ce0 msgr2=0x7fbd540f22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:49.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.944+0000 7fbd527fc6c0 1 --2- 10.20.193.96:0/14322038 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fbd54060ce0 0x7fbd540f22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:49.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.944+0000 7fbd527fc6c0 1 -- 10.20.193.96:0/14322038 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd48009590 con 0x7fbd540622d0 2026-02-13T03:37:49.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.944+0000 7fbd527fc6c0 1 --2- 10.20.193.96:0/14322038 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbd540622d0 0x7fbd540f2810 secure :-1 s=READY pgs=442 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd3c00b710 tx=0x7fbd3c00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:49.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.944+0000 7fbd58a216c0 1 -- 10.20.193.96:0/14322038 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd3c004250 con 0x7fbd540622d0 2026-02-13T03:37:49.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.944+0000 7fbd59a276c0 1 -- 10.20.193.96:0/14322038 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd540f8830 con 0x7fbd540622d0 2026-02-13T03:37:49.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.944+0000 7fbd58a216c0 1 -- 10.20.193.96:0/14322038 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fbd3c002da0 con 0x7fbd540622d0 2026-02-13T03:37:49.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.944+0000 7fbd58a216c0 1 -- 10.20.193.96:0/14322038 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd3c00ce30 con 0x7fbd540622d0 2026-02-13T03:37:49.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.944+0000 7fbd59a276c0 1 -- 10.20.193.96:0/14322038 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd540f8ef0 con 0x7fbd540622d0 2026-02-13T03:37:49.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.945+0000 7fbd59a276c0 1 -- 10.20.193.96:0/14322038 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd54061cb0 con 0x7fbd540622d0 2026-02-13T03:37:49.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.946+0000 7fbd58a216c0 1 -- 10.20.193.96:0/14322038 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fbd3c0028c0 con 0x7fbd540622d0 2026-02-13T03:37:49.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.947+0000 7fbd58a216c0 1 --2- 10.20.193.96:0/14322038 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fbd280b5600 0x7fbd280d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:49.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.947+0000 7fbd58a216c0 1 -- 10.20.193.96:0/14322038 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7fbd3c0e3c00 con 0x7fbd540622d0 2026-02-13T03:37:49.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.947+0000 7fbd52ffd6c0 1 --2- 10.20.193.96:0/14322038 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fbd280b5600 0x7fbd280d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:49.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.947+0000 7fbd58a216c0 1 -- 10.20.193.96:0/14322038 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbd3c0a66a0 con 0x7fbd540622d0 2026-02-13T03:37:49.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:49.947+0000 7fbd52ffd6c0 1 --2- 10.20.193.96:0/14322038 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fbd280b5600 0x7fbd280d5ab0 secure :-1 s=READY pgs=285 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd480098c0 tx=0x7fbd480091a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:50.063 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:50.059+0000 7fbd59a276c0 1 -- 10.20.193.96:0/14322038 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbd540f3420 con 0x7fbd540622d0 2026-02-13T03:37:50.063 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:50.059+0000 7fbd58a216c0 1 -- 10.20.193.96:0/14322038 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fbd3c0a9850 con 0x7fbd540622d0 2026-02-13T03:37:50.063 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:37:50.064 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:37:50.064 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:50.060+0000 7fbd59a276c0 1 -- 10.20.193.96:0/14322038 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fbd280b5600 msgr2=0x7fbd280d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:50.064 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:50.060+0000 7fbd59a276c0 1 --2- 10.20.193.96:0/14322038 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fbd280b5600 0x7fbd280d5ab0 secure :-1 s=READY pgs=285 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd480098c0 tx=0x7fbd480091a0 comp rx=0 tx=0).stop 2026-02-13T03:37:50.064 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:50.060+0000 7fbd59a276c0 1 -- 10.20.193.96:0/14322038 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbd540622d0 msgr2=0x7fbd540f2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:50.065 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:50.060+0000 7fbd59a276c0 1 --2- 10.20.193.96:0/14322038 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbd540622d0 0x7fbd540f2810 secure :-1 s=READY pgs=442 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd3c00b710 tx=0x7fbd3c00bbe0 comp rx=0 tx=0).stop 2026-02-13T03:37:50.065 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:50.060+0000 7fbd59a276c0 1 -- 10.20.193.96:0/14322038 shutdown_connections 2026-02-13T03:37:50.065 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:50.060+0000 7fbd59a276c0 1 --2- 10.20.193.96:0/14322038 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fbd280b5600 0x7fbd280d5ab0 unknown :-1 s=CLOSED pgs=285 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:50.065 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:50.060+0000 7fbd59a276c0 1 --2- 10.20.193.96:0/14322038 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fbd54159ac0 0x7fbd540f7bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:50.065 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:50.060+0000 7fbd59a276c0 1 --2- 10.20.193.96:0/14322038 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbd540622d0 0x7fbd540f2810 unknown :-1 s=CLOSED pgs=442 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:50.065 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:50.060+0000 7fbd59a276c0 1 --2- 10.20.193.96:0/14322038 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fbd54060ce0 0x7fbd540f22d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:50.065 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:50.060+0000 7fbd59a276c0 1 -- 10.20.193.96:0/14322038 >> 10.20.193.96:0/14322038 conn(0x7fbd540ea880 msgr2=0x7fbd5410ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:50.065 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:50.060+0000 7fbd59a276c0 1 -- 10.20.193.96:0/14322038 shutdown_connections 2026-02-13T03:37:50.065 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:50.060+0000 7fbd59a276c0 1 -- 10.20.193.96:0/14322038 wait complete. 2026-02-13T03:37:51.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:51 trial096 ceph-mon[24671]: pgmap v298: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:37:51.425 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:51 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/14322038' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:51.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:51 trial132 ceph-mon[26888]: pgmap v298: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:37:51.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:51 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/14322038' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:51.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:51 trial133 ceph-mon[26943]: pgmap v298: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:37:51.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:51 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/14322038' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:52.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:52 trial096 ceph-mon[24671]: pgmap v299: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:52.482 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:52 trial132 ceph-mon[26888]: pgmap v299: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:52.513 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:52 trial133 ceph-mon[26943]: pgmap v299: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:53.106 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:37:53.225 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:37:53.345 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f98546c0 1 -- 10.20.193.96:0/4127799727 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f48f410fc20 msgr2=0x7f48f4114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:53.345 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f98546c0 1 --2- 10.20.193.96:0/4127799727 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f48f410fc20 0x7f48f4114c60 secure :-1 s=READY pgs=443 gs=1 cs=0 l=1 c_cookie=6424040612269331922 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f48dc0099a0 tx=0x7f48dc02ed00 comp rx=0 tx=0).stop 2026-02-13T03:37:53.345 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f98546c0 1 -- 10.20.193.96:0/4127799727 shutdown_connections 2026-02-13T03:37:53.345 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f98546c0 1 --2- 10.20.193.96:0/4127799727 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f48f4115440 0x7f48f4175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:53.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f98546c0 1 --2- 10.20.193.96:0/4127799727 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f48f410fc20 0x7f48f4114c60 unknown :-1 s=CLOSED pgs=443 gs=1 cs=0 l=1 c_cookie=6424040612269331922 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:53.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f98546c0 1 --2- 10.20.193.96:0/4127799727 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f48f410f230 0x7f48f410f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:53.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f98546c0 1 -- 10.20.193.96:0/4127799727 >> 10.20.193.96:0/4127799727 conn(0x7f48f40ecb30 msgr2=0x7f48f410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:53.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f98546c0 1 -- 10.20.193.96:0/4127799727 shutdown_connections 2026-02-13T03:37:53.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f98546c0 1 -- 10.20.193.96:0/4127799727 wait complete. 2026-02-13T03:37:53.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f98546c0 1 Processor -- start 2026-02-13T03:37:53.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f98546c0 1 -- start start 2026-02-13T03:37:53.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f98546c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f48f410f230 0x7f48f40f4b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:53.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f98546c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f48f4115440 0x7f48f4175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:53.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f98546c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f48f40f5170 0x7f48f40fa440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:53.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f98546c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f48f40f57d0 con 0x7f48f40f5170 2026-02-13T03:37:53.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f98546c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f48f40fa980 con 0x7f48f4115440 2026-02-13T03:37:53.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f98546c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f48f40fab40 con 0x7f48f410f230 2026-02-13T03:37:53.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f37fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f48f40f5170 0x7f48f40fa440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:53.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f37fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f48f40f5170 0x7f48f40fa440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49056/0 (socket says 10.20.193.96:49056) 2026-02-13T03:37:53.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f37fe6c0 1 -- 10.20.193.96:0/3551903397 learned_addr learned my addr 10.20.193.96:0/3551903397 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:37:53.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f27fc6c0 1 --2- 10.20.193.96:0/3551903397 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f48f4115440 0x7f48f4175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:53.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f2ffd6c0 1 --2- 10.20.193.96:0/3551903397 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f48f410f230 0x7f48f40f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:53.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f37fe6c0 1 -- 10.20.193.96:0/3551903397 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f48f410f230 msgr2=0x7f48f40f4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:53.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f37fe6c0 1 --2- 10.20.193.96:0/3551903397 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f48f410f230 0x7f48f40f4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:53.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f37fe6c0 1 -- 10.20.193.96:0/3551903397 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f48f4115440 msgr2=0x7f48f4175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:53.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f37fe6c0 1 --2- 10.20.193.96:0/3551903397 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f48f4115440 0x7f48f4175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:53.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f37fe6c0 1 -- 10.20.193.96:0/3551903397 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48dc009590 con 0x7f48f40f5170 2026-02-13T03:37:53.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.340+0000 7f48f2ffd6c0 1 --2- 10.20.193.96:0/3551903397 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f48f410f230 0x7f48f40f4b40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:37:53.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.341+0000 7f48f37fe6c0 1 --2- 10.20.193.96:0/3551903397 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f48f40f5170 0x7f48f40fa440 secure :-1 s=READY pgs=444 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f48e400c730 tx=0x7f48e400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:53.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.341+0000 7f48f884e6c0 1 -- 10.20.193.96:0/3551903397 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f48e4003c40 con 0x7f48f40f5170 2026-02-13T03:37:53.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.341+0000 7f48f98546c0 1 -- 10.20.193.96:0/3551903397 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f40fadc0 con 0x7f48f40f5170 2026-02-13T03:37:53.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.341+0000 7f48f884e6c0 1 -- 10.20.193.96:0/3551903397 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f48e400a070 con 0x7f48f40f5170 2026-02-13T03:37:53.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.341+0000 7f48f884e6c0 1 -- 10.20.193.96:0/3551903397 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f48e400dcf0 con 0x7f48f40f5170 2026-02-13T03:37:53.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.341+0000 7f48f98546c0 1 -- 10.20.193.96:0/3551903397 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f40fb5b0 con 0x7f48f40f5170 2026-02-13T03:37:53.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.341+0000 7f48f98546c0 1 -- 10.20.193.96:0/3551903397 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48f40fb2f0 con 0x7f48f40f5170 2026-02-13T03:37:53.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.343+0000 7f48f884e6c0 1 -- 10.20.193.96:0/3551903397 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f48e4005030 con 0x7f48f40f5170 2026-02-13T03:37:53.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.343+0000 7f48f884e6c0 1 --2- 10.20.193.96:0/3551903397 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f48c80b5600 0x7f48c80d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:53.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.344+0000 7f48f2ffd6c0 1 --2- 10.20.193.96:0/3551903397 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f48c80b5600 0x7f48c80d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:53.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.344+0000 7f48f884e6c0 1 -- 10.20.193.96:0/3551903397 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f48e40e4930 con 0x7f48f40f5170 2026-02-13T03:37:53.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.344+0000 7f48f884e6c0 1 -- 10.20.193.96:0/3551903397 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f48e40e4e20 con 0x7f48f40f5170 2026-02-13T03:37:53.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.344+0000 7f48f2ffd6c0 1 --2- 10.20.193.96:0/3551903397 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f48c80b5600 0x7f48c80d5ab0 secure :-1 s=READY pgs=286 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f48e8004750 tx=0x7f48e80095b0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:53.462 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.458+0000 7f48f98546c0 1 -- 10.20.193.96:0/3551903397 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f48f40fb2f0 con 0x7f48f40f5170 2026-02-13T03:37:53.462 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.458+0000 7f48f884e6c0 1 -- 10.20.193.96:0/3551903397 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f48f40fb2f0 con 0x7f48f40f5170 2026-02-13T03:37:53.462 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:37:53.462 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:37:53.463 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.459+0000 7f48f98546c0 1 -- 10.20.193.96:0/3551903397 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f48c80b5600 msgr2=0x7f48c80d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:53.463 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.459+0000 7f48f98546c0 1 --2- 10.20.193.96:0/3551903397 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f48c80b5600 0x7f48c80d5ab0 secure :-1 s=READY pgs=286 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f48e8004750 tx=0x7f48e80095b0 comp rx=0 tx=0).stop 2026-02-13T03:37:53.463 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.459+0000 7f48f98546c0 1 -- 10.20.193.96:0/3551903397 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f48f40f5170 msgr2=0x7f48f40fa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:53.463 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.459+0000 7f48f98546c0 1 --2- 10.20.193.96:0/3551903397 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f48f40f5170 0x7f48f40fa440 secure :-1 s=READY pgs=444 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f48e400c730 tx=0x7f48e400cc00 comp rx=0 tx=0).stop 2026-02-13T03:37:53.464 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.459+0000 7f48f98546c0 1 -- 10.20.193.96:0/3551903397 shutdown_connections 2026-02-13T03:37:53.464 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.459+0000 7f48f98546c0 1 --2- 10.20.193.96:0/3551903397 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f48c80b5600 0x7f48c80d5ab0 unknown :-1 s=CLOSED pgs=286 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:53.464 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.459+0000 7f48f98546c0 1 --2- 10.20.193.96:0/3551903397 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f48f40f5170 0x7f48f40fa440 unknown :-1 s=CLOSED pgs=444 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:53.464 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.459+0000 7f48f98546c0 1 --2- 10.20.193.96:0/3551903397 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f48f4115440 0x7f48f4175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:53.464 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.459+0000 7f48f98546c0 1 --2- 10.20.193.96:0/3551903397 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f48f410f230 0x7f48f40f4b40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:53.464 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.459+0000 7f48f98546c0 1 -- 10.20.193.96:0/3551903397 >> 10.20.193.96:0/3551903397 conn(0x7f48f40ecb30 msgr2=0x7f48f410d790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:53.464 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.459+0000 7f48f98546c0 1 -- 10.20.193.96:0/3551903397 shutdown_connections 2026-02-13T03:37:53.464 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:53.459+0000 7f48f98546c0 1 -- 10.20.193.96:0/3551903397 wait complete. 2026-02-13T03:37:54.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:54 trial096 ceph-mon[24671]: pgmap v300: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:54.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:54 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3551903397' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:54.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:54 trial132 ceph-mon[26888]: pgmap v300: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:54.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:54 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3551903397' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:54.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:54 trial133 ceph-mon[26943]: pgmap v300: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:54.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:54 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3551903397' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:56.504 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:37:56.623 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:37:56.646 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:56 trial096 ceph-mon[24671]: pgmap v301: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:56.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:56 trial132 ceph-mon[26888]: pgmap v301: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:56.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.739+0000 7f2c732746c0 1 -- 10.20.193.96:0/541808947 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2c6c10f200 msgr2=0x7f2c6c10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:56.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.739+0000 7f2c732746c0 1 --2- 10.20.193.96:0/541808947 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2c6c10f200 0x7f2c6c10f5d0 secure :-1 s=READY pgs=445 gs=1 cs=0 l=1 c_cookie=17797661894245772182 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c5c0099a0 tx=0x7f2c5c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:37:56.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.739+0000 7f2c732746c0 1 -- 10.20.193.96:0/541808947 shutdown_connections 2026-02-13T03:37:56.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.739+0000 7f2c732746c0 1 --2- 10.20.193.96:0/541808947 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2c6c115410 0x7f2c6c175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:56.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.739+0000 7f2c732746c0 1 --2- 10.20.193.96:0/541808947 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2c6c10fbf0 0x7f2c6c114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:56.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.739+0000 7f2c732746c0 1 --2- 10.20.193.96:0/541808947 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2c6c10f200 0x7f2c6c10f5d0 unknown :-1 s=CLOSED pgs=445 gs=1 cs=0 l=1 c_cookie=17797661894245772182 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:56.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.739+0000 7f2c732746c0 1 -- 10.20.193.96:0/541808947 >> 10.20.193.96:0/541808947 conn(0x7f2c6c0ecb00 msgr2=0x7f2c6c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:56.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.739+0000 7f2c732746c0 1 -- 10.20.193.96:0/541808947 shutdown_connections 2026-02-13T03:37:56.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.739+0000 7f2c732746c0 1 -- 10.20.193.96:0/541808947 wait complete. 2026-02-13T03:37:56.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.740+0000 7f2c732746c0 1 Processor -- start 2026-02-13T03:37:56.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.740+0000 7f2c732746c0 1 -- start start 2026-02-13T03:37:56.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.740+0000 7f2c732746c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2c6c10f200 0x7f2c6c11d210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:56.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.740+0000 7f2c732746c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2c6c115410 0x7f2c6c11d750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:56.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.740+0000 7f2c732746c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2c6c122b10 0x7f2c6c122fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:56.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.740+0000 7f2c732746c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c123520 con 0x7f2c6c10f200 2026-02-13T03:37:56.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.740+0000 7f2c732746c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c123690 con 0x7f2c6c115410 2026-02-13T03:37:56.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.740+0000 7f2c732746c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c123850 con 0x7f2c6c122b10 2026-02-13T03:37:56.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.740+0000 7f2c70fe56c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2c6c10f200 0x7f2c6c11d210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:56.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.740+0000 7f2c70fe56c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2c6c10f200 0x7f2c6c11d210 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49082/0 (socket says 10.20.193.96:49082) 2026-02-13T03:37:56.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.740+0000 7f2c70fe56c0 1 -- 10.20.193.96:0/3124322508 learned_addr learned my addr 10.20.193.96:0/3124322508 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:37:56.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.740+0000 7f2c717e66c0 1 --2- 10.20.193.96:0/3124322508 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2c6c122b10 0x7f2c6c122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:56.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.740+0000 7f2c63fff6c0 1 --2- 10.20.193.96:0/3124322508 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2c6c115410 0x7f2c6c11d750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:56.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.740+0000 7f2c70fe56c0 1 -- 10.20.193.96:0/3124322508 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2c6c122b10 msgr2=0x7f2c6c122fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:56.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.740+0000 7f2c70fe56c0 1 --2- 10.20.193.96:0/3124322508 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2c6c122b10 0x7f2c6c122fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:56.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.740+0000 7f2c70fe56c0 1 -- 10.20.193.96:0/3124322508 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2c6c115410 msgr2=0x7f2c6c11d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:56.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.740+0000 7f2c70fe56c0 1 --2- 10.20.193.96:0/3124322508 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2c6c115410 0x7f2c6c11d750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:56.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.740+0000 7f2c70fe56c0 1 -- 10.20.193.96:0/3124322508 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5c009590 con 0x7f2c6c10f200 2026-02-13T03:37:56.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.740+0000 7f2c70fe56c0 1 --2- 10.20.193.96:0/3124322508 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2c6c10f200 0x7f2c6c11d210 secure :-1 s=READY pgs=446 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c5c0098c0 tx=0x7f2c5c0047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:56.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.740+0000 7f2c61ffb6c0 1 -- 10.20.193.96:0/3124322508 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c5c002ae0 con 0x7f2c6c10f200 2026-02-13T03:37:56.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.740+0000 7f2c732746c0 1 -- 10.20.193.96:0/3124322508 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c6c163ca0 con 0x7f2c6c10f200 2026-02-13T03:37:56.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.740+0000 7f2c61ffb6c0 1 -- 10.20.193.96:0/3124322508 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f2c5c002c40 con 0x7f2c6c10f200 2026-02-13T03:37:56.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.740+0000 7f2c61ffb6c0 1 -- 10.20.193.96:0/3124322508 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c5c0372f0 con 0x7f2c6c10f200 2026-02-13T03:37:56.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.740+0000 7f2c732746c0 1 -- 10.20.193.96:0/3124322508 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c6c1640d0 con 0x7f2c6c10f200 2026-02-13T03:37:56.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.741+0000 7f2c732746c0 1 -- 10.20.193.96:0/3124322508 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c6c1104d0 con 0x7f2c6c10f200 2026-02-13T03:37:56.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.742+0000 7f2c61ffb6c0 1 -- 10.20.193.96:0/3124322508 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f2c5c007960 con 0x7f2c6c10f200 2026-02-13T03:37:56.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.743+0000 7f2c61ffb6c0 1 --2- 10.20.193.96:0/3124322508 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f2c480b5600 0x7f2c480d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:37:56.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.743+0000 7f2c63fff6c0 1 --2- 10.20.193.96:0/3124322508 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f2c480b5600 0x7f2c480d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:37:56.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.743+0000 7f2c61ffb6c0 1 -- 10.20.193.96:0/3124322508 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f2c5c107cf0 con 0x7f2c6c10f200 2026-02-13T03:37:56.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.743+0000 7f2c63fff6c0 1 --2- 10.20.193.96:0/3124322508 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f2c480b5600 0x7f2c480d5ab0 secure :-1 s=READY pgs=287 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c54005980 tx=0x7f2c54005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:37:56.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.744+0000 7f2c61ffb6c0 1 -- 10.20.193.96:0/3124322508 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2c5c0ca750 con 0x7f2c6c10f200 2026-02-13T03:37:56.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:56 trial133 ceph-mon[26943]: pgmap v301: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:37:56.863 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.859+0000 7f2c732746c0 1 -- 10.20.193.96:0/3124322508 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2c6c10fbf0 con 0x7f2c6c10f200 2026-02-13T03:37:56.863 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.859+0000 7f2c61ffb6c0 1 -- 10.20.193.96:0/3124322508 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f2c5c002db0 con 0x7f2c6c10f200 2026-02-13T03:37:56.863 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:37:56.863 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:37:56.864 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.860+0000 7f2c732746c0 1 -- 10.20.193.96:0/3124322508 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f2c480b5600 msgr2=0x7f2c480d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:56.864 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.860+0000 7f2c732746c0 1 --2- 10.20.193.96:0/3124322508 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f2c480b5600 0x7f2c480d5ab0 secure :-1 s=READY pgs=287 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c54005980 tx=0x7f2c54005910 comp rx=0 tx=0).stop 2026-02-13T03:37:56.865 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.860+0000 7f2c732746c0 1 -- 10.20.193.96:0/3124322508 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2c6c10f200 msgr2=0x7f2c6c11d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:37:56.865 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.860+0000 7f2c732746c0 1 --2- 10.20.193.96:0/3124322508 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2c6c10f200 0x7f2c6c11d210 secure :-1 s=READY pgs=446 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c5c0098c0 tx=0x7f2c5c0047f0 comp rx=0 tx=0).stop 2026-02-13T03:37:56.865 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.860+0000 7f2c732746c0 1 -- 10.20.193.96:0/3124322508 shutdown_connections 2026-02-13T03:37:56.865 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.860+0000 7f2c732746c0 1 --2- 10.20.193.96:0/3124322508 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f2c480b5600 0x7f2c480d5ab0 unknown :-1 s=CLOSED pgs=287 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:56.865 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.860+0000 7f2c732746c0 1 --2- 10.20.193.96:0/3124322508 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f2c6c122b10 0x7f2c6c122fb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:56.865 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.860+0000 7f2c732746c0 1 --2- 10.20.193.96:0/3124322508 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f2c6c115410 0x7f2c6c11d750 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:56.865 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.860+0000 7f2c732746c0 1 --2- 10.20.193.96:0/3124322508 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f2c6c10f200 0x7f2c6c11d210 unknown :-1 s=CLOSED pgs=446 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:37:56.865 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.860+0000 7f2c732746c0 1 -- 10.20.193.96:0/3124322508 >> 10.20.193.96:0/3124322508 conn(0x7f2c6c0ecb00 msgr2=0x7f2c6c10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:37:56.865 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.860+0000 7f2c732746c0 1 -- 10.20.193.96:0/3124322508 shutdown_connections 2026-02-13T03:37:56.865 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:37:56.860+0000 7f2c732746c0 1 -- 10.20.193.96:0/3124322508 wait complete. 2026-02-13T03:37:57.674 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:57 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3124322508' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:57.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:57 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3124322508' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:57.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:57 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3124322508' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:37:58.674 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:37:58 trial096 ceph-mon[24671]: pgmap v302: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:58.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:37:58 trial132 ceph-mon[26888]: pgmap v302: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:58.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:37:58 trial133 ceph-mon[26943]: pgmap v302: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:37:59.904 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:38:00.022 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:38:00.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.138+0000 7f07d37736c0 1 -- 10.20.193.96:0/2067847199 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f07cc1131c0 msgr2=0x7f07cc173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:00.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.138+0000 7f07d37736c0 1 --2- 10.20.193.96:0/2067847199 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f07cc1131c0 0x7f07cc173b60 secure :-1 s=READY pgs=447 gs=1 cs=0 l=1 c_cookie=15242008205077208776 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07c800aa70 tx=0x7f07c802fde0 comp rx=0 tx=0).stop 2026-02-13T03:38:00.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.138+0000 7f07d37736c0 1 -- 10.20.193.96:0/2067847199 shutdown_connections 2026-02-13T03:38:00.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.138+0000 7f07d37736c0 1 --2- 10.20.193.96:0/2067847199 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f07cc1131c0 0x7f07cc173b60 unknown :-1 s=CLOSED pgs=447 gs=1 cs=0 l=1 c_cookie=15242008205077208776 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:00.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.138+0000 7f07d37736c0 1 --2- 10.20.193.96:0/2067847199 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f07cc10d9a0 0x7f07cc1129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:00.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.138+0000 7f07d37736c0 1 --2- 10.20.193.96:0/2067847199 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f07cc10cfb0 0x7f07cc10d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:00.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.138+0000 7f07d37736c0 1 -- 10.20.193.96:0/2067847199 >> 10.20.193.96:0/2067847199 conn(0x7f07cc0ea8b0 msgr2=0x7f07cc10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:00.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.138+0000 7f07d37736c0 1 -- 10.20.193.96:0/2067847199 shutdown_connections 2026-02-13T03:38:00.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.138+0000 7f07d37736c0 1 -- 10.20.193.96:0/2067847199 wait complete. 2026-02-13T03:38:00.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.139+0000 7f07d37736c0 1 Processor -- start 2026-02-13T03:38:00.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.139+0000 7f07d37736c0 1 -- start start 2026-02-13T03:38:00.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.139+0000 7f07d37736c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f07cc10cfb0 0x7f07cc11af80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:00.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.139+0000 7f07d37736c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f07cc1131c0 0x7f07cc11b4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:00.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.139+0000 7f07d37736c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f07cc120880 0x7f07cc120d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:00.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.139+0000 7f07d37736c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f07cc121260 con 0x7f07cc120880 2026-02-13T03:38:00.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.139+0000 7f07d37736c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f07cc1213d0 con 0x7f07cc1131c0 2026-02-13T03:38:00.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.139+0000 7f07d37736c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f07cc121590 con 0x7f07cc10cfb0 2026-02-13T03:38:00.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.139+0000 7f07d1ce56c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f07cc120880 0x7f07cc120d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:00.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.139+0000 7f07d1ce56c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f07cc120880 0x7f07cc120d20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49098/0 (socket says 10.20.193.96:49098) 2026-02-13T03:38:00.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.139+0000 7f07d1ce56c0 1 -- 10.20.193.96:0/3782265757 learned_addr learned my addr 10.20.193.96:0/3782265757 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:38:00.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.139+0000 7f07d0ce36c0 1 --2- 10.20.193.96:0/3782265757 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f07cc1131c0 0x7f07cc11b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:00.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.139+0000 7f07d14e46c0 1 --2- 10.20.193.96:0/3782265757 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f07cc10cfb0 0x7f07cc11af80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:00.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.139+0000 7f07d1ce56c0 1 -- 10.20.193.96:0/3782265757 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f07cc10cfb0 msgr2=0x7f07cc11af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:00.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.139+0000 7f07d1ce56c0 1 --2- 10.20.193.96:0/3782265757 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f07cc10cfb0 0x7f07cc11af80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:00.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.139+0000 7f07d1ce56c0 1 -- 10.20.193.96:0/3782265757 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f07cc1131c0 msgr2=0x7f07cc11b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:00.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.139+0000 7f07d1ce56c0 1 --2- 10.20.193.96:0/3782265757 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f07cc1131c0 0x7f07cc11b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:00.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.139+0000 7f07d1ce56c0 1 -- 10.20.193.96:0/3782265757 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c800a660 con 0x7f07cc120880 2026-02-13T03:38:00.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.139+0000 7f07d1ce56c0 1 --2- 10.20.193.96:0/3782265757 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f07cc120880 0x7f07cc120d20 secure :-1 s=READY pgs=448 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07c800ab70 tx=0x7f07c80054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:00.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.139+0000 7f07ba7fc6c0 1 -- 10.20.193.96:0/3782265757 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f07c8030d10 con 0x7f07cc120880 2026-02-13T03:38:00.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.139+0000 7f07ba7fc6c0 1 -- 10.20.193.96:0/3782265757 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f07c8030e70 con 0x7f07cc120880 2026-02-13T03:38:00.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.139+0000 7f07d37736c0 1 -- 10.20.193.96:0/3782265757 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07cc161a10 con 0x7f07cc120880 2026-02-13T03:38:00.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.139+0000 7f07ba7fc6c0 1 -- 10.20.193.96:0/3782265757 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f07c8008430 con 0x7f07cc120880 2026-02-13T03:38:00.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.139+0000 7f07d37736c0 1 -- 10.20.193.96:0/3782265757 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07cc161e90 con 0x7f07cc120880 2026-02-13T03:38:00.144 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.140+0000 7f07d37736c0 1 -- 10.20.193.96:0/3782265757 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07cc10e280 con 0x7f07cc120880 2026-02-13T03:38:00.144 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.141+0000 7f07ba7fc6c0 1 -- 10.20.193.96:0/3782265757 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f07c8003810 con 0x7f07cc120880 2026-02-13T03:38:00.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.141+0000 7f07ba7fc6c0 1 --2- 10.20.193.96:0/3782265757 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f07a80b5680 0x7f07a80d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:00.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.142+0000 7f07d14e46c0 1 --2- 10.20.193.96:0/3782265757 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f07a80b5680 0x7f07a80d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:00.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.142+0000 7f07ba7fc6c0 1 -- 10.20.193.96:0/3782265757 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f07c8108dd0 con 0x7f07cc120880 2026-02-13T03:38:00.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.142+0000 7f07d14e46c0 1 --2- 10.20.193.96:0/3782265757 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f07a80b5680 0x7f07a80d5b30 secure :-1 s=READY pgs=288 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07bc005980 tx=0x7f07bc005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:00.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.142+0000 7f07ba7fc6c0 1 -- 10.20.193.96:0/3782265757 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f07c80cb830 con 0x7f07cc120880 2026-02-13T03:38:00.261 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.258+0000 7f07d37736c0 1 -- 10.20.193.96:0/3782265757 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f07cc10d380 con 0x7f07cc120880 2026-02-13T03:38:00.262 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.258+0000 7f07ba7fc6c0 1 -- 10.20.193.96:0/3782265757 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f07c80ce9e0 con 0x7f07cc120880 2026-02-13T03:38:00.262 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:38:00.262 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:38:00.263 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.259+0000 7f07d37736c0 1 -- 10.20.193.96:0/3782265757 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f07a80b5680 msgr2=0x7f07a80d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:00.263 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.259+0000 7f07d37736c0 1 --2- 10.20.193.96:0/3782265757 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f07a80b5680 0x7f07a80d5b30 secure :-1 s=READY pgs=288 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07bc005980 tx=0x7f07bc005910 comp rx=0 tx=0).stop 2026-02-13T03:38:00.263 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.259+0000 7f07d37736c0 1 -- 10.20.193.96:0/3782265757 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f07cc120880 msgr2=0x7f07cc120d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:00.263 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.259+0000 7f07d37736c0 1 --2- 10.20.193.96:0/3782265757 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f07cc120880 0x7f07cc120d20 secure :-1 s=READY pgs=448 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07c800ab70 tx=0x7f07c80054b0 comp rx=0 tx=0).stop 2026-02-13T03:38:00.263 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.259+0000 7f07d37736c0 1 -- 10.20.193.96:0/3782265757 shutdown_connections 2026-02-13T03:38:00.263 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.259+0000 7f07d37736c0 1 --2- 10.20.193.96:0/3782265757 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f07a80b5680 0x7f07a80d5b30 unknown :-1 s=CLOSED pgs=288 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:00.263 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.259+0000 7f07d37736c0 1 --2- 10.20.193.96:0/3782265757 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f07cc120880 0x7f07cc120d20 unknown :-1 s=CLOSED pgs=448 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:00.263 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.259+0000 7f07d37736c0 1 --2- 10.20.193.96:0/3782265757 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f07cc1131c0 0x7f07cc11b4c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:00.263 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.259+0000 7f07d37736c0 1 --2- 10.20.193.96:0/3782265757 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f07cc10cfb0 0x7f07cc11af80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:00.263 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.259+0000 7f07d37736c0 1 -- 10.20.193.96:0/3782265757 >> 10.20.193.96:0/3782265757 conn(0x7f07cc0ea8b0 msgr2=0x7f07cc10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:00.263 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.259+0000 7f07d37736c0 1 -- 10.20.193.96:0/3782265757 shutdown_connections 2026-02-13T03:38:00.263 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:00.260+0000 7f07d37736c0 1 -- 10.20.193.96:0/3782265757 wait complete. 2026-02-13T03:38:00.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:00 trial096 ceph-mon[24671]: pgmap v303: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:38:00.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:00 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3782265757' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:00.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:00 trial132 ceph-mon[26888]: pgmap v303: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:38:00.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:00 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3782265757' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:00.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:00 trial133 ceph-mon[26943]: pgmap v303: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:38:00.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:00 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3782265757' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:02.674 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:02 trial096 ceph-mon[24671]: pgmap v304: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:02.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:02 trial132 ceph-mon[26888]: pgmap v304: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:02.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:02 trial133 ceph-mon[26943]: pgmap v304: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:03.305 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:38:03.429 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:38:03.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.540+0000 7f5146aa06c0 1 -- 10.20.193.96:0/2783000048 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f514010fbf0 msgr2=0x7f5140114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:03.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.540+0000 7f5146aa06c0 1 --2- 10.20.193.96:0/2783000048 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f514010fbf0 0x7f5140114c30 secure :-1 s=READY pgs=449 gs=1 cs=0 l=1 c_cookie=2489750443637707417 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f51280099a0 tx=0x7f512802ed50 comp rx=0 tx=0).stop 2026-02-13T03:38:03.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.540+0000 7f5146aa06c0 1 -- 10.20.193.96:0/2783000048 shutdown_connections 2026-02-13T03:38:03.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.540+0000 7f5146aa06c0 1 --2- 10.20.193.96:0/2783000048 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5140115410 0x7f5140175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:03.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.540+0000 7f5146aa06c0 1 --2- 10.20.193.96:0/2783000048 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f514010fbf0 0x7f5140114c30 unknown :-1 s=CLOSED pgs=449 gs=1 cs=0 l=1 c_cookie=2489750443637707417 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:03.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.540+0000 7f5146aa06c0 1 --2- 10.20.193.96:0/2783000048 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f514010f200 0x7f514010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:03.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.540+0000 7f5146aa06c0 1 -- 10.20.193.96:0/2783000048 >> 10.20.193.96:0/2783000048 conn(0x7f51400ecb00 msgr2=0x7f514010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:03.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.540+0000 7f5146aa06c0 1 -- 10.20.193.96:0/2783000048 shutdown_connections 2026-02-13T03:38:03.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.540+0000 7f5146aa06c0 1 -- 10.20.193.96:0/2783000048 wait complete. 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f5146aa06c0 1 Processor -- start 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f5146aa06c0 1 -- start start 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f5146aa06c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f514010f200 0x7f514011d1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f5146aa06c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5140115410 0x7f514011d6e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f5146aa06c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5140122aa0 0x7f5140122f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f5146aa06c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5140123480 con 0x7f5140122aa0 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f5146aa06c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f51401235f0 con 0x7f514010f200 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f5146aa06c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f51401237b0 con 0x7f5140115410 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f51450126c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5140122aa0 0x7f5140122f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f51450126c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5140122aa0 0x7f5140122f40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:56042/0 (socket says 10.20.193.96:56042) 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f51450126c0 1 -- 10.20.193.96:0/4075252862 learned_addr learned my addr 10.20.193.96:0/4075252862 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f5137fff6c0 1 --2- 10.20.193.96:0/4075252862 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5140115410 0x7f514011d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f51450126c0 1 -- 10.20.193.96:0/4075252862 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5140115410 msgr2=0x7f514011d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f51448116c0 1 --2- 10.20.193.96:0/4075252862 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f514010f200 0x7f514011d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f51450126c0 1 --2- 10.20.193.96:0/4075252862 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5140115410 0x7f514011d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f51450126c0 1 -- 10.20.193.96:0/4075252862 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f514010f200 msgr2=0x7f514011d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f51450126c0 1 --2- 10.20.193.96:0/4075252862 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f514010f200 0x7f514011d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f51450126c0 1 -- 10.20.193.96:0/4075252862 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5128009590 con 0x7f5140122aa0 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f51448116c0 1 --2- 10.20.193.96:0/4075252862 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f514010f200 0x7f514011d1a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f51450126c0 1 --2- 10.20.193.96:0/4075252862 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5140122aa0 0x7f5140122f40 secure :-1 s=READY pgs=450 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f513c00c730 tx=0x7f513c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f5135ffb6c0 1 -- 10.20.193.96:0/4075252862 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f513c003c40 con 0x7f5140122aa0 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f5135ffb6c0 1 -- 10.20.193.96:0/4075252862 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f513c00a070 con 0x7f5140122aa0 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f5146aa06c0 1 -- 10.20.193.96:0/4075252862 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5140163c30 con 0x7f5140122aa0 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f5135ffb6c0 1 -- 10.20.193.96:0/4075252862 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f513c00dcf0 con 0x7f5140122aa0 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.541+0000 7f5146aa06c0 1 -- 10.20.193.96:0/4075252862 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5140164160 con 0x7f5140122aa0 2026-02-13T03:38:03.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.542+0000 7f5146aa06c0 1 -- 10.20.193.96:0/4075252862 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51401104d0 con 0x7f5140122aa0 2026-02-13T03:38:03.546 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.543+0000 7f5135ffb6c0 1 -- 10.20.193.96:0/4075252862 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f513c005030 con 0x7f5140122aa0 2026-02-13T03:38:03.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.543+0000 7f5135ffb6c0 1 --2- 10.20.193.96:0/4075252862 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f511c0b5680 0x7f511c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:03.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.544+0000 7f51448116c0 1 --2- 10.20.193.96:0/4075252862 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f511c0b5680 0x7f511c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:03.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.544+0000 7f5135ffb6c0 1 -- 10.20.193.96:0/4075252862 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f513c0e4af0 con 0x7f5140122aa0 2026-02-13T03:38:03.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.544+0000 7f51448116c0 1 --2- 10.20.193.96:0/4075252862 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f511c0b5680 0x7f511c0d5b30 secure :-1 s=READY pgs=289 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5130004750 tx=0x7f5130009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:03.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.544+0000 7f5135ffb6c0 1 -- 10.20.193.96:0/4075252862 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f513c0a7550 con 0x7f5140122aa0 2026-02-13T03:38:03.663 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.659+0000 7f5146aa06c0 1 -- 10.20.193.96:0/4075252862 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f514011e2f0 con 0x7f5140122aa0 2026-02-13T03:38:03.663 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.659+0000 7f5135ffb6c0 1 -- 10.20.193.96:0/4075252862 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f513c0aa700 con 0x7f5140122aa0 2026-02-13T03:38:03.663 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:38:03.663 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:38:03.664 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.660+0000 7f5146aa06c0 1 -- 10.20.193.96:0/4075252862 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f511c0b5680 msgr2=0x7f511c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:03.664 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.660+0000 7f5146aa06c0 1 --2- 10.20.193.96:0/4075252862 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f511c0b5680 0x7f511c0d5b30 secure :-1 s=READY pgs=289 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5130004750 tx=0x7f5130009260 comp rx=0 tx=0).stop 2026-02-13T03:38:03.664 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.660+0000 7f5146aa06c0 1 -- 10.20.193.96:0/4075252862 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5140122aa0 msgr2=0x7f5140122f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:03.664 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.660+0000 7f5146aa06c0 1 --2- 10.20.193.96:0/4075252862 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5140122aa0 0x7f5140122f40 secure :-1 s=READY pgs=450 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f513c00c730 tx=0x7f513c00cc00 comp rx=0 tx=0).stop 2026-02-13T03:38:03.664 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.660+0000 7f5146aa06c0 1 -- 10.20.193.96:0/4075252862 shutdown_connections 2026-02-13T03:38:03.664 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.660+0000 7f5146aa06c0 1 --2- 10.20.193.96:0/4075252862 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f511c0b5680 0x7f511c0d5b30 unknown :-1 s=CLOSED pgs=289 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:03.664 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.660+0000 7f5146aa06c0 1 --2- 10.20.193.96:0/4075252862 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5140122aa0 0x7f5140122f40 unknown :-1 s=CLOSED pgs=450 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:03.664 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.660+0000 7f5146aa06c0 1 --2- 10.20.193.96:0/4075252862 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5140115410 0x7f514011d6e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:03.664 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.660+0000 7f5146aa06c0 1 --2- 10.20.193.96:0/4075252862 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f514010f200 0x7f514011d1a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:03.664 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.660+0000 7f5146aa06c0 1 -- 10.20.193.96:0/4075252862 >> 10.20.193.96:0/4075252862 conn(0x7f51400ecb00 msgr2=0x7f514010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:03.664 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.660+0000 7f5146aa06c0 1 -- 10.20.193.96:0/4075252862 shutdown_connections 2026-02-13T03:38:03.664 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:03.660+0000 7f5146aa06c0 1 -- 10.20.193.96:0/4075252862 wait complete. 2026-02-13T03:38:04.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:04 trial096 ceph-mon[24671]: pgmap v305: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:04.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:04 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/4075252862' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:04.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:04 trial132 ceph-mon[26888]: pgmap v305: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:04.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:04 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/4075252862' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:04.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:04 trial133 ceph-mon[26943]: pgmap v305: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:04.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:04 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/4075252862' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:06.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:06 trial096 ceph-mon[24671]: pgmap v306: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:06.704 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:38:06.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:06 trial132 ceph-mon[26888]: pgmap v306: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:06.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:06 trial133 ceph-mon[26943]: pgmap v306: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:06.817 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:38:06.942 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.937+0000 7f73a99036c0 1 -- 10.20.193.96:0/380389580 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f73a4115410 msgr2=0x7f73a4175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:06.943 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.937+0000 7f73a99036c0 1 --2- 10.20.193.96:0/380389580 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f73a4115410 0x7f73a4175db0 secure :-1 s=READY pgs=451 gs=1 cs=0 l=1 c_cookie=1891798461094854460 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f739400aa70 tx=0x7f739402fde0 comp rx=0 tx=0).stop 2026-02-13T03:38:06.943 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.937+0000 7f73a99036c0 1 -- 10.20.193.96:0/380389580 shutdown_connections 2026-02-13T03:38:06.943 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.937+0000 7f73a99036c0 1 --2- 10.20.193.96:0/380389580 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f73a4115410 0x7f73a4175db0 unknown :-1 s=CLOSED pgs=451 gs=1 cs=0 l=1 c_cookie=1891798461094854460 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:06.943 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.937+0000 7f73a99036c0 1 --2- 10.20.193.96:0/380389580 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f73a410fbf0 0x7f73a4114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:06.943 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.937+0000 7f73a99036c0 1 --2- 10.20.193.96:0/380389580 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f73a410f200 0x7f73a410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:06.943 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.937+0000 7f73a99036c0 1 -- 10.20.193.96:0/380389580 >> 10.20.193.96:0/380389580 conn(0x7f73a40ecb00 msgr2=0x7f73a410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:06.943 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.937+0000 7f73a99036c0 1 -- 10.20.193.96:0/380389580 shutdown_connections 2026-02-13T03:38:06.943 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.937+0000 7f73a99036c0 1 -- 10.20.193.96:0/380389580 wait complete. 2026-02-13T03:38:06.943 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.938+0000 7f73a99036c0 1 Processor -- start 2026-02-13T03:38:06.944 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.938+0000 7f73a99036c0 1 -- start start 2026-02-13T03:38:06.944 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.938+0000 7f73a99036c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f73a410f200 0x7f73a411d100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:06.944 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.938+0000 7f73a99036c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f73a4115410 0x7f73a411d640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:06.944 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.938+0000 7f73a99036c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f73a4122a00 0x7f73a4122ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:06.944 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.938+0000 7f73a99036c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f73a4123410 con 0x7f73a410f200 2026-02-13T03:38:06.944 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.938+0000 7f73a99036c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f73a4123580 con 0x7f73a4122a00 2026-02-13T03:38:06.944 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.938+0000 7f73a99036c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f73a4123740 con 0x7f73a4115410 2026-02-13T03:38:06.944 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.938+0000 7f73a2ffd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f73a410f200 0x7f73a411d100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:06.944 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.938+0000 7f73a2ffd6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f73a410f200 0x7f73a411d100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:56060/0 (socket says 10.20.193.96:56060) 2026-02-13T03:38:06.944 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.938+0000 7f73a2ffd6c0 1 -- 10.20.193.96:0/1335523170 learned_addr learned my addr 10.20.193.96:0/1335523170 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:38:06.944 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.938+0000 7f73a2ffd6c0 1 -- 10.20.193.96:0/1335523170 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f73a4115410 msgr2=0x7f73a411d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:06.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.938+0000 7f73a2ffd6c0 1 --2- 10.20.193.96:0/1335523170 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f73a4115410 0x7f73a411d640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:06.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.938+0000 7f73a2ffd6c0 1 -- 10.20.193.96:0/1335523170 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f73a4122a00 msgr2=0x7f73a4122ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:06.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.938+0000 7f73a2ffd6c0 1 --2- 10.20.193.96:0/1335523170 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f73a4122a00 0x7f73a4122ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:06.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.938+0000 7f73a2ffd6c0 1 -- 10.20.193.96:0/1335523170 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f739400a660 con 0x7f73a410f200 2026-02-13T03:38:06.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.938+0000 7f73a2ffd6c0 1 --2- 10.20.193.96:0/1335523170 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f73a410f200 0x7f73a411d100 secure :-1 s=READY pgs=452 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7398005dc0 tx=0x7f739800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:06.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.938+0000 7f73a88fd6c0 1 -- 10.20.193.96:0/1335523170 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7398004250 con 0x7f73a410f200 2026-02-13T03:38:06.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.938+0000 7f73a88fd6c0 1 -- 10.20.193.96:0/1335523170 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f7398009070 con 0x7f73a410f200 2026-02-13T03:38:06.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.938+0000 7f73a99036c0 1 -- 10.20.193.96:0/1335523170 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73a4163bf0 con 0x7f73a410f200 2026-02-13T03:38:06.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.938+0000 7f73a88fd6c0 1 -- 10.20.193.96:0/1335523170 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f739800cdb0 con 0x7f73a410f200 2026-02-13T03:38:06.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.938+0000 7f73a99036c0 1 -- 10.20.193.96:0/1335523170 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73a4164080 con 0x7f73a410f200 2026-02-13T03:38:06.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.939+0000 7f73a99036c0 1 -- 10.20.193.96:0/1335523170 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73a41104d0 con 0x7f73a410f200 2026-02-13T03:38:06.946 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.940+0000 7f73a88fd6c0 1 -- 10.20.193.96:0/1335523170 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f73980028c0 con 0x7f73a410f200 2026-02-13T03:38:06.947 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.941+0000 7f73a88fd6c0 1 --2- 10.20.193.96:0/1335523170 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f73780b5600 0x7f73780d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:06.947 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.941+0000 7f73a27fc6c0 1 --2- 10.20.193.96:0/1335523170 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f73780b5600 0x7f73780d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:06.947 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.941+0000 7f73a88fd6c0 1 -- 10.20.193.96:0/1335523170 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f73980e3ae0 con 0x7f73a410f200 2026-02-13T03:38:06.947 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.941+0000 7f73a88fd6c0 1 -- 10.20.193.96:0/1335523170 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f73980a6580 con 0x7f73a410f200 2026-02-13T03:38:06.947 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:06.941+0000 7f73a27fc6c0 1 --2- 10.20.193.96:0/1335523170 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f73780b5600 0x7f73780d5ab0 secure :-1 s=READY pgs=290 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f738c005980 tx=0x7f738c005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:07.062 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:07.058+0000 7f73a99036c0 1 -- 10.20.193.96:0/1335523170 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f73a410f5d0 con 0x7f73a410f200 2026-02-13T03:38:07.063 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:07.059+0000 7f73a88fd6c0 1 -- 10.20.193.96:0/1335523170 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f73980a9730 con 0x7f73a410f200 2026-02-13T03:38:07.063 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:38:07.063 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:38:07.064 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:07.060+0000 7f73a99036c0 1 -- 10.20.193.96:0/1335523170 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f73780b5600 msgr2=0x7f73780d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:07.065 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:07.060+0000 7f73a99036c0 1 --2- 10.20.193.96:0/1335523170 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f73780b5600 0x7f73780d5ab0 secure :-1 s=READY pgs=290 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f738c005980 tx=0x7f738c005910 comp rx=0 tx=0).stop 2026-02-13T03:38:07.065 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:07.060+0000 7f73a99036c0 1 -- 10.20.193.96:0/1335523170 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f73a410f200 msgr2=0x7f73a411d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:07.065 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:07.060+0000 7f73a99036c0 1 --2- 10.20.193.96:0/1335523170 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f73a410f200 0x7f73a411d100 secure :-1 s=READY pgs=452 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7398005dc0 tx=0x7f739800bbb0 comp rx=0 tx=0).stop 2026-02-13T03:38:07.065 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:07.060+0000 7f73a99036c0 1 -- 10.20.193.96:0/1335523170 shutdown_connections 2026-02-13T03:38:07.065 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:07.060+0000 7f73a99036c0 1 --2- 10.20.193.96:0/1335523170 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f73780b5600 0x7f73780d5ab0 unknown :-1 s=CLOSED pgs=290 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:07.065 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:07.060+0000 7f73a99036c0 1 --2- 10.20.193.96:0/1335523170 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f73a4122a00 0x7f73a4122ea0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:07.065 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:07.060+0000 7f73a99036c0 1 --2- 10.20.193.96:0/1335523170 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f73a4115410 0x7f73a411d640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:07.065 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:07.060+0000 7f73a99036c0 1 --2- 10.20.193.96:0/1335523170 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f73a410f200 0x7f73a411d100 unknown :-1 s=CLOSED pgs=452 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:07.065 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:07.060+0000 7f73a99036c0 1 -- 10.20.193.96:0/1335523170 >> 10.20.193.96:0/1335523170 conn(0x7f73a40ecb00 msgr2=0x7f73a410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:07.065 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:07.060+0000 7f73a99036c0 1 -- 10.20.193.96:0/1335523170 shutdown_connections 2026-02-13T03:38:07.065 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:07.060+0000 7f73a99036c0 1 -- 10.20.193.96:0/1335523170 wait complete. 2026-02-13T03:38:07.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:07 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1335523170' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:07.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:07 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1335523170' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:07.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:07 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1335523170' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:08.674 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:08 trial096 ceph-mon[24671]: pgmap v307: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:08.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:08 trial132 ceph-mon[26888]: pgmap v307: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:08.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:08 trial133 ceph-mon[26943]: pgmap v307: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:10.106 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:38:10.224 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:38:10.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.342+0000 7f26bb29c6c0 1 -- 10.20.193.96:0/1161670641 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f26b410fc20 msgr2=0x7f26b4114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:10.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.342+0000 7f26bb29c6c0 1 --2- 10.20.193.96:0/1161670641 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f26b410fc20 0x7f26b4114c60 secure :-1 s=READY pgs=453 gs=1 cs=0 l=1 c_cookie=7180560390405651365 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26a80099a0 tx=0x7f26a802ed00 comp rx=0 tx=0).stop 2026-02-13T03:38:10.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.342+0000 7f26bb29c6c0 1 -- 10.20.193.96:0/1161670641 shutdown_connections 2026-02-13T03:38:10.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.342+0000 7f26bb29c6c0 1 --2- 10.20.193.96:0/1161670641 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f26b4115440 0x7f26b4175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:10.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.342+0000 7f26bb29c6c0 1 --2- 10.20.193.96:0/1161670641 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f26b410fc20 0x7f26b4114c60 unknown :-1 s=CLOSED pgs=453 gs=1 cs=0 l=1 c_cookie=7180560390405651365 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:10.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.342+0000 7f26bb29c6c0 1 --2- 10.20.193.96:0/1161670641 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f26b410f230 0x7f26b410f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:10.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.342+0000 7f26bb29c6c0 1 -- 10.20.193.96:0/1161670641 >> 10.20.193.96:0/1161670641 conn(0x7f26b40ecb30 msgr2=0x7f26b410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:10.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.342+0000 7f26bb29c6c0 1 -- 10.20.193.96:0/1161670641 shutdown_connections 2026-02-13T03:38:10.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.342+0000 7f26bb29c6c0 1 -- 10.20.193.96:0/1161670641 wait complete. 2026-02-13T03:38:10.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.342+0000 7f26bb29c6c0 1 Processor -- start 2026-02-13T03:38:10.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.342+0000 7f26bb29c6c0 1 -- start start 2026-02-13T03:38:10.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.342+0000 7f26bb29c6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f26b410f230 0x7f26b411d220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:10.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.342+0000 7f26bb29c6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f26b4115440 0x7f26b411d760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:10.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.342+0000 7f26bb29c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f26b4122b20 0x7f26b4122fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:10.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.342+0000 7f26bb29c6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f26b4123500 con 0x7f26b4122b20 2026-02-13T03:38:10.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.342+0000 7f26bb29c6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f26b4123670 con 0x7f26b410f230 2026-02-13T03:38:10.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.342+0000 7f26bb29c6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f26b4123830 con 0x7f26b4115440 2026-02-13T03:38:10.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.342+0000 7f26b98126c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f26b4122b20 0x7f26b4122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:10.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.342+0000 7f26b98126c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f26b4122b20 0x7f26b4122fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:56082/0 (socket says 10.20.193.96:56082) 2026-02-13T03:38:10.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.342+0000 7f26b98126c0 1 -- 10.20.193.96:0/3100287454 learned_addr learned my addr 10.20.193.96:0/3100287454 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:38:10.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.343+0000 7f26b90116c0 1 --2- 10.20.193.96:0/3100287454 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f26b410f230 0x7f26b411d220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:10.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.343+0000 7f26b88106c0 1 --2- 10.20.193.96:0/3100287454 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f26b4115440 0x7f26b411d760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:10.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.343+0000 7f26b98126c0 1 -- 10.20.193.96:0/3100287454 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f26b4115440 msgr2=0x7f26b411d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:10.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.343+0000 7f26b98126c0 1 --2- 10.20.193.96:0/3100287454 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f26b4115440 0x7f26b411d760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:10.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.343+0000 7f26b98126c0 1 -- 10.20.193.96:0/3100287454 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f26b410f230 msgr2=0x7f26b411d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:10.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.343+0000 7f26b98126c0 1 --2- 10.20.193.96:0/3100287454 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f26b410f230 0x7f26b411d220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:10.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.343+0000 7f26b98126c0 1 -- 10.20.193.96:0/3100287454 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a8009590 con 0x7f26b4122b20 2026-02-13T03:38:10.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.343+0000 7f26b98126c0 1 --2- 10.20.193.96:0/3100287454 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f26b4122b20 0x7f26b4122fc0 secure :-1 s=READY pgs=454 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b000c730 tx=0x7f26b000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:10.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.343+0000 7f26a27fc6c0 1 -- 10.20.193.96:0/3100287454 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26b0003c40 con 0x7f26b4122b20 2026-02-13T03:38:10.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.343+0000 7f26bb29c6c0 1 -- 10.20.193.96:0/3100287454 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26b4163cb0 con 0x7f26b4122b20 2026-02-13T03:38:10.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.343+0000 7f26a27fc6c0 1 -- 10.20.193.96:0/3100287454 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f26b000a070 con 0x7f26b4122b20 2026-02-13T03:38:10.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.343+0000 7f26a27fc6c0 1 -- 10.20.193.96:0/3100287454 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26b000dcf0 con 0x7f26b4122b20 2026-02-13T03:38:10.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.343+0000 7f26bb29c6c0 1 -- 10.20.193.96:0/3100287454 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b41641e0 con 0x7f26b4122b20 2026-02-13T03:38:10.351 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.343+0000 7f26bb29c6c0 1 -- 10.20.193.96:0/3100287454 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26b4110500 con 0x7f26b4122b20 2026-02-13T03:38:10.352 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.345+0000 7f26a27fc6c0 1 -- 10.20.193.96:0/3100287454 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f26b0005030 con 0x7f26b4122b20 2026-02-13T03:38:10.352 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.346+0000 7f26a27fc6c0 1 --2- 10.20.193.96:0/3100287454 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f26900b5600 0x7f26900d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:10.352 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.346+0000 7f26b90116c0 1 --2- 10.20.193.96:0/3100287454 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f26900b5600 0x7f26900d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:10.352 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.346+0000 7f26a27fc6c0 1 -- 10.20.193.96:0/3100287454 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f26b00e4ad0 con 0x7f26b4122b20 2026-02-13T03:38:10.352 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.346+0000 7f26a27fc6c0 1 -- 10.20.193.96:0/3100287454 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f26b00a7570 con 0x7f26b4122b20 2026-02-13T03:38:10.352 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.346+0000 7f26b90116c0 1 --2- 10.20.193.96:0/3100287454 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f26900b5600 0x7f26900d5ab0 secure :-1 s=READY pgs=291 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26a4005980 tx=0x7f26a4005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:10.424 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:10 trial096 ceph-mon[24671]: pgmap v308: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:38:10.463 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.459+0000 7f26bb29c6c0 1 -- 10.20.193.96:0/3100287454 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f26b411e370 con 0x7f26b4122b20 2026-02-13T03:38:10.463 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.459+0000 7f26a27fc6c0 1 -- 10.20.193.96:0/3100287454 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f26b00aa720 con 0x7f26b4122b20 2026-02-13T03:38:10.463 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:38:10.463 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:38:10.464 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.460+0000 7f26bb29c6c0 1 -- 10.20.193.96:0/3100287454 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f26900b5600 msgr2=0x7f26900d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:10.464 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.460+0000 7f26bb29c6c0 1 --2- 10.20.193.96:0/3100287454 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f26900b5600 0x7f26900d5ab0 secure :-1 s=READY pgs=291 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26a4005980 tx=0x7f26a4005910 comp rx=0 tx=0).stop 2026-02-13T03:38:10.464 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.460+0000 7f26bb29c6c0 1 -- 10.20.193.96:0/3100287454 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f26b4122b20 msgr2=0x7f26b4122fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:10.465 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.460+0000 7f26bb29c6c0 1 --2- 10.20.193.96:0/3100287454 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f26b4122b20 0x7f26b4122fc0 secure :-1 s=READY pgs=454 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b000c730 tx=0x7f26b000cc00 comp rx=0 tx=0).stop 2026-02-13T03:38:10.465 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.460+0000 7f26bb29c6c0 1 -- 10.20.193.96:0/3100287454 shutdown_connections 2026-02-13T03:38:10.465 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.460+0000 7f26bb29c6c0 1 --2- 10.20.193.96:0/3100287454 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f26900b5600 0x7f26900d5ab0 unknown :-1 s=CLOSED pgs=291 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:10.465 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.460+0000 7f26bb29c6c0 1 --2- 10.20.193.96:0/3100287454 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f26b4122b20 0x7f26b4122fc0 unknown :-1 s=CLOSED pgs=454 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:10.465 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.460+0000 7f26bb29c6c0 1 --2- 10.20.193.96:0/3100287454 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f26b4115440 0x7f26b411d760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:10.465 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.460+0000 7f26bb29c6c0 1 --2- 10.20.193.96:0/3100287454 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f26b410f230 0x7f26b411d220 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:10.465 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.460+0000 7f26bb29c6c0 1 -- 10.20.193.96:0/3100287454 >> 10.20.193.96:0/3100287454 conn(0x7f26b40ecb30 msgr2=0x7f26b410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:10.465 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.460+0000 7f26bb29c6c0 1 -- 10.20.193.96:0/3100287454 shutdown_connections 2026-02-13T03:38:10.465 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:10.460+0000 7f26bb29c6c0 1 -- 10.20.193.96:0/3100287454 wait complete. 2026-02-13T03:38:10.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:10 trial132 ceph-mon[26888]: pgmap v308: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:38:10.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:10 trial133 ceph-mon[26943]: pgmap v308: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:38:11.674 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:11 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3100287454' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:11.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:11 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3100287454' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:11.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:11 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3100287454' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:12.674 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:12 trial096 ceph-mon[24671]: pgmap v309: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:12.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:12 trial132 ceph-mon[26888]: pgmap v309: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:12.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:12 trial133 ceph-mon[26943]: pgmap v309: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:13.505 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:38:13.621 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:38:13.741 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c910a46c0 1 -- 10.20.193.96:0/1409636918 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1c8c10c480 msgr2=0x7f1c8c110a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:13.741 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c910a46c0 1 --2- 10.20.193.96:0/1409636918 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1c8c10c480 0x7f1c8c110a50 secure :-1 s=READY pgs=455 gs=1 cs=0 l=1 c_cookie=16830873189124339494 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c74009970 tx=0x7f1c7402ed20 comp rx=0 tx=0).stop 2026-02-13T03:38:13.742 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c910a46c0 1 -- 10.20.193.96:0/1409636918 shutdown_connections 2026-02-13T03:38:13.742 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c910a46c0 1 --2- 10.20.193.96:0/1409636918 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1c8c1110a0 0x7f1c8c111520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:13.742 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c910a46c0 1 --2- 10.20.193.96:0/1409636918 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1c8c10c480 0x7f1c8c110a50 unknown :-1 s=CLOSED pgs=455 gs=1 cs=0 l=1 c_cookie=16830873189124339494 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:13.742 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c910a46c0 1 --2- 10.20.193.96:0/1409636918 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1c8c10ba90 0x7f1c8c10be60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:13.742 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c910a46c0 1 -- 10.20.193.96:0/1409636918 >> 10.20.193.96:0/1409636918 conn(0x7f1c8c0e9700 msgr2=0x7f1c8c109b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:13.742 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c910a46c0 1 -- 10.20.193.96:0/1409636918 shutdown_connections 2026-02-13T03:38:13.742 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c910a46c0 1 -- 10.20.193.96:0/1409636918 wait complete. 2026-02-13T03:38:13.742 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c910a46c0 1 Processor -- start 2026-02-13T03:38:13.742 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c910a46c0 1 -- start start 2026-02-13T03:38:13.742 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c910a46c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1c8c10ba90 0x7f1c8c121a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:13.742 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c910a46c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1c8c10c480 0x7f1c8c121f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:13.743 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c910a46c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1c8c1110a0 0x7f1c8c127320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:13.743 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c910a46c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8c127970 con 0x7f1c8c10ba90 2026-02-13T03:38:13.743 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c910a46c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8c127ae0 con 0x7f1c8c1110a0 2026-02-13T03:38:13.743 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c910a46c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8c127ca0 con 0x7f1c8c10c480 2026-02-13T03:38:13.743 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c8ad766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1c8c10ba90 0x7f1c8c121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:13.743 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c8ad766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1c8c10ba90 0x7f1c8c121a20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:55800/0 (socket says 10.20.193.96:55800) 2026-02-13T03:38:13.743 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c8ad766c0 1 -- 10.20.193.96:0/578368467 learned_addr learned my addr 10.20.193.96:0/578368467 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:38:13.743 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c8b5776c0 1 --2- 10.20.193.96:0/578368467 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1c8c1110a0 0x7f1c8c127320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:13.743 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c8a5756c0 1 --2- 10.20.193.96:0/578368467 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1c8c10c480 0x7f1c8c121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:13.743 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c8ad766c0 1 -- 10.20.193.96:0/578368467 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1c8c10c480 msgr2=0x7f1c8c121f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:13.743 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c8ad766c0 1 --2- 10.20.193.96:0/578368467 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1c8c10c480 0x7f1c8c121f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:13.744 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c8ad766c0 1 -- 10.20.193.96:0/578368467 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1c8c1110a0 msgr2=0x7f1c8c127320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:13.744 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c8ad766c0 1 --2- 10.20.193.96:0/578368467 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1c8c1110a0 0x7f1c8c127320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:13.744 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c8ad766c0 1 -- 10.20.193.96:0/578368467 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c74009590 con 0x7f1c8c10ba90 2026-02-13T03:38:13.744 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.736+0000 7f1c8a5756c0 1 --2- 10.20.193.96:0/578368467 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1c8c10c480 0x7f1c8c121f60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:38:13.744 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.737+0000 7f1c8ad766c0 1 --2- 10.20.193.96:0/578368467 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1c8c10ba90 0x7f1c8c121a20 secure :-1 s=READY pgs=456 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c8000b710 tx=0x7f1c8000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:13.744 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.737+0000 7f1c6bfff6c0 1 -- 10.20.193.96:0/578368467 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c80004250 con 0x7f1c8c10ba90 2026-02-13T03:38:13.744 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.737+0000 7f1c910a46c0 1 -- 10.20.193.96:0/578368467 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c8c127f80 con 0x7f1c8c10ba90 2026-02-13T03:38:13.744 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.737+0000 7f1c6bfff6c0 1 -- 10.20.193.96:0/578368467 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f1c80002da0 con 0x7f1c8c10ba90 2026-02-13T03:38:13.744 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.737+0000 7f1c6bfff6c0 1 -- 10.20.193.96:0/578368467 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c8000ce30 con 0x7f1c8c10ba90 2026-02-13T03:38:13.744 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.737+0000 7f1c910a46c0 1 -- 10.20.193.96:0/578368467 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c8c168660 con 0x7f1c8c10ba90 2026-02-13T03:38:13.744 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.737+0000 7f1c910a46c0 1 -- 10.20.193.96:0/578368467 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c8c05fb90 con 0x7f1c8c10ba90 2026-02-13T03:38:13.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.739+0000 7f1c6bfff6c0 1 -- 10.20.193.96:0/578368467 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f1c800028c0 con 0x7f1c8c10ba90 2026-02-13T03:38:13.745 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.739+0000 7f1c6bfff6c0 1 --2- 10.20.193.96:0/578368467 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f1c600b5600 0x7f1c600d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:13.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.739+0000 7f1c8a5756c0 1 --2- 10.20.193.96:0/578368467 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f1c600b5600 0x7f1c600d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:13.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.739+0000 7f1c6bfff6c0 1 -- 10.20.193.96:0/578368467 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f1c800e3c40 con 0x7f1c8c10ba90 2026-02-13T03:38:13.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.739+0000 7f1c8a5756c0 1 --2- 10.20.193.96:0/578368467 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f1c600b5600 0x7f1c600d5ab0 secure :-1 s=READY pgs=292 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c740023e0 tx=0x7f1c74009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:13.746 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.739+0000 7f1c6bfff6c0 1 -- 10.20.193.96:0/578368467 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1c800aa100 con 0x7f1c8c10ba90 2026-02-13T03:38:13.857 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.854+0000 7f1c910a46c0 1 -- 10.20.193.96:0/578368467 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1c8c10be60 con 0x7f1c8c10ba90 2026-02-13T03:38:13.858 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.854+0000 7f1c6bfff6c0 1 -- 10.20.193.96:0/578368467 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f1c800ac170 con 0x7f1c8c10ba90 2026-02-13T03:38:13.858 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:38:13.858 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:38:13.859 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.855+0000 7f1c910a46c0 1 -- 10.20.193.96:0/578368467 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f1c600b5600 msgr2=0x7f1c600d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:13.859 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.855+0000 7f1c910a46c0 1 --2- 10.20.193.96:0/578368467 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f1c600b5600 0x7f1c600d5ab0 secure :-1 s=READY pgs=292 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c740023e0 tx=0x7f1c74009260 comp rx=0 tx=0).stop 2026-02-13T03:38:13.860 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.855+0000 7f1c910a46c0 1 -- 10.20.193.96:0/578368467 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1c8c10ba90 msgr2=0x7f1c8c121a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:13.860 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.855+0000 7f1c910a46c0 1 --2- 10.20.193.96:0/578368467 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1c8c10ba90 0x7f1c8c121a20 secure :-1 s=READY pgs=456 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c8000b710 tx=0x7f1c8000bbe0 comp rx=0 tx=0).stop 2026-02-13T03:38:13.860 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.855+0000 7f1c910a46c0 1 -- 10.20.193.96:0/578368467 shutdown_connections 2026-02-13T03:38:13.860 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.855+0000 7f1c910a46c0 1 --2- 10.20.193.96:0/578368467 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f1c600b5600 0x7f1c600d5ab0 unknown :-1 s=CLOSED pgs=292 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:13.860 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.855+0000 7f1c910a46c0 1 --2- 10.20.193.96:0/578368467 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1c8c1110a0 0x7f1c8c127320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:13.860 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.855+0000 7f1c910a46c0 1 --2- 10.20.193.96:0/578368467 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1c8c10c480 0x7f1c8c121f60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:13.860 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.855+0000 7f1c910a46c0 1 --2- 10.20.193.96:0/578368467 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1c8c10ba90 0x7f1c8c121a20 unknown :-1 s=CLOSED pgs=456 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:13.860 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.855+0000 7f1c910a46c0 1 -- 10.20.193.96:0/578368467 >> 10.20.193.96:0/578368467 conn(0x7f1c8c0e9700 msgr2=0x7f1c8c109ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:13.860 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.855+0000 7f1c910a46c0 1 -- 10.20.193.96:0/578368467 shutdown_connections 2026-02-13T03:38:13.860 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:13.855+0000 7f1c910a46c0 1 -- 10.20.193.96:0/578368467 wait complete. 2026-02-13T03:38:14.674 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:14 trial096 ceph-mon[24671]: pgmap v310: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:14.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:14 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/578368467' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:14.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:14 trial132 ceph-mon[26888]: pgmap v310: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:14.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:14 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/578368467' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:14.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:14 trial133 ceph-mon[26943]: pgmap v310: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:14.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:14 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/578368467' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:16.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:16 trial096 ceph-mon[24671]: pgmap v311: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:16.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:16 trial132 ceph-mon[26888]: pgmap v311: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:16.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:16 trial133 ceph-mon[26943]: pgmap v311: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:16.899 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:38:17.016 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:38:17.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.133+0000 7f71667dc6c0 1 -- 10.20.193.96:0/3871680970 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f716010f230 msgr2=0x7f716010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:17.138 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.133+0000 7f71667dc6c0 1 --2- 10.20.193.96:0/3871680970 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f716010f230 0x7f716010f600 secure :-1 s=READY pgs=457 gs=1 cs=0 l=1 c_cookie=12427109779489407164 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f714c0099a0 tx=0x7f714c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:38:17.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.133+0000 7f71667dc6c0 1 -- 10.20.193.96:0/3871680970 shutdown_connections 2026-02-13T03:38:17.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.133+0000 7f71667dc6c0 1 --2- 10.20.193.96:0/3871680970 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7160115440 0x7f7160175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:17.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.133+0000 7f71667dc6c0 1 --2- 10.20.193.96:0/3871680970 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f716010fc20 0x7f7160114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:17.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.133+0000 7f71667dc6c0 1 --2- 10.20.193.96:0/3871680970 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f716010f230 0x7f716010f600 unknown :-1 s=CLOSED pgs=457 gs=1 cs=0 l=1 c_cookie=12427109779489407164 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:17.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.133+0000 7f71667dc6c0 1 -- 10.20.193.96:0/3871680970 >> 10.20.193.96:0/3871680970 conn(0x7f71600ecb30 msgr2=0x7f716010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:17.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.133+0000 7f71667dc6c0 1 -- 10.20.193.96:0/3871680970 shutdown_connections 2026-02-13T03:38:17.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.133+0000 7f71667dc6c0 1 -- 10.20.193.96:0/3871680970 wait complete. 2026-02-13T03:38:17.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f71667dc6c0 1 Processor -- start 2026-02-13T03:38:17.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f71667dc6c0 1 -- start start 2026-02-13T03:38:17.139 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f71667dc6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f716010f230 0x7f716011d150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:17.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f71667dc6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7160115440 0x7f716011d690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:17.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f71667dc6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7160122a50 0x7f7160122ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:17.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f71667dc6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7160123460 con 0x7f716010f230 2026-02-13T03:38:17.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f71667dc6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f71601235d0 con 0x7f7160115440 2026-02-13T03:38:17.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f71667dc6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7160123790 con 0x7f7160122a50 2026-02-13T03:38:17.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f715ffff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f716010f230 0x7f716011d150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:17.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f715ffff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f716010f230 0x7f716011d150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:55822/0 (socket says 10.20.193.96:55822) 2026-02-13T03:38:17.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f715ffff6c0 1 -- 10.20.193.96:0/1039363879 learned_addr learned my addr 10.20.193.96:0/1039363879 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:38:17.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f715ffff6c0 1 -- 10.20.193.96:0/1039363879 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7160122a50 msgr2=0x7f7160122ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:17.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f7164d526c0 1 --2- 10.20.193.96:0/1039363879 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7160122a50 0x7f7160122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:17.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f715ffff6c0 1 --2- 10.20.193.96:0/1039363879 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7160122a50 0x7f7160122ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:17.140 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f715ffff6c0 1 -- 10.20.193.96:0/1039363879 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7160115440 msgr2=0x7f716011d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:17.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f715f7fe6c0 1 --2- 10.20.193.96:0/1039363879 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7160115440 0x7f716011d690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:17.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f715ffff6c0 1 --2- 10.20.193.96:0/1039363879 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7160115440 0x7f716011d690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:17.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f715ffff6c0 1 -- 10.20.193.96:0/1039363879 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f714c009590 con 0x7f716010f230 2026-02-13T03:38:17.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f7164d526c0 1 --2- 10.20.193.96:0/1039363879 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7160122a50 0x7f7160122ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:38:17.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f715f7fe6c0 1 --2- 10.20.193.96:0/1039363879 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7160115440 0x7f716011d690 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:38:17.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f715ffff6c0 1 --2- 10.20.193.96:0/1039363879 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f716010f230 0x7f716011d150 secure :-1 s=READY pgs=458 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f714c0098c0 tx=0x7f714c0047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:17.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f715d7fa6c0 1 -- 10.20.193.96:0/1039363879 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f714c002ae0 con 0x7f716010f230 2026-02-13T03:38:17.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f715d7fa6c0 1 -- 10.20.193.96:0/1039363879 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f714c002c40 con 0x7f716010f230 2026-02-13T03:38:17.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f71667dc6c0 1 -- 10.20.193.96:0/1039363879 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7160163be0 con 0x7f716010f230 2026-02-13T03:38:17.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f715d7fa6c0 1 -- 10.20.193.96:0/1039363879 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f714c0372f0 con 0x7f716010f230 2026-02-13T03:38:17.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.134+0000 7f71667dc6c0 1 -- 10.20.193.96:0/1039363879 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7160164010 con 0x7f716010f230 2026-02-13T03:38:17.141 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.135+0000 7f71667dc6c0 1 -- 10.20.193.96:0/1039363879 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7160110500 con 0x7f716010f230 2026-02-13T03:38:17.142 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.136+0000 7f715d7fa6c0 1 -- 10.20.193.96:0/1039363879 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f714c007960 con 0x7f716010f230 2026-02-13T03:38:17.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.137+0000 7f715d7fa6c0 1 --2- 10.20.193.96:0/1039363879 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f71340b5600 0x7f71340d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:17.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.137+0000 7f715f7fe6c0 1 --2- 10.20.193.96:0/1039363879 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f71340b5600 0x7f71340d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:17.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.137+0000 7f715d7fa6c0 1 -- 10.20.193.96:0/1039363879 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f714c107e50 con 0x7f716010f230 2026-02-13T03:38:17.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.137+0000 7f715f7fe6c0 1 --2- 10.20.193.96:0/1039363879 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f71340b5600 0x7f71340d5ab0 secure :-1 s=READY pgs=293 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7160123ae0 tx=0x7f7150005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:17.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.138+0000 7f715d7fa6c0 1 -- 10.20.193.96:0/1039363879 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f714c0ca8b0 con 0x7f716010f230 2026-02-13T03:38:17.257 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.254+0000 7f71667dc6c0 1 -- 10.20.193.96:0/1039363879 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f716010f600 con 0x7f716010f230 2026-02-13T03:38:17.257 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.254+0000 7f715d7fa6c0 1 -- 10.20.193.96:0/1039363879 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f714c002db0 con 0x7f716010f230 2026-02-13T03:38:17.257 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:38:17.257 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:38:17.258 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.255+0000 7f71667dc6c0 1 -- 10.20.193.96:0/1039363879 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f71340b5600 msgr2=0x7f71340d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:17.258 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.255+0000 7f71667dc6c0 1 --2- 10.20.193.96:0/1039363879 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f71340b5600 0x7f71340d5ab0 secure :-1 s=READY pgs=293 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7160123ae0 tx=0x7f7150005f10 comp rx=0 tx=0).stop 2026-02-13T03:38:17.258 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.255+0000 7f71667dc6c0 1 -- 10.20.193.96:0/1039363879 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f716010f230 msgr2=0x7f716011d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:17.259 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.255+0000 7f71667dc6c0 1 --2- 10.20.193.96:0/1039363879 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f716010f230 0x7f716011d150 secure :-1 s=READY pgs=458 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f714c0098c0 tx=0x7f714c0047f0 comp rx=0 tx=0).stop 2026-02-13T03:38:17.259 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.255+0000 7f71667dc6c0 1 -- 10.20.193.96:0/1039363879 shutdown_connections 2026-02-13T03:38:17.259 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.255+0000 7f71667dc6c0 1 --2- 10.20.193.96:0/1039363879 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f71340b5600 0x7f71340d5ab0 unknown :-1 s=CLOSED pgs=293 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:17.259 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.255+0000 7f71667dc6c0 1 --2- 10.20.193.96:0/1039363879 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7160122a50 0x7f7160122ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:17.259 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.255+0000 7f71667dc6c0 1 --2- 10.20.193.96:0/1039363879 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7160115440 0x7f716011d690 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:17.259 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.255+0000 7f71667dc6c0 1 --2- 10.20.193.96:0/1039363879 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f716010f230 0x7f716011d150 unknown :-1 s=CLOSED pgs=458 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:17.259 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.255+0000 7f71667dc6c0 1 -- 10.20.193.96:0/1039363879 >> 10.20.193.96:0/1039363879 conn(0x7f71600ecb30 msgr2=0x7f716010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:17.259 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.255+0000 7f71667dc6c0 1 -- 10.20.193.96:0/1039363879 shutdown_connections 2026-02-13T03:38:17.259 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:17.255+0000 7f71667dc6c0 1 -- 10.20.193.96:0/1039363879 wait complete. 2026-02-13T03:38:17.674 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:17 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1039363879' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:17.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:17 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:38:17.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:17 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1039363879' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:17.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:17 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:38:17.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:17 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1039363879' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:17.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:17 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:38:18.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:18 trial096 ceph-mon[24671]: pgmap v312: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:18.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:38:18.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:38:18.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:38:18.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:18 trial096 ceph-mon[24671]: pgmap v313: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T03:38:18.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:38:18.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:38:18.675 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:38:18.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:18 trial132 ceph-mon[26888]: pgmap v312: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:18.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:38:18.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:38:18.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:38:18.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:18 trial132 ceph-mon[26888]: pgmap v313: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T03:38:18.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:38:18.732 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:38:18.733 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:38:18.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:18 trial133 ceph-mon[26943]: pgmap v312: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:18.763 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:38:18.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:38:18.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:38:18.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:18 trial133 ceph-mon[26943]: pgmap v313: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T03:38:18.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:38:18.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:38:18.764 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:38:19.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:19 trial132 ceph-mon[26888]: pgmap v314: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:38:20.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:19 trial133 ceph-mon[26943]: pgmap v314: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:38:20.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:19 trial096 ceph-mon[24671]: pgmap v314: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:38:20.298 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:38:20.421 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:38:20.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.542+0000 7efc9aa706c0 1 -- 10.20.193.96:0/3828185541 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efc9410f230 msgr2=0x7efc9410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:20.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.542+0000 7efc9aa706c0 1 --2- 10.20.193.96:0/3828185541 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efc9410f230 0x7efc9410f600 secure :-1 s=READY pgs=459 gs=1 cs=0 l=1 c_cookie=2947100271482927698 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc800099a0 tx=0x7efc8002ed20 comp rx=0 tx=0).stop 2026-02-13T03:38:20.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.542+0000 7efc9aa706c0 1 -- 10.20.193.96:0/3828185541 shutdown_connections 2026-02-13T03:38:20.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.542+0000 7efc9aa706c0 1 --2- 10.20.193.96:0/3828185541 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efc94115440 0x7efc94175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:20.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.542+0000 7efc9aa706c0 1 --2- 10.20.193.96:0/3828185541 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efc9410fc20 0x7efc94114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:20.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.542+0000 7efc9aa706c0 1 --2- 10.20.193.96:0/3828185541 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efc9410f230 0x7efc9410f600 unknown :-1 s=CLOSED pgs=459 gs=1 cs=0 l=1 c_cookie=2947100271482927698 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:20.548 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.542+0000 7efc9aa706c0 1 -- 10.20.193.96:0/3828185541 >> 10.20.193.96:0/3828185541 conn(0x7efc940ecb30 msgr2=0x7efc9410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:20.548 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.542+0000 7efc9aa706c0 1 -- 10.20.193.96:0/3828185541 shutdown_connections 2026-02-13T03:38:20.548 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.542+0000 7efc9aa706c0 1 -- 10.20.193.96:0/3828185541 wait complete. 2026-02-13T03:38:20.548 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc9aa706c0 1 Processor -- start 2026-02-13T03:38:20.548 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc9aa706c0 1 -- start start 2026-02-13T03:38:20.548 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc9aa706c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efc9410f230 0x7efc9411b4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:20.548 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc9aa706c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efc94115440 0x7efc9411ba30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:20.548 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc9aa706c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efc94120df0 0x7efc94121290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:20.548 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc9aa706c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7efc94121800 con 0x7efc94115440 2026-02-13T03:38:20.548 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc9aa706c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7efc94121970 con 0x7efc9410f230 2026-02-13T03:38:20.548 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc9aa706c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7efc94121b30 con 0x7efc94120df0 2026-02-13T03:38:20.548 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc937fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efc94115440 0x7efc9411ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:20.549 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc937fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efc94115440 0x7efc9411ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:55846/0 (socket says 10.20.193.96:55846) 2026-02-13T03:38:20.549 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc937fe6c0 1 -- 10.20.193.96:0/2329654706 learned_addr learned my addr 10.20.193.96:0/2329654706 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:38:20.549 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc93fff6c0 1 --2- 10.20.193.96:0/2329654706 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efc9410f230 0x7efc9411b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:20.549 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc98fe26c0 1 --2- 10.20.193.96:0/2329654706 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efc94120df0 0x7efc94121290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:20.549 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc937fe6c0 1 -- 10.20.193.96:0/2329654706 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efc94120df0 msgr2=0x7efc94121290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:20.549 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc937fe6c0 1 --2- 10.20.193.96:0/2329654706 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efc94120df0 0x7efc94121290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:20.549 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc937fe6c0 1 -- 10.20.193.96:0/2329654706 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efc9410f230 msgr2=0x7efc9411b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:20.549 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc937fe6c0 1 --2- 10.20.193.96:0/2329654706 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efc9410f230 0x7efc9411b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:20.549 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc937fe6c0 1 -- 10.20.193.96:0/2329654706 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc80009590 con 0x7efc94115440 2026-02-13T03:38:20.549 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc93fff6c0 1 --2- 10.20.193.96:0/2329654706 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efc9410f230 0x7efc9411b4f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:38:20.549 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc937fe6c0 1 --2- 10.20.193.96:0/2329654706 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efc94115440 0x7efc9411ba30 secure :-1 s=READY pgs=460 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc84005dc0 tx=0x7efc8400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:20.549 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc917fa6c0 1 -- 10.20.193.96:0/2329654706 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc84004250 con 0x7efc94115440 2026-02-13T03:38:20.550 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc917fa6c0 1 -- 10.20.193.96:0/2329654706 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7efc84009070 con 0x7efc94115440 2026-02-13T03:38:20.550 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc9aa706c0 1 -- 10.20.193.96:0/2329654706 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc94161fe0 con 0x7efc94115440 2026-02-13T03:38:20.550 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc917fa6c0 1 -- 10.20.193.96:0/2329654706 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc8400cdb0 con 0x7efc94115440 2026-02-13T03:38:20.550 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.543+0000 7efc9aa706c0 1 -- 10.20.193.96:0/2329654706 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc941624c0 con 0x7efc94115440 2026-02-13T03:38:20.550 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.544+0000 7efc9aa706c0 1 -- 10.20.193.96:0/2329654706 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc94110500 con 0x7efc94115440 2026-02-13T03:38:20.551 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.545+0000 7efc917fa6c0 1 -- 10.20.193.96:0/2329654706 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7efc840028c0 con 0x7efc94115440 2026-02-13T03:38:20.551 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.545+0000 7efc917fa6c0 1 --2- 10.20.193.96:0/2329654706 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efc680b5680 0x7efc680d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:20.551 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.545+0000 7efc917fa6c0 1 -- 10.20.193.96:0/2329654706 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7efc840e3a60 con 0x7efc94115440 2026-02-13T03:38:20.551 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.545+0000 7efc93fff6c0 1 --2- 10.20.193.96:0/2329654706 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efc680b5680 0x7efc680d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:20.551 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.546+0000 7efc93fff6c0 1 --2- 10.20.193.96:0/2329654706 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efc680b5680 0x7efc680d5b30 secure :-1 s=READY pgs=294 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc800023e0 tx=0x7efc800092a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:20.551 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.546+0000 7efc917fa6c0 1 -- 10.20.193.96:0/2329654706 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7efc840a64c0 con 0x7efc94115440 2026-02-13T03:38:20.662 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.659+0000 7efc9aa706c0 1 -- 10.20.193.96:0/2329654706 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7efc9410f600 con 0x7efc94115440 2026-02-13T03:38:20.663 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.660+0000 7efc917fa6c0 1 -- 10.20.193.96:0/2329654706 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7efc840a9670 con 0x7efc94115440 2026-02-13T03:38:20.663 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:38:20.663 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:38:20.664 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.661+0000 7efc9aa706c0 1 -- 10.20.193.96:0/2329654706 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efc680b5680 msgr2=0x7efc680d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:20.664 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.661+0000 7efc9aa706c0 1 --2- 10.20.193.96:0/2329654706 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efc680b5680 0x7efc680d5b30 secure :-1 s=READY pgs=294 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc800023e0 tx=0x7efc800092a0 comp rx=0 tx=0).stop 2026-02-13T03:38:20.664 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.661+0000 7efc9aa706c0 1 -- 10.20.193.96:0/2329654706 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efc94115440 msgr2=0x7efc9411ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:20.664 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.661+0000 7efc9aa706c0 1 --2- 10.20.193.96:0/2329654706 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efc94115440 0x7efc9411ba30 secure :-1 s=READY pgs=460 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc84005dc0 tx=0x7efc8400bbb0 comp rx=0 tx=0).stop 2026-02-13T03:38:20.665 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.661+0000 7efc9aa706c0 1 -- 10.20.193.96:0/2329654706 shutdown_connections 2026-02-13T03:38:20.665 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.661+0000 7efc9aa706c0 1 --2- 10.20.193.96:0/2329654706 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efc680b5680 0x7efc680d5b30 unknown :-1 s=CLOSED pgs=294 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:20.665 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.661+0000 7efc9aa706c0 1 --2- 10.20.193.96:0/2329654706 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efc94120df0 0x7efc94121290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:20.665 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.661+0000 7efc9aa706c0 1 --2- 10.20.193.96:0/2329654706 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efc94115440 0x7efc9411ba30 unknown :-1 s=CLOSED pgs=460 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:20.665 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.661+0000 7efc9aa706c0 1 --2- 10.20.193.96:0/2329654706 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efc9410f230 0x7efc9411b4f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:20.665 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.661+0000 7efc9aa706c0 1 -- 10.20.193.96:0/2329654706 >> 10.20.193.96:0/2329654706 conn(0x7efc940ecb30 msgr2=0x7efc9410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:20.665 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.661+0000 7efc9aa706c0 1 -- 10.20.193.96:0/2329654706 shutdown_connections 2026-02-13T03:38:20.665 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:20.661+0000 7efc9aa706c0 1 -- 10.20.193.96:0/2329654706 wait complete. 2026-02-13T03:38:20.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:20 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2329654706' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:20.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:20 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2329654706' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:21.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:20 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2329654706' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:21.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:21 trial132 ceph-mon[26888]: pgmap v315: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:38:22.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:21 trial133 ceph-mon[26943]: pgmap v315: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:38:22.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:21 trial096 ceph-mon[24671]: pgmap v315: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:38:23.707 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:38:23.826 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:38:23.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.941+0000 7f3d40bf96c0 1 -- 10.20.193.96:0/2892298146 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3d3c10fbf0 msgr2=0x7f3d3c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:23.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.941+0000 7f3d40bf96c0 1 --2- 10.20.193.96:0/2892298146 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3d3c10fbf0 0x7f3d3c114c30 secure :-1 s=READY pgs=461 gs=1 cs=0 l=1 c_cookie=14520641800315895462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d240099a0 tx=0x7f3d2402ed20 comp rx=0 tx=0).stop 2026-02-13T03:38:23.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.942+0000 7f3d40bf96c0 1 -- 10.20.193.96:0/2892298146 shutdown_connections 2026-02-13T03:38:23.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.942+0000 7f3d40bf96c0 1 --2- 10.20.193.96:0/2892298146 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3d3c115410 0x7f3d3c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:23.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.942+0000 7f3d40bf96c0 1 --2- 10.20.193.96:0/2892298146 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3d3c10fbf0 0x7f3d3c114c30 unknown :-1 s=CLOSED pgs=461 gs=1 cs=0 l=1 c_cookie=14520641800315895462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:23.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.942+0000 7f3d40bf96c0 1 --2- 10.20.193.96:0/2892298146 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3d3c10f200 0x7f3d3c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:23.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.942+0000 7f3d40bf96c0 1 -- 10.20.193.96:0/2892298146 >> 10.20.193.96:0/2892298146 conn(0x7f3d3c0ecb00 msgr2=0x7f3d3c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:23.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.942+0000 7f3d40bf96c0 1 -- 10.20.193.96:0/2892298146 shutdown_connections 2026-02-13T03:38:23.945 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.942+0000 7f3d40bf96c0 1 -- 10.20.193.96:0/2892298146 wait complete. 2026-02-13T03:38:23.946 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:23 trial096 ceph-mon[24671]: pgmap v316: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:38:23.948 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.942+0000 7f3d40bf96c0 1 Processor -- start 2026-02-13T03:38:23.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.942+0000 7f3d40bf96c0 1 -- start start 2026-02-13T03:38:23.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.942+0000 7f3d40bf96c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3d3c10f200 0x7f3d3c0f4cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:23.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.942+0000 7f3d40bf96c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3d3c115410 0x7f3d3c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:23.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.942+0000 7f3d40bf96c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3d3c0f5300 0x7f3d3c0fa580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:23.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.942+0000 7f3d40bf96c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c0f59f0 con 0x7f3d3c0f5300 2026-02-13T03:38:23.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.942+0000 7f3d40bf96c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c0faac0 con 0x7f3d3c10f200 2026-02-13T03:38:23.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.942+0000 7f3d40bf96c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c0fac80 con 0x7f3d3c115410 2026-02-13T03:38:23.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.942+0000 7f3d3ad766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3d3c0f5300 0x7f3d3c0fa580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:23.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.942+0000 7f3d3ad766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3d3c0f5300 0x7f3d3c0fa580 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:35510/0 (socket says 10.20.193.96:35510) 2026-02-13T03:38:23.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.942+0000 7f3d3ad766c0 1 -- 10.20.193.96:0/2010847926 learned_addr learned my addr 10.20.193.96:0/2010847926 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:38:23.949 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.942+0000 7f3d3a5756c0 1 --2- 10.20.193.96:0/2010847926 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3d3c10f200 0x7f3d3c0f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:23.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.942+0000 7f3d39d746c0 1 --2- 10.20.193.96:0/2010847926 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3d3c115410 0x7f3d3c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:23.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.942+0000 7f3d3ad766c0 1 -- 10.20.193.96:0/2010847926 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3d3c115410 msgr2=0x7f3d3c175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:23.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.942+0000 7f3d3ad766c0 1 --2- 10.20.193.96:0/2010847926 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3d3c115410 0x7f3d3c175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:23.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.943+0000 7f3d3ad766c0 1 -- 10.20.193.96:0/2010847926 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3d3c10f200 msgr2=0x7f3d3c0f4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:23.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.943+0000 7f3d3ad766c0 1 --2- 10.20.193.96:0/2010847926 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3d3c10f200 0x7f3d3c0f4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:23.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.943+0000 7f3d3ad766c0 1 -- 10.20.193.96:0/2010847926 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d24009590 con 0x7f3d3c0f5300 2026-02-13T03:38:23.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.943+0000 7f3d3ad766c0 1 --2- 10.20.193.96:0/2010847926 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3d3c0f5300 0x7f3d3c0fa580 secure :-1 s=READY pgs=462 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d2c006ea0 tx=0x7f3d2c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:23.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.943+0000 7f3d237fe6c0 1 -- 10.20.193.96:0/2010847926 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3d2c003a30 con 0x7f3d3c0f5300 2026-02-13T03:38:23.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.943+0000 7f3d237fe6c0 1 -- 10.20.193.96:0/2010847926 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f3d2c005510 con 0x7f3d3c0f5300 2026-02-13T03:38:23.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.943+0000 7f3d40bf96c0 1 -- 10.20.193.96:0/2010847926 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d3c0faf60 con 0x7f3d3c0f5300 2026-02-13T03:38:23.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.943+0000 7f3d237fe6c0 1 -- 10.20.193.96:0/2010847926 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3d2c00dd70 con 0x7f3d3c0f5300 2026-02-13T03:38:23.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.943+0000 7f3d40bf96c0 1 -- 10.20.193.96:0/2010847926 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d3c0fb6f0 con 0x7f3d3c0f5300 2026-02-13T03:38:23.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.943+0000 7f3d40bf96c0 1 -- 10.20.193.96:0/2010847926 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d3c0fb440 con 0x7f3d3c0f5300 2026-02-13T03:38:23.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.944+0000 7f3d237fe6c0 1 -- 10.20.193.96:0/2010847926 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f3d2c003b90 con 0x7f3d3c0f5300 2026-02-13T03:38:23.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.945+0000 7f3d237fe6c0 1 --2- 10.20.193.96:0/2010847926 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f3d140b5600 0x7f3d140d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:23.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.945+0000 7f3d237fe6c0 1 -- 10.20.193.96:0/2010847926 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f3d2c0e49d0 con 0x7f3d3c0f5300 2026-02-13T03:38:23.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.945+0000 7f3d3a5756c0 1 --2- 10.20.193.96:0/2010847926 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f3d140b5600 0x7f3d140d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:23.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.945+0000 7f3d3a5756c0 1 --2- 10.20.193.96:0/2010847926 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f3d140b5600 0x7f3d140d5ab0 secure :-1 s=READY pgs=295 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d30004750 tx=0x7f3d30009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:23.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:23.945+0000 7f3d237fe6c0 1 -- 10.20.193.96:0/2010847926 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3d2c0a7430 con 0x7f3d3c0f5300 2026-02-13T03:38:23.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:23 trial132 ceph-mon[26888]: pgmap v316: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:38:24.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:23 trial133 ceph-mon[26943]: pgmap v316: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:38:24.061 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:24.058+0000 7f3d40bf96c0 1 -- 10.20.193.96:0/2010847926 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3d3c1104d0 con 0x7f3d3c0f5300 2026-02-13T03:38:24.061 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:24.059+0000 7f3d237fe6c0 1 -- 10.20.193.96:0/2010847926 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f3d2c0aa5e0 con 0x7f3d3c0f5300 2026-02-13T03:38:24.062 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:38:24.062 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:38:24.062 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:24.060+0000 7f3d40bf96c0 1 -- 10.20.193.96:0/2010847926 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f3d140b5600 msgr2=0x7f3d140d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:24.063 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:24.060+0000 7f3d40bf96c0 1 --2- 10.20.193.96:0/2010847926 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f3d140b5600 0x7f3d140d5ab0 secure :-1 s=READY pgs=295 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d30004750 tx=0x7f3d30009390 comp rx=0 tx=0).stop 2026-02-13T03:38:24.063 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:24.060+0000 7f3d40bf96c0 1 -- 10.20.193.96:0/2010847926 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3d3c0f5300 msgr2=0x7f3d3c0fa580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:24.063 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:24.060+0000 7f3d40bf96c0 1 --2- 10.20.193.96:0/2010847926 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3d3c0f5300 0x7f3d3c0fa580 secure :-1 s=READY pgs=462 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d2c006ea0 tx=0x7f3d2c00cca0 comp rx=0 tx=0).stop 2026-02-13T03:38:24.063 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:24.060+0000 7f3d40bf96c0 1 -- 10.20.193.96:0/2010847926 shutdown_connections 2026-02-13T03:38:24.063 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:24.060+0000 7f3d40bf96c0 1 --2- 10.20.193.96:0/2010847926 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f3d140b5600 0x7f3d140d5ab0 unknown :-1 s=CLOSED pgs=295 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:24.063 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:24.060+0000 7f3d40bf96c0 1 --2- 10.20.193.96:0/2010847926 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3d3c0f5300 0x7f3d3c0fa580 unknown :-1 s=CLOSED pgs=462 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:24.063 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:24.060+0000 7f3d40bf96c0 1 --2- 10.20.193.96:0/2010847926 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3d3c115410 0x7f3d3c175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:24.063 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:24.060+0000 7f3d40bf96c0 1 --2- 10.20.193.96:0/2010847926 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3d3c10f200 0x7f3d3c0f4cd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:24.063 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:24.060+0000 7f3d40bf96c0 1 -- 10.20.193.96:0/2010847926 >> 10.20.193.96:0/2010847926 conn(0x7f3d3c0ecb00 msgr2=0x7f3d3c10d940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:24.063 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:24.060+0000 7f3d40bf96c0 1 -- 10.20.193.96:0/2010847926 shutdown_connections 2026-02-13T03:38:24.063 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:24.060+0000 7f3d40bf96c0 1 -- 10.20.193.96:0/2010847926 wait complete. 2026-02-13T03:38:24.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:24 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2010847926' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:25.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:24 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2010847926' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:25.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:24 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2010847926' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:25.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:25 trial132 ceph-mon[26888]: pgmap v317: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s rd, 3 op/s 2026-02-13T03:38:26.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:25 trial133 ceph-mon[26943]: pgmap v317: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s rd, 3 op/s 2026-02-13T03:38:26.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:25 trial096 ceph-mon[24671]: pgmap v317: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s rd, 3 op/s 2026-02-13T03:38:27.103 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:38:27.221 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:38:27.345 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.341+0000 7ff1e4cc86c0 1 -- 10.20.193.96:0/2177777919 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff1e010f200 msgr2=0x7ff1e010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:27.345 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.341+0000 7ff1e4cc86c0 1 --2- 10.20.193.96:0/2177777919 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff1e010f200 0x7ff1e010f5d0 secure :-1 s=READY pgs=463 gs=1 cs=0 l=1 c_cookie=10735365934354424418 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1d40099a0 tx=0x7ff1d402ed20 comp rx=0 tx=0).stop 2026-02-13T03:38:27.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.341+0000 7ff1e4cc86c0 1 -- 10.20.193.96:0/2177777919 shutdown_connections 2026-02-13T03:38:27.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.341+0000 7ff1e4cc86c0 1 --2- 10.20.193.96:0/2177777919 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff1e0115410 0x7ff1e0175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:27.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.341+0000 7ff1e4cc86c0 1 --2- 10.20.193.96:0/2177777919 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff1e010fbf0 0x7ff1e0114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:27.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.341+0000 7ff1e4cc86c0 1 --2- 10.20.193.96:0/2177777919 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff1e010f200 0x7ff1e010f5d0 unknown :-1 s=CLOSED pgs=463 gs=1 cs=0 l=1 c_cookie=10735365934354424418 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:27.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.341+0000 7ff1e4cc86c0 1 -- 10.20.193.96:0/2177777919 >> 10.20.193.96:0/2177777919 conn(0x7ff1e00ecb00 msgr2=0x7ff1e010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:27.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.341+0000 7ff1e4cc86c0 1 -- 10.20.193.96:0/2177777919 shutdown_connections 2026-02-13T03:38:27.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.341+0000 7ff1e4cc86c0 1 -- 10.20.193.96:0/2177777919 wait complete. 2026-02-13T03:38:27.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.341+0000 7ff1e4cc86c0 1 Processor -- start 2026-02-13T03:38:27.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.341+0000 7ff1e4cc86c0 1 -- start start 2026-02-13T03:38:27.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.341+0000 7ff1e4cc86c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff1e010f200 0x7ff1e011d1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:27.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.341+0000 7ff1e4cc86c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff1e0115410 0x7ff1e011d6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:27.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.341+0000 7ff1e4cc86c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff1e0122ab0 0x7ff1e0122f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:27.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.341+0000 7ff1e4cc86c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e01234c0 con 0x7ff1e0122ab0 2026-02-13T03:38:27.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.341+0000 7ff1e4cc86c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e0123630 con 0x7ff1e010f200 2026-02-13T03:38:27.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.341+0000 7ff1e4cc86c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e01237f0 con 0x7ff1e0115410 2026-02-13T03:38:27.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.341+0000 7ff1ded766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff1e0122ab0 0x7ff1e0122f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:27.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.341+0000 7ff1ded766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff1e0122ab0 0x7ff1e0122f50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:35518/0 (socket says 10.20.193.96:35518) 2026-02-13T03:38:27.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.341+0000 7ff1ded766c0 1 -- 10.20.193.96:0/3434193049 learned_addr learned my addr 10.20.193.96:0/3434193049 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:38:27.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.341+0000 7ff1de5756c0 1 --2- 10.20.193.96:0/3434193049 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff1e010f200 0x7ff1e011d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:27.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.341+0000 7ff1ddd746c0 1 --2- 10.20.193.96:0/3434193049 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff1e0115410 0x7ff1e011d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:27.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.342+0000 7ff1ded766c0 1 -- 10.20.193.96:0/3434193049 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff1e0115410 msgr2=0x7ff1e011d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:27.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.342+0000 7ff1ded766c0 1 --2- 10.20.193.96:0/3434193049 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff1e0115410 0x7ff1e011d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:27.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.342+0000 7ff1ded766c0 1 -- 10.20.193.96:0/3434193049 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff1e010f200 msgr2=0x7ff1e011d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:27.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.342+0000 7ff1ded766c0 1 --2- 10.20.193.96:0/3434193049 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff1e010f200 0x7ff1e011d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:27.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.342+0000 7ff1ded766c0 1 -- 10.20.193.96:0/3434193049 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d4009590 con 0x7ff1e0122ab0 2026-02-13T03:38:27.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.342+0000 7ff1ded766c0 1 --2- 10.20.193.96:0/3434193049 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff1e0122ab0 0x7ff1e0122f50 secure :-1 s=READY pgs=464 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1d0006ea0 tx=0x7ff1d000ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:27.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.342+0000 7ff1c77fe6c0 1 -- 10.20.193.96:0/3434193049 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1d0003c40 con 0x7ff1e0122ab0 2026-02-13T03:38:27.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.342+0000 7ff1c77fe6c0 1 -- 10.20.193.96:0/3434193049 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7ff1d0003da0 con 0x7ff1e0122ab0 2026-02-13T03:38:27.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.342+0000 7ff1e4cc86c0 1 -- 10.20.193.96:0/3434193049 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e0163ca0 con 0x7ff1e0122ab0 2026-02-13T03:38:27.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.342+0000 7ff1c77fe6c0 1 -- 10.20.193.96:0/3434193049 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1d00081c0 con 0x7ff1e0122ab0 2026-02-13T03:38:27.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.342+0000 7ff1e4cc86c0 1 -- 10.20.193.96:0/3434193049 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e0164130 con 0x7ff1e0122ab0 2026-02-13T03:38:27.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.342+0000 7ff1e4cc86c0 1 -- 10.20.193.96:0/3434193049 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1e01104d0 con 0x7ff1e0122ab0 2026-02-13T03:38:27.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.344+0000 7ff1c77fe6c0 1 -- 10.20.193.96:0/3434193049 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7ff1d0005860 con 0x7ff1e0122ab0 2026-02-13T03:38:27.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.344+0000 7ff1c77fe6c0 1 --2- 10.20.193.96:0/3434193049 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff1b80b5680 0x7ff1b80d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:27.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.344+0000 7ff1de5756c0 1 --2- 10.20.193.96:0/3434193049 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff1b80b5680 0x7ff1b80d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:27.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.344+0000 7ff1c77fe6c0 1 -- 10.20.193.96:0/3434193049 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7ff1d00e4b10 con 0x7ff1e0122ab0 2026-02-13T03:38:27.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.345+0000 7ff1c77fe6c0 1 -- 10.20.193.96:0/3434193049 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff1d00aa760 con 0x7ff1e0122ab0 2026-02-13T03:38:27.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.345+0000 7ff1de5756c0 1 --2- 10.20.193.96:0/3434193049 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff1b80b5680 0x7ff1b80d5b30 secure :-1 s=READY pgs=296 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1d40023e0 tx=0x7ff1d4005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:27.461 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.459+0000 7ff1e4cc86c0 1 -- 10.20.193.96:0/3434193049 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff1e011e300 con 0x7ff1e0122ab0 2026-02-13T03:38:27.462 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.459+0000 7ff1c77fe6c0 1 -- 10.20.193.96:0/3434193049 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff1d00aa940 con 0x7ff1e0122ab0 2026-02-13T03:38:27.462 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:38:27.462 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:38:27.463 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.460+0000 7ff1e4cc86c0 1 -- 10.20.193.96:0/3434193049 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff1b80b5680 msgr2=0x7ff1b80d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:27.463 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.460+0000 7ff1e4cc86c0 1 --2- 10.20.193.96:0/3434193049 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff1b80b5680 0x7ff1b80d5b30 secure :-1 s=READY pgs=296 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1d40023e0 tx=0x7ff1d4005c00 comp rx=0 tx=0).stop 2026-02-13T03:38:27.463 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.460+0000 7ff1e4cc86c0 1 -- 10.20.193.96:0/3434193049 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff1e0122ab0 msgr2=0x7ff1e0122f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:27.463 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.460+0000 7ff1e4cc86c0 1 --2- 10.20.193.96:0/3434193049 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff1e0122ab0 0x7ff1e0122f50 secure :-1 s=READY pgs=464 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1d0006ea0 tx=0x7ff1d000ce50 comp rx=0 tx=0).stop 2026-02-13T03:38:27.464 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.460+0000 7ff1e4cc86c0 1 -- 10.20.193.96:0/3434193049 shutdown_connections 2026-02-13T03:38:27.464 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.460+0000 7ff1e4cc86c0 1 --2- 10.20.193.96:0/3434193049 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff1b80b5680 0x7ff1b80d5b30 unknown :-1 s=CLOSED pgs=296 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:27.464 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.460+0000 7ff1e4cc86c0 1 --2- 10.20.193.96:0/3434193049 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff1e0122ab0 0x7ff1e0122f50 unknown :-1 s=CLOSED pgs=464 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:27.464 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.460+0000 7ff1e4cc86c0 1 --2- 10.20.193.96:0/3434193049 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff1e0115410 0x7ff1e011d6f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:27.464 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.460+0000 7ff1e4cc86c0 1 --2- 10.20.193.96:0/3434193049 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff1e010f200 0x7ff1e011d1b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:27.464 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.460+0000 7ff1e4cc86c0 1 -- 10.20.193.96:0/3434193049 >> 10.20.193.96:0/3434193049 conn(0x7ff1e00ecb00 msgr2=0x7ff1e010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:27.464 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.460+0000 7ff1e4cc86c0 1 -- 10.20.193.96:0/3434193049 shutdown_connections 2026-02-13T03:38:27.464 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:27.460+0000 7ff1e4cc86c0 1 -- 10.20.193.96:0/3434193049 wait complete. 2026-02-13T03:38:27.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:27 trial096 ceph-mon[24671]: pgmap v318: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:38:27.925 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:27 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3434193049' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:27.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:27 trial132 ceph-mon[26888]: pgmap v318: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:38:27.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:27 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3434193049' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:28.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:27 trial133 ceph-mon[26943]: pgmap v318: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:38:28.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:27 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3434193049' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:29.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:29 trial132 ceph-mon[26888]: pgmap v319: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T03:38:30.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:29 trial133 ceph-mon[26943]: pgmap v319: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T03:38:30.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:29 trial096 ceph-mon[24671]: pgmap v319: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T03:38:30.518 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:38:30.639 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:38:30.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.748+0000 7efcd37f86c0 1 -- 10.20.193.96:0/658307023 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efccc115440 msgr2=0x7efccc175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:30.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.748+0000 7efcd37f86c0 1 --2- 10.20.193.96:0/658307023 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efccc115440 0x7efccc175de0 secure :-1 s=READY pgs=465 gs=1 cs=0 l=1 c_cookie=144817582122116111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efcc800aa70 tx=0x7efcc802fde0 comp rx=0 tx=0).stop 2026-02-13T03:38:30.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.748+0000 7efcd37f86c0 1 -- 10.20.193.96:0/658307023 shutdown_connections 2026-02-13T03:38:30.752 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.748+0000 7efcd37f86c0 1 --2- 10.20.193.96:0/658307023 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efccc115440 0x7efccc175de0 unknown :-1 s=CLOSED pgs=465 gs=1 cs=0 l=1 c_cookie=144817582122116111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:30.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.748+0000 7efcd37f86c0 1 --2- 10.20.193.96:0/658307023 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efccc10fc20 0x7efccc114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:30.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.748+0000 7efcd37f86c0 1 --2- 10.20.193.96:0/658307023 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efccc10f230 0x7efccc10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:30.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.748+0000 7efcd37f86c0 1 -- 10.20.193.96:0/658307023 >> 10.20.193.96:0/658307023 conn(0x7efccc0ecb30 msgr2=0x7efccc10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:30.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.748+0000 7efcd37f86c0 1 -- 10.20.193.96:0/658307023 shutdown_connections 2026-02-13T03:38:30.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.748+0000 7efcd37f86c0 1 -- 10.20.193.96:0/658307023 wait complete. 2026-02-13T03:38:30.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.748+0000 7efcd37f86c0 1 Processor -- start 2026-02-13T03:38:30.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.748+0000 7efcd37f86c0 1 -- start start 2026-02-13T03:38:30.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.748+0000 7efcd37f86c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efccc10f230 0x7efccc0f4b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:30.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.748+0000 7efcd37f86c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efccc115440 0x7efccc175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:30.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.748+0000 7efcd37f86c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efccc0f5160 0x7efccc0fa430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:30.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.748+0000 7efcd37f86c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7efccc0f5850 con 0x7efccc115440 2026-02-13T03:38:30.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.748+0000 7efcd37f86c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7efccc0fa970 con 0x7efccc10f230 2026-02-13T03:38:30.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.748+0000 7efcd37f86c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7efccc0fab30 con 0x7efccc0f5160 2026-02-13T03:38:30.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.748+0000 7efcd0d6c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efccc115440 0x7efccc175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:30.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.748+0000 7efcd0d6c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efccc115440 0x7efccc175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:35528/0 (socket says 10.20.193.96:35528) 2026-02-13T03:38:30.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.748+0000 7efcd0d6c6c0 1 -- 10.20.193.96:0/3919016671 learned_addr learned my addr 10.20.193.96:0/3919016671 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:38:30.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.748+0000 7efcd1d6e6c0 1 --2- 10.20.193.96:0/3919016671 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efccc0f5160 0x7efccc0fa430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:30.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.748+0000 7efcd156d6c0 1 --2- 10.20.193.96:0/3919016671 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efccc10f230 0x7efccc0f4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:30.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.749+0000 7efcd0d6c6c0 1 -- 10.20.193.96:0/3919016671 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efccc0f5160 msgr2=0x7efccc0fa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:30.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.749+0000 7efcd0d6c6c0 1 --2- 10.20.193.96:0/3919016671 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efccc0f5160 0x7efccc0fa430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:30.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.749+0000 7efcd0d6c6c0 1 -- 10.20.193.96:0/3919016671 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efccc10f230 msgr2=0x7efccc0f4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:30.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.749+0000 7efcd0d6c6c0 1 --2- 10.20.193.96:0/3919016671 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efccc10f230 0x7efccc0f4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:30.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.749+0000 7efcd0d6c6c0 1 -- 10.20.193.96:0/3919016671 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc800a660 con 0x7efccc115440 2026-02-13T03:38:30.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.749+0000 7efcd156d6c0 1 --2- 10.20.193.96:0/3919016671 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efccc10f230 0x7efccc0f4b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:38:30.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.749+0000 7efcd0d6c6c0 1 --2- 10.20.193.96:0/3919016671 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efccc115440 0x7efccc175ce0 secure :-1 s=READY pgs=466 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efcc000b6c0 tx=0x7efcc000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:30.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.749+0000 7efcba7fc6c0 1 -- 10.20.193.96:0/3919016671 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efcc00044a0 con 0x7efccc115440 2026-02-13T03:38:30.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.749+0000 7efcd37f86c0 1 -- 10.20.193.96:0/3919016671 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efccc0fae10 con 0x7efccc115440 2026-02-13T03:38:30.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.749+0000 7efcba7fc6c0 1 -- 10.20.193.96:0/3919016671 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7efcc000be50 con 0x7efccc115440 2026-02-13T03:38:30.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.749+0000 7efcba7fc6c0 1 -- 10.20.193.96:0/3919016671 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efcc000cd00 con 0x7efccc115440 2026-02-13T03:38:30.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.749+0000 7efcd37f86c0 1 -- 10.20.193.96:0/3919016671 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efccc0fb5a0 con 0x7efccc115440 2026-02-13T03:38:30.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.749+0000 7efcd37f86c0 1 -- 10.20.193.96:0/3919016671 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efccc0fb2f0 con 0x7efccc115440 2026-02-13T03:38:30.756 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.751+0000 7efcba7fc6c0 1 -- 10.20.193.96:0/3919016671 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7efcc00026b0 con 0x7efccc115440 2026-02-13T03:38:30.756 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.751+0000 7efcba7fc6c0 1 --2- 10.20.193.96:0/3919016671 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efca80b5600 0x7efca80d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:30.756 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.752+0000 7efcba7fc6c0 1 -- 10.20.193.96:0/3919016671 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7efcc00e3730 con 0x7efccc115440 2026-02-13T03:38:30.756 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.752+0000 7efcd156d6c0 1 --2- 10.20.193.96:0/3919016671 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efca80b5600 0x7efca80d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:30.757 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.752+0000 7efcba7fc6c0 1 -- 10.20.193.96:0/3919016671 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7efcc00e3c20 con 0x7efccc115440 2026-02-13T03:38:30.757 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.752+0000 7efcd156d6c0 1 --2- 10.20.193.96:0/3919016671 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efca80b5600 0x7efca80d5ab0 secure :-1 s=READY pgs=297 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efcbc005e50 tx=0x7efcbc005de0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:30.867 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.865+0000 7efcd37f86c0 1 -- 10.20.193.96:0/3919016671 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7efccc0f5c80 con 0x7efccc115440 2026-02-13T03:38:30.868 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.865+0000 7efcba7fc6c0 1 -- 10.20.193.96:0/3919016671 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7efcc00a61d0 con 0x7efccc115440 2026-02-13T03:38:30.868 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:38:30.868 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:38:30.869 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.866+0000 7efcd37f86c0 1 -- 10.20.193.96:0/3919016671 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efca80b5600 msgr2=0x7efca80d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:30.869 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.866+0000 7efcd37f86c0 1 --2- 10.20.193.96:0/3919016671 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efca80b5600 0x7efca80d5ab0 secure :-1 s=READY pgs=297 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efcbc005e50 tx=0x7efcbc005de0 comp rx=0 tx=0).stop 2026-02-13T03:38:30.869 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.866+0000 7efcd37f86c0 1 -- 10.20.193.96:0/3919016671 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efccc115440 msgr2=0x7efccc175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:30.870 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.866+0000 7efcd37f86c0 1 --2- 10.20.193.96:0/3919016671 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efccc115440 0x7efccc175ce0 secure :-1 s=READY pgs=466 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efcc000b6c0 tx=0x7efcc000bb90 comp rx=0 tx=0).stop 2026-02-13T03:38:30.870 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.866+0000 7efcd37f86c0 1 -- 10.20.193.96:0/3919016671 shutdown_connections 2026-02-13T03:38:30.870 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.866+0000 7efcd37f86c0 1 --2- 10.20.193.96:0/3919016671 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7efca80b5600 0x7efca80d5ab0 unknown :-1 s=CLOSED pgs=297 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:30.870 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.866+0000 7efcd37f86c0 1 --2- 10.20.193.96:0/3919016671 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7efccc0f5160 0x7efccc0fa430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:30.870 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.866+0000 7efcd37f86c0 1 --2- 10.20.193.96:0/3919016671 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7efccc115440 0x7efccc175ce0 unknown :-1 s=CLOSED pgs=466 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:30.870 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.866+0000 7efcd37f86c0 1 --2- 10.20.193.96:0/3919016671 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7efccc10f230 0x7efccc0f4b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:30.870 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.866+0000 7efcd37f86c0 1 -- 10.20.193.96:0/3919016671 >> 10.20.193.96:0/3919016671 conn(0x7efccc0ecb30 msgr2=0x7efccc111a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:30.870 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.866+0000 7efcd37f86c0 1 -- 10.20.193.96:0/3919016671 shutdown_connections 2026-02-13T03:38:30.870 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:30.866+0000 7efcd37f86c0 1 -- 10.20.193.96:0/3919016671 wait complete. 2026-02-13T03:38:31.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:31 trial132 ceph-mon[26888]: pgmap v320: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:31.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:31 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3919016671' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:32.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:31 trial133 ceph-mon[26943]: pgmap v320: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:32.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:31 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3919016671' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:32.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:31 trial096 ceph-mon[24671]: pgmap v320: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:32.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:31 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3919016671' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:33.911 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:38:33.976 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:33 trial096 ceph-mon[24671]: pgmap v321: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:33.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:33 trial132 ceph-mon[26888]: pgmap v321: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:34.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:33 trial133 ceph-mon[26943]: pgmap v321: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:34.029 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:38:34.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.138+0000 7fe869e036c0 1 -- 10.20.193.96:0/920293404 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe864115410 msgr2=0x7fe864175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:34.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.138+0000 7fe869e036c0 1 --2- 10.20.193.96:0/920293404 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe864115410 0x7fe864175db0 secure :-1 s=READY pgs=467 gs=1 cs=0 l=1 c_cookie=9495856096387696526 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe85800aa70 tx=0x7fe85802fde0 comp rx=0 tx=0).stop 2026-02-13T03:38:34.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.138+0000 7fe869e036c0 1 -- 10.20.193.96:0/920293404 shutdown_connections 2026-02-13T03:38:34.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.138+0000 7fe869e036c0 1 --2- 10.20.193.96:0/920293404 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe864115410 0x7fe864175db0 unknown :-1 s=CLOSED pgs=467 gs=1 cs=0 l=1 c_cookie=9495856096387696526 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:34.143 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.138+0000 7fe869e036c0 1 --2- 10.20.193.96:0/920293404 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe86410fbf0 0x7fe864114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:34.144 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.138+0000 7fe869e036c0 1 --2- 10.20.193.96:0/920293404 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe86410f200 0x7fe86410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:34.144 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.138+0000 7fe869e036c0 1 -- 10.20.193.96:0/920293404 >> 10.20.193.96:0/920293404 conn(0x7fe8640ecb00 msgr2=0x7fe86410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:34.144 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.138+0000 7fe869e036c0 1 -- 10.20.193.96:0/920293404 shutdown_connections 2026-02-13T03:38:34.144 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.138+0000 7fe869e036c0 1 -- 10.20.193.96:0/920293404 wait complete. 2026-02-13T03:38:34.144 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.138+0000 7fe869e036c0 1 Processor -- start 2026-02-13T03:38:34.144 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.138+0000 7fe869e036c0 1 -- start start 2026-02-13T03:38:34.144 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.139+0000 7fe869e036c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe86410f200 0x7fe86411d1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:34.144 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.139+0000 7fe869e036c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe864115410 0x7fe86411d710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:34.144 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.139+0000 7fe869e036c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe864122ad0 0x7fe864122f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:34.144 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.139+0000 7fe869e036c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe8641234e0 con 0x7fe86410f200 2026-02-13T03:38:34.144 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.139+0000 7fe869e036c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe864123650 con 0x7fe864122ad0 2026-02-13T03:38:34.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.139+0000 7fe869e036c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe864123810 con 0x7fe864115410 2026-02-13T03:38:34.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.139+0000 7fe8637fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe86410f200 0x7fe86411d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:34.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.139+0000 7fe8637fe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe86410f200 0x7fe86411d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:38930/0 (socket says 10.20.193.96:38930) 2026-02-13T03:38:34.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.139+0000 7fe8637fe6c0 1 -- 10.20.193.96:0/560746505 learned_addr learned my addr 10.20.193.96:0/560746505 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:38:34.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.139+0000 7fe863fff6c0 1 --2- 10.20.193.96:0/560746505 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe864122ad0 0x7fe864122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:34.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.139+0000 7fe8637fe6c0 1 -- 10.20.193.96:0/560746505 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe864115410 msgr2=0x7fe86411d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:34.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.139+0000 7fe8637fe6c0 1 --2- 10.20.193.96:0/560746505 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe864115410 0x7fe86411d710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:34.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.139+0000 7fe8637fe6c0 1 -- 10.20.193.96:0/560746505 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe864122ad0 msgr2=0x7fe864122f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:34.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.139+0000 7fe8637fe6c0 1 --2- 10.20.193.96:0/560746505 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe864122ad0 0x7fe864122f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:34.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.139+0000 7fe8637fe6c0 1 -- 10.20.193.96:0/560746505 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85800a660 con 0x7fe86410f200 2026-02-13T03:38:34.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.139+0000 7fe8637fe6c0 1 --2- 10.20.193.96:0/560746505 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe86410f200 0x7fe86411d1d0 secure :-1 s=READY pgs=468 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe85000b6c0 tx=0x7fe85000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:34.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.139+0000 7fe860ff96c0 1 -- 10.20.193.96:0/560746505 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe8500044a0 con 0x7fe86410f200 2026-02-13T03:38:34.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.139+0000 7fe860ff96c0 1 -- 10.20.193.96:0/560746505 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fe850009030 con 0x7fe86410f200 2026-02-13T03:38:34.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.139+0000 7fe869e036c0 1 -- 10.20.193.96:0/560746505 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe864163cc0 con 0x7fe86410f200 2026-02-13T03:38:34.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.139+0000 7fe860ff96c0 1 -- 10.20.193.96:0/560746505 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe85000ccf0 con 0x7fe86410f200 2026-02-13T03:38:34.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.139+0000 7fe869e036c0 1 -- 10.20.193.96:0/560746505 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8641641a0 con 0x7fe86410f200 2026-02-13T03:38:34.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.139+0000 7fe869e036c0 1 -- 10.20.193.96:0/560746505 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8641104d0 con 0x7fe86410f200 2026-02-13T03:38:34.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.141+0000 7fe860ff96c0 1 -- 10.20.193.96:0/560746505 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fe850005080 con 0x7fe86410f200 2026-02-13T03:38:34.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.141+0000 7fe860ff96c0 1 --2- 10.20.193.96:0/560746505 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe8380b5680 0x7fe8380d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:34.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.141+0000 7fe862ffd6c0 1 --2- 10.20.193.96:0/560746505 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe8380b5680 0x7fe8380d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:34.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.142+0000 7fe860ff96c0 1 -- 10.20.193.96:0/560746505 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7fe8500e39a0 con 0x7fe86410f200 2026-02-13T03:38:34.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.142+0000 7fe862ffd6c0 1 --2- 10.20.193.96:0/560746505 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe8380b5680 0x7fe8380d5b30 secure :-1 s=READY pgs=298 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe864123b60 tx=0x7fe854005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:34.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.142+0000 7fe860ff96c0 1 -- 10.20.193.96:0/560746505 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe8500a9e60 con 0x7fe86410f200 2026-02-13T03:38:34.258 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.256+0000 7fe869e036c0 1 -- 10.20.193.96:0/560746505 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe86410f5d0 con 0x7fe86410f200 2026-02-13T03:38:34.259 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.256+0000 7fe860ff96c0 1 -- 10.20.193.96:0/560746505 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe8500704c0 con 0x7fe86410f200 2026-02-13T03:38:34.259 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:38:34.259 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:38:34.260 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.257+0000 7fe869e036c0 1 -- 10.20.193.96:0/560746505 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe8380b5680 msgr2=0x7fe8380d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:34.260 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.257+0000 7fe869e036c0 1 --2- 10.20.193.96:0/560746505 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe8380b5680 0x7fe8380d5b30 secure :-1 s=READY pgs=298 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe864123b60 tx=0x7fe854005f10 comp rx=0 tx=0).stop 2026-02-13T03:38:34.260 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.257+0000 7fe869e036c0 1 -- 10.20.193.96:0/560746505 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe86410f200 msgr2=0x7fe86411d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:34.261 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.257+0000 7fe869e036c0 1 --2- 10.20.193.96:0/560746505 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe86410f200 0x7fe86411d1d0 secure :-1 s=READY pgs=468 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe85000b6c0 tx=0x7fe85000bb90 comp rx=0 tx=0).stop 2026-02-13T03:38:34.261 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.257+0000 7fe869e036c0 1 -- 10.20.193.96:0/560746505 shutdown_connections 2026-02-13T03:38:34.261 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.257+0000 7fe869e036c0 1 --2- 10.20.193.96:0/560746505 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe8380b5680 0x7fe8380d5b30 unknown :-1 s=CLOSED pgs=298 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:34.261 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.257+0000 7fe869e036c0 1 --2- 10.20.193.96:0/560746505 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe864122ad0 0x7fe864122f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:34.261 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.257+0000 7fe869e036c0 1 --2- 10.20.193.96:0/560746505 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe864115410 0x7fe86411d710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:34.261 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.257+0000 7fe869e036c0 1 --2- 10.20.193.96:0/560746505 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe86410f200 0x7fe86411d1d0 unknown :-1 s=CLOSED pgs=468 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:34.261 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.257+0000 7fe869e036c0 1 -- 10.20.193.96:0/560746505 >> 10.20.193.96:0/560746505 conn(0x7fe8640ecb00 msgr2=0x7fe86410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:34.261 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.257+0000 7fe869e036c0 1 -- 10.20.193.96:0/560746505 shutdown_connections 2026-02-13T03:38:34.261 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:34.257+0000 7fe869e036c0 1 -- 10.20.193.96:0/560746505 wait complete. 2026-02-13T03:38:34.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:34 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/560746505' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:35.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:34 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/560746505' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:35.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:34 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/560746505' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:35.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:35 trial132 ceph-mon[26888]: pgmap v322: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:38:36.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:35 trial133 ceph-mon[26943]: pgmap v322: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:38:36.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:35 trial096 ceph-mon[24671]: pgmap v322: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:38:37.316 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:38:37.435 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:38:37.551 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff29976c0 1 -- 10.20.193.96:0/3950379458 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4fec10fbf0 msgr2=0x7f4fec114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:37.551 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff29976c0 1 --2- 10.20.193.96:0/3950379458 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4fec10fbf0 0x7f4fec114c30 secure :-1 s=READY pgs=469 gs=1 cs=0 l=1 c_cookie=11561379269539169097 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fdc0099a0 tx=0x7f4fdc02ed20 comp rx=0 tx=0).stop 2026-02-13T03:38:37.551 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff29976c0 1 -- 10.20.193.96:0/3950379458 shutdown_connections 2026-02-13T03:38:37.551 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff29976c0 1 --2- 10.20.193.96:0/3950379458 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4fec115410 0x7f4fec175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:37.552 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff29976c0 1 --2- 10.20.193.96:0/3950379458 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4fec10fbf0 0x7f4fec114c30 unknown :-1 s=CLOSED pgs=469 gs=1 cs=0 l=1 c_cookie=11561379269539169097 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:37.552 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff29976c0 1 --2- 10.20.193.96:0/3950379458 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4fec10f200 0x7f4fec10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:37.552 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff29976c0 1 -- 10.20.193.96:0/3950379458 >> 10.20.193.96:0/3950379458 conn(0x7f4fec0ecb00 msgr2=0x7f4fec10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:37.552 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff29976c0 1 -- 10.20.193.96:0/3950379458 shutdown_connections 2026-02-13T03:38:37.552 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff29976c0 1 -- 10.20.193.96:0/3950379458 wait complete. 2026-02-13T03:38:37.552 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff29976c0 1 Processor -- start 2026-02-13T03:38:37.552 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff29976c0 1 -- start start 2026-02-13T03:38:37.552 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff29976c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4fec10f200 0x7f4fec11d230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:37.552 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff29976c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4fec115410 0x7f4fec11d770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:37.552 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff29976c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4fec122b30 0x7f4fec122fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:37.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff29976c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec123540 con 0x7f4fec122b30 2026-02-13T03:38:37.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff29976c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec1236b0 con 0x7f4fec115410 2026-02-13T03:38:37.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff29976c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec123870 con 0x7f4fec10f200 2026-02-13T03:38:37.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff0f096c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4fec122b30 0x7f4fec122fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:37.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff0f096c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4fec122b30 0x7f4fec122fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:38952/0 (socket says 10.20.193.96:38952) 2026-02-13T03:38:37.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff0f096c0 1 -- 10.20.193.96:0/139684315 learned_addr learned my addr 10.20.193.96:0/139684315 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:38:37.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4febfff6c0 1 --2- 10.20.193.96:0/139684315 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4fec10f200 0x7f4fec11d230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:37.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4feb7fe6c0 1 --2- 10.20.193.96:0/139684315 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4fec115410 0x7f4fec11d770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:37.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff0f096c0 1 -- 10.20.193.96:0/139684315 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4fec10f200 msgr2=0x7f4fec11d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:37.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff0f096c0 1 --2- 10.20.193.96:0/139684315 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4fec10f200 0x7f4fec11d230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:37.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff0f096c0 1 -- 10.20.193.96:0/139684315 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4fec115410 msgr2=0x7f4fec11d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:37.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff0f096c0 1 --2- 10.20.193.96:0/139684315 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4fec115410 0x7f4fec11d770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:37.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4ff0f096c0 1 -- 10.20.193.96:0/139684315 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fdc009590 con 0x7f4fec122b30 2026-02-13T03:38:37.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.547+0000 7f4febfff6c0 1 --2- 10.20.193.96:0/139684315 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4fec10f200 0x7f4fec11d230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:38:37.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.548+0000 7f4ff0f096c0 1 --2- 10.20.193.96:0/139684315 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4fec122b30 0x7f4fec122fd0 secure :-1 s=READY pgs=470 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fe0006ea0 tx=0x7f4fe000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:37.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.548+0000 7f4fe97fa6c0 1 -- 10.20.193.96:0/139684315 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4fe0003a30 con 0x7f4fec122b30 2026-02-13T03:38:37.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.548+0000 7f4ff29976c0 1 -- 10.20.193.96:0/139684315 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fec163d20 con 0x7f4fec122b30 2026-02-13T03:38:37.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.548+0000 7f4fe97fa6c0 1 -- 10.20.193.96:0/139684315 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f4fe0005510 con 0x7f4fec122b30 2026-02-13T03:38:37.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.548+0000 7f4fe97fa6c0 1 -- 10.20.193.96:0/139684315 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4fe000dd70 con 0x7f4fec122b30 2026-02-13T03:38:37.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.548+0000 7f4ff29976c0 1 -- 10.20.193.96:0/139684315 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fec164200 con 0x7f4fec122b30 2026-02-13T03:38:37.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.548+0000 7f4ff29976c0 1 -- 10.20.193.96:0/139684315 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fec1104d0 con 0x7f4fec122b30 2026-02-13T03:38:37.555 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.550+0000 7f4fe97fa6c0 1 -- 10.20.193.96:0/139684315 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f4fe0003b90 con 0x7f4fec122b30 2026-02-13T03:38:37.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.550+0000 7f4fe97fa6c0 1 --2- 10.20.193.96:0/139684315 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4fc00b5680 0x7f4fc00d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:37.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.551+0000 7f4febfff6c0 1 --2- 10.20.193.96:0/139684315 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4fc00b5680 0x7f4fc00d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:37.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.551+0000 7f4fe97fa6c0 1 -- 10.20.193.96:0/139684315 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f4fe00e4ad0 con 0x7f4fec122b30 2026-02-13T03:38:37.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.551+0000 7f4fe97fa6c0 1 -- 10.20.193.96:0/139684315 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4fe011d5e0 con 0x7f4fec122b30 2026-02-13T03:38:37.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.551+0000 7f4febfff6c0 1 --2- 10.20.193.96:0/139684315 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4fc00b5680 0x7f4fc00d5b30 secure :-1 s=READY pgs=299 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fd8004750 tx=0x7f4fd8009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:37.668 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.665+0000 7f4ff29976c0 1 -- 10.20.193.96:0/139684315 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4fec10f5d0 con 0x7f4fec122b30 2026-02-13T03:38:37.668 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.665+0000 7f4fe97fa6c0 1 -- 10.20.193.96:0/139684315 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f4fe00a7570 con 0x7f4fec122b30 2026-02-13T03:38:37.668 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:38:37.669 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:38:37.670 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.667+0000 7f4ff29976c0 1 -- 10.20.193.96:0/139684315 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4fc00b5680 msgr2=0x7f4fc00d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:37.670 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.667+0000 7f4ff29976c0 1 --2- 10.20.193.96:0/139684315 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4fc00b5680 0x7f4fc00d5b30 secure :-1 s=READY pgs=299 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fd8004750 tx=0x7f4fd8009260 comp rx=0 tx=0).stop 2026-02-13T03:38:37.670 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.667+0000 7f4ff29976c0 1 -- 10.20.193.96:0/139684315 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4fec122b30 msgr2=0x7f4fec122fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:37.670 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.667+0000 7f4ff29976c0 1 --2- 10.20.193.96:0/139684315 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4fec122b30 0x7f4fec122fd0 secure :-1 s=READY pgs=470 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fe0006ea0 tx=0x7f4fe000cca0 comp rx=0 tx=0).stop 2026-02-13T03:38:37.670 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.667+0000 7f4ff29976c0 1 -- 10.20.193.96:0/139684315 shutdown_connections 2026-02-13T03:38:37.670 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.667+0000 7f4ff29976c0 1 --2- 10.20.193.96:0/139684315 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f4fc00b5680 0x7f4fc00d5b30 unknown :-1 s=CLOSED pgs=299 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:37.670 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.667+0000 7f4ff29976c0 1 --2- 10.20.193.96:0/139684315 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f4fec122b30 0x7f4fec122fd0 unknown :-1 s=CLOSED pgs=470 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:37.670 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.667+0000 7f4ff29976c0 1 --2- 10.20.193.96:0/139684315 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f4fec115410 0x7f4fec11d770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:37.670 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.667+0000 7f4ff29976c0 1 --2- 10.20.193.96:0/139684315 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f4fec10f200 0x7f4fec11d230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:37.671 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.667+0000 7f4ff29976c0 1 -- 10.20.193.96:0/139684315 >> 10.20.193.96:0/139684315 conn(0x7f4fec0ecb00 msgr2=0x7f4fec10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:37.671 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.667+0000 7f4ff29976c0 1 -- 10.20.193.96:0/139684315 shutdown_connections 2026-02-13T03:38:37.671 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:37.667+0000 7f4ff29976c0 1 -- 10.20.193.96:0/139684315 wait complete. 2026-02-13T03:38:37.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:37 trial096 ceph-mon[24671]: pgmap v323: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:37.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:37 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/139684315' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:37.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:37 trial132 ceph-mon[26888]: pgmap v323: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:37.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:37 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/139684315' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:38.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:37 trial133 ceph-mon[26943]: pgmap v323: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:38.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:37 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/139684315' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:39.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:39 trial132 ceph-mon[26888]: pgmap v324: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:40.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:39 trial133 ceph-mon[26943]: pgmap v324: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:40.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:39 trial096 ceph-mon[24671]: pgmap v324: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:40.709 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:38:40.830 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:38:40.955 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.950+0000 7ff454f076c0 1 -- 10.20.193.96:0/300193346 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff45010fbf0 msgr2=0x7ff450114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:40.955 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.950+0000 7ff454f076c0 1 --2- 10.20.193.96:0/300193346 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff45010fbf0 0x7ff450114c30 secure :-1 s=READY pgs=471 gs=1 cs=0 l=1 c_cookie=13733545917170381105 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4380099a0 tx=0x7ff43802ed20 comp rx=0 tx=0).stop 2026-02-13T03:38:40.955 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.950+0000 7ff454f076c0 1 -- 10.20.193.96:0/300193346 shutdown_connections 2026-02-13T03:38:40.955 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.950+0000 7ff454f076c0 1 --2- 10.20.193.96:0/300193346 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff450115410 0x7ff450175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:40.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.950+0000 7ff454f076c0 1 --2- 10.20.193.96:0/300193346 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff45010fbf0 0x7ff450114c30 unknown :-1 s=CLOSED pgs=471 gs=1 cs=0 l=1 c_cookie=13733545917170381105 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:40.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.950+0000 7ff454f076c0 1 --2- 10.20.193.96:0/300193346 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff45010f200 0x7ff45010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:40.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.950+0000 7ff454f076c0 1 -- 10.20.193.96:0/300193346 >> 10.20.193.96:0/300193346 conn(0x7ff4500ecb00 msgr2=0x7ff45010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:40.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.950+0000 7ff454f076c0 1 -- 10.20.193.96:0/300193346 shutdown_connections 2026-02-13T03:38:40.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.950+0000 7ff454f076c0 1 -- 10.20.193.96:0/300193346 wait complete. 2026-02-13T03:38:40.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.951+0000 7ff454f076c0 1 Processor -- start 2026-02-13T03:38:40.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.951+0000 7ff454f076c0 1 -- start start 2026-02-13T03:38:40.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.951+0000 7ff454f076c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff45010f200 0x7ff4500f4d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:40.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.951+0000 7ff454f076c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff450115410 0x7ff450175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:40.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.951+0000 7ff454f076c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff4500f53a0 0x7ff4500fa620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:40.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.951+0000 7ff454f076c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff4500f5a00 con 0x7ff4500f53a0 2026-02-13T03:38:40.956 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.951+0000 7ff454f076c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff4500fab60 con 0x7ff450115410 2026-02-13T03:38:40.957 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.951+0000 7ff454f076c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff4500fad20 con 0x7ff45010f200 2026-02-13T03:38:40.957 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.951+0000 7ff44ed766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff4500f53a0 0x7ff4500fa620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:40.957 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.951+0000 7ff44ed766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff4500f53a0 0x7ff4500fa620 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:38970/0 (socket says 10.20.193.96:38970) 2026-02-13T03:38:40.957 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.951+0000 7ff44ed766c0 1 -- 10.20.193.96:0/364062416 learned_addr learned my addr 10.20.193.96:0/364062416 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:38:40.957 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.951+0000 7ff44dd746c0 1 --2- 10.20.193.96:0/364062416 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff450115410 0x7ff450175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:40.957 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.951+0000 7ff44e5756c0 1 --2- 10.20.193.96:0/364062416 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff45010f200 0x7ff4500f4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:40.957 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.951+0000 7ff44ed766c0 1 -- 10.20.193.96:0/364062416 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff45010f200 msgr2=0x7ff4500f4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:40.957 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.951+0000 7ff44ed766c0 1 --2- 10.20.193.96:0/364062416 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff45010f200 0x7ff4500f4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:40.957 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.951+0000 7ff44ed766c0 1 -- 10.20.193.96:0/364062416 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff450115410 msgr2=0x7ff450175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:40.957 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.951+0000 7ff44ed766c0 1 --2- 10.20.193.96:0/364062416 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff450115410 0x7ff450175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:40.957 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.951+0000 7ff44ed766c0 1 -- 10.20.193.96:0/364062416 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff438009590 con 0x7ff4500f53a0 2026-02-13T03:38:40.957 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.951+0000 7ff44ed766c0 1 --2- 10.20.193.96:0/364062416 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff4500f53a0 0x7ff4500fa620 secure :-1 s=READY pgs=472 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff440006ea0 tx=0x7ff44000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:40.958 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.951+0000 7ff4377fe6c0 1 -- 10.20.193.96:0/364062416 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff440003a30 con 0x7ff4500f53a0 2026-02-13T03:38:40.958 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.951+0000 7ff4377fe6c0 1 -- 10.20.193.96:0/364062416 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7ff440005510 con 0x7ff4500f53a0 2026-02-13T03:38:40.958 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.951+0000 7ff454f076c0 1 -- 10.20.193.96:0/364062416 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4500fafa0 con 0x7ff4500f53a0 2026-02-13T03:38:40.958 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.951+0000 7ff4377fe6c0 1 -- 10.20.193.96:0/364062416 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff44000dd70 con 0x7ff4500f53a0 2026-02-13T03:38:40.958 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.952+0000 7ff454f076c0 1 -- 10.20.193.96:0/364062416 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4500fb430 con 0x7ff4500f53a0 2026-02-13T03:38:40.958 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.952+0000 7ff454f076c0 1 -- 10.20.193.96:0/364062416 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4501104d0 con 0x7ff4500f53a0 2026-02-13T03:38:40.959 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.953+0000 7ff4377fe6c0 1 -- 10.20.193.96:0/364062416 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7ff440003b90 con 0x7ff4500f53a0 2026-02-13T03:38:40.959 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.954+0000 7ff4377fe6c0 1 --2- 10.20.193.96:0/364062416 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff4280b5600 0x7ff4280d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:40.959 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.954+0000 7ff4377fe6c0 1 -- 10.20.193.96:0/364062416 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7ff4400e4ae0 con 0x7ff4500f53a0 2026-02-13T03:38:40.959 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.954+0000 7ff44e5756c0 1 --2- 10.20.193.96:0/364062416 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff4280b5600 0x7ff4280d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:40.959 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.954+0000 7ff4377fe6c0 1 -- 10.20.193.96:0/364062416 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff44011d5e0 con 0x7ff4500f53a0 2026-02-13T03:38:40.959 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:40.954+0000 7ff44e5756c0 1 --2- 10.20.193.96:0/364062416 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff4280b5600 0x7ff4280d5ab0 secure :-1 s=READY pgs=300 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff444004750 tx=0x7ff444005e60 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:41.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:41.068+0000 7ff454f076c0 1 -- 10.20.193.96:0/364062416 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff4500f5e70 con 0x7ff4500f53a0 2026-02-13T03:38:41.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:41.068+0000 7ff4377fe6c0 1 -- 10.20.193.96:0/364062416 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff4400a7540 con 0x7ff4500f53a0 2026-02-13T03:38:41.071 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:38:41.071 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:38:41.072 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:41.069+0000 7ff454f076c0 1 -- 10.20.193.96:0/364062416 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff4280b5600 msgr2=0x7ff4280d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:41.072 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:41.069+0000 7ff454f076c0 1 --2- 10.20.193.96:0/364062416 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff4280b5600 0x7ff4280d5ab0 secure :-1 s=READY pgs=300 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff444004750 tx=0x7ff444005e60 comp rx=0 tx=0).stop 2026-02-13T03:38:41.072 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:41.069+0000 7ff454f076c0 1 -- 10.20.193.96:0/364062416 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff4500f53a0 msgr2=0x7ff4500fa620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:41.072 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:41.069+0000 7ff454f076c0 1 --2- 10.20.193.96:0/364062416 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff4500f53a0 0x7ff4500fa620 secure :-1 s=READY pgs=472 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff440006ea0 tx=0x7ff44000cca0 comp rx=0 tx=0).stop 2026-02-13T03:38:41.072 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:41.069+0000 7ff454f076c0 1 -- 10.20.193.96:0/364062416 shutdown_connections 2026-02-13T03:38:41.072 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:41.069+0000 7ff454f076c0 1 --2- 10.20.193.96:0/364062416 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff4280b5600 0x7ff4280d5ab0 unknown :-1 s=CLOSED pgs=300 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:41.073 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:41.069+0000 7ff454f076c0 1 --2- 10.20.193.96:0/364062416 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff4500f53a0 0x7ff4500fa620 unknown :-1 s=CLOSED pgs=472 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:41.073 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:41.069+0000 7ff454f076c0 1 --2- 10.20.193.96:0/364062416 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff450115410 0x7ff450175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:41.073 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:41.069+0000 7ff454f076c0 1 --2- 10.20.193.96:0/364062416 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff45010f200 0x7ff4500f4d70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:41.073 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:41.069+0000 7ff454f076c0 1 -- 10.20.193.96:0/364062416 >> 10.20.193.96:0/364062416 conn(0x7ff4500ecb00 msgr2=0x7ff450111c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:41.073 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:41.069+0000 7ff454f076c0 1 -- 10.20.193.96:0/364062416 shutdown_connections 2026-02-13T03:38:41.073 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:41.069+0000 7ff454f076c0 1 -- 10.20.193.96:0/364062416 wait complete. 2026-02-13T03:38:41.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:41 trial132 ceph-mon[26888]: pgmap v325: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:41.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:41 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/364062416' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:42.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:41 trial133 ceph-mon[26943]: pgmap v325: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:42.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:41 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/364062416' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:42.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:41 trial096 ceph-mon[24671]: pgmap v325: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:42.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:41 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/364062416' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:43.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:43 trial132 ceph-mon[26888]: pgmap v326: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:44.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:43 trial133 ceph-mon[26943]: pgmap v326: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:44.113 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:38:44.138 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:43 trial096 ceph-mon[24671]: pgmap v326: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:44.233 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:38:44.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.343+0000 7f81210e06c0 1 -- 10.20.193.96:0/150563327 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f811c10fc20 msgr2=0x7f811c114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:44.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.343+0000 7f81210e06c0 1 --2- 10.20.193.96:0/150563327 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f811c10fc20 0x7f811c114c60 secure :-1 s=READY pgs=473 gs=1 cs=0 l=1 c_cookie=14144484645980168774 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f81040099a0 tx=0x7f810402ed20 comp rx=0 tx=0).stop 2026-02-13T03:38:44.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.343+0000 7f81210e06c0 1 -- 10.20.193.96:0/150563327 shutdown_connections 2026-02-13T03:38:44.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.343+0000 7f81210e06c0 1 --2- 10.20.193.96:0/150563327 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f811c115440 0x7f811c175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:44.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.343+0000 7f81210e06c0 1 --2- 10.20.193.96:0/150563327 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f811c10fc20 0x7f811c114c60 unknown :-1 s=CLOSED pgs=473 gs=1 cs=0 l=1 c_cookie=14144484645980168774 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:44.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.343+0000 7f81210e06c0 1 --2- 10.20.193.96:0/150563327 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f811c10f230 0x7f811c10f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:44.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.343+0000 7f81210e06c0 1 -- 10.20.193.96:0/150563327 >> 10.20.193.96:0/150563327 conn(0x7f811c0ecb30 msgr2=0x7f811c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:44.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.343+0000 7f81210e06c0 1 -- 10.20.193.96:0/150563327 shutdown_connections 2026-02-13T03:38:44.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.343+0000 7f81210e06c0 1 -- 10.20.193.96:0/150563327 wait complete. 2026-02-13T03:38:44.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.344+0000 7f81210e06c0 1 Processor -- start 2026-02-13T03:38:44.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.344+0000 7f81210e06c0 1 -- start start 2026-02-13T03:38:44.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.344+0000 7f81210e06c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f811c10f230 0x7f811c11d350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:44.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.344+0000 7f81210e06c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f811c115440 0x7f811c11d890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:44.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.344+0000 7f81210e06c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f811c122c50 0x7f811c1230f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:44.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.344+0000 7f81210e06c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f811c123660 con 0x7f811c115440 2026-02-13T03:38:44.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.344+0000 7f81210e06c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f811c1237d0 con 0x7f811c122c50 2026-02-13T03:38:44.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.344+0000 7f81210e06c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f811c123990 con 0x7f811c10f230 2026-02-13T03:38:44.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.344+0000 7f811a5756c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f811c115440 0x7f811c11d890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:44.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.344+0000 7f811a5756c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f811c115440 0x7f811c11d890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49302/0 (socket says 10.20.193.96:49302) 2026-02-13T03:38:44.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.344+0000 7f811a5756c0 1 -- 10.20.193.96:0/3072113952 learned_addr learned my addr 10.20.193.96:0/3072113952 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:38:44.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.344+0000 7f811a5756c0 1 -- 10.20.193.96:0/3072113952 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f811c10f230 msgr2=0x7f811c11d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:44.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.344+0000 7f811a5756c0 1 --2- 10.20.193.96:0/3072113952 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f811c10f230 0x7f811c11d350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:44.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.344+0000 7f811a5756c0 1 -- 10.20.193.96:0/3072113952 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f811c122c50 msgr2=0x7f811c1230f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:44.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.344+0000 7f811a5756c0 1 --2- 10.20.193.96:0/3072113952 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f811c122c50 0x7f811c1230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:44.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.344+0000 7f811a5756c0 1 -- 10.20.193.96:0/3072113952 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8104009590 con 0x7f811c115440 2026-02-13T03:38:44.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.344+0000 7f811a5756c0 1 --2- 10.20.193.96:0/3072113952 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f811c115440 0x7f811c11d890 secure :-1 s=READY pgs=474 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f810402f230 tx=0x7f810402fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:44.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.344+0000 7f80fbfff6c0 1 -- 10.20.193.96:0/3072113952 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8104002ae0 con 0x7f811c115440 2026-02-13T03:38:44.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.344+0000 7f80fbfff6c0 1 -- 10.20.193.96:0/3072113952 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f8104002c40 con 0x7f811c115440 2026-02-13T03:38:44.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.344+0000 7f81210e06c0 1 -- 10.20.193.96:0/3072113952 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f811c163de0 con 0x7f811c115440 2026-02-13T03:38:44.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.344+0000 7f80fbfff6c0 1 -- 10.20.193.96:0/3072113952 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f81040312b0 con 0x7f811c115440 2026-02-13T03:38:44.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.344+0000 7f81210e06c0 1 -- 10.20.193.96:0/3072113952 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f811c164260 con 0x7f811c115440 2026-02-13T03:38:44.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.345+0000 7f81210e06c0 1 -- 10.20.193.96:0/3072113952 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f811c110500 con 0x7f811c115440 2026-02-13T03:38:44.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.346+0000 7f80fbfff6c0 1 -- 10.20.193.96:0/3072113952 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f8104007980 con 0x7f811c115440 2026-02-13T03:38:44.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.347+0000 7f80fbfff6c0 1 --2- 10.20.193.96:0/3072113952 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f80f00b5680 0x7f80f00d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:44.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.347+0000 7f811ad766c0 1 --2- 10.20.193.96:0/3072113952 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f80f00b5680 0x7f80f00d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:44.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.347+0000 7f80fbfff6c0 1 -- 10.20.193.96:0/3072113952 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f8104107c10 con 0x7f811c115440 2026-02-13T03:38:44.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.347+0000 7f811ad766c0 1 --2- 10.20.193.96:0/3072113952 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f80f00b5680 0x7f80f00d5b30 secure :-1 s=READY pgs=301 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8110005980 tx=0x7f8110005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:44.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.347+0000 7f80fbfff6c0 1 -- 10.20.193.96:0/3072113952 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f81040ce0d0 con 0x7f811c115440 2026-02-13T03:38:44.465 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.462+0000 7f81210e06c0 1 -- 10.20.193.96:0/3072113952 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f811c10f600 con 0x7f811c115440 2026-02-13T03:38:44.465 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.462+0000 7f80fbfff6c0 1 -- 10.20.193.96:0/3072113952 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f81040d0140 con 0x7f811c115440 2026-02-13T03:38:44.466 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:38:44.466 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:38:44.467 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.463+0000 7f81210e06c0 1 -- 10.20.193.96:0/3072113952 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f80f00b5680 msgr2=0x7f80f00d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:44.467 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.463+0000 7f81210e06c0 1 --2- 10.20.193.96:0/3072113952 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f80f00b5680 0x7f80f00d5b30 secure :-1 s=READY pgs=301 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8110005980 tx=0x7f8110005910 comp rx=0 tx=0).stop 2026-02-13T03:38:44.467 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.463+0000 7f81210e06c0 1 -- 10.20.193.96:0/3072113952 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f811c115440 msgr2=0x7f811c11d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:44.467 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.463+0000 7f81210e06c0 1 --2- 10.20.193.96:0/3072113952 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f811c115440 0x7f811c11d890 secure :-1 s=READY pgs=474 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f810402f230 tx=0x7f810402fc60 comp rx=0 tx=0).stop 2026-02-13T03:38:44.467 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.463+0000 7f81210e06c0 1 -- 10.20.193.96:0/3072113952 shutdown_connections 2026-02-13T03:38:44.467 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.463+0000 7f81210e06c0 1 --2- 10.20.193.96:0/3072113952 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f80f00b5680 0x7f80f00d5b30 unknown :-1 s=CLOSED pgs=301 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:44.467 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.463+0000 7f81210e06c0 1 --2- 10.20.193.96:0/3072113952 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f811c122c50 0x7f811c1230f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:44.467 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.463+0000 7f81210e06c0 1 --2- 10.20.193.96:0/3072113952 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f811c115440 0x7f811c11d890 unknown :-1 s=CLOSED pgs=474 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:44.468 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.463+0000 7f81210e06c0 1 --2- 10.20.193.96:0/3072113952 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f811c10f230 0x7f811c11d350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:44.468 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.463+0000 7f81210e06c0 1 -- 10.20.193.96:0/3072113952 >> 10.20.193.96:0/3072113952 conn(0x7f811c0ecb30 msgr2=0x7f811c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:44.468 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.463+0000 7f81210e06c0 1 -- 10.20.193.96:0/3072113952 shutdown_connections 2026-02-13T03:38:44.468 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:44.463+0000 7f81210e06c0 1 -- 10.20.193.96:0/3072113952 wait complete. 2026-02-13T03:38:44.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:44 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3072113952' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:45.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:44 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3072113952' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:45.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:44 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3072113952' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:45.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:45 trial132 ceph-mon[26888]: pgmap v327: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:38:46.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:45 trial133 ceph-mon[26943]: pgmap v327: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:38:46.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:45 trial096 ceph-mon[24671]: pgmap v327: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:38:47.524 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:38:47.643 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:38:47.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.750+0000 7f3efa7246c0 1 -- 10.20.193.96:0/758978734 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3ef410fc00 msgr2=0x7f3ef4114c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:47.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.750+0000 7f3efa7246c0 1 --2- 10.20.193.96:0/758978734 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3ef410fc00 0x7f3ef4114c40 secure :-1 s=READY pgs=475 gs=1 cs=0 l=1 c_cookie=12713431174439421566 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ee40099a0 tx=0x7f3ee402ed20 comp rx=0 tx=0).stop 2026-02-13T03:38:47.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.750+0000 7f3efa7246c0 1 -- 10.20.193.96:0/758978734 shutdown_connections 2026-02-13T03:38:47.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.750+0000 7f3efa7246c0 1 --2- 10.20.193.96:0/758978734 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3ef4115420 0x7f3ef4175dc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:47.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.750+0000 7f3efa7246c0 1 --2- 10.20.193.96:0/758978734 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3ef410fc00 0x7f3ef4114c40 unknown :-1 s=CLOSED pgs=475 gs=1 cs=0 l=1 c_cookie=12713431174439421566 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:47.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.750+0000 7f3efa7246c0 1 --2- 10.20.193.96:0/758978734 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3ef410f210 0x7f3ef410f5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:47.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.750+0000 7f3efa7246c0 1 -- 10.20.193.96:0/758978734 >> 10.20.193.96:0/758978734 conn(0x7f3ef40ecb30 msgr2=0x7f3ef410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:47.753 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.750+0000 7f3efa7246c0 1 -- 10.20.193.96:0/758978734 shutdown_connections 2026-02-13T03:38:47.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.750+0000 7f3efa7246c0 1 -- 10.20.193.96:0/758978734 wait complete. 2026-02-13T03:38:47.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.750+0000 7f3efa7246c0 1 Processor -- start 2026-02-13T03:38:47.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.751+0000 7f3efa7246c0 1 -- start start 2026-02-13T03:38:47.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.751+0000 7f3efa7246c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3ef410f210 0x7f3ef40f4c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:47.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.751+0000 7f3efa7246c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3ef4115420 0x7f3ef4175cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:47.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.751+0000 7f3efa7246c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3ef40f5240 0x7f3ef40fa510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:47.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.751+0000 7f3efa7246c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef40f5930 con 0x7f3ef40f5240 2026-02-13T03:38:47.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.751+0000 7f3efa7246c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef40faa50 con 0x7f3ef410f210 2026-02-13T03:38:47.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.751+0000 7f3efa7246c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef40fac10 con 0x7f3ef4115420 2026-02-13T03:38:47.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.751+0000 7f3ef8c9a6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3ef40f5240 0x7f3ef40fa510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:47.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.751+0000 7f3ef8c9a6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3ef40f5240 0x7f3ef40fa510 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49322/0 (socket says 10.20.193.96:49322) 2026-02-13T03:38:47.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.751+0000 7f3ef8c9a6c0 1 -- 10.20.193.96:0/188212121 learned_addr learned my addr 10.20.193.96:0/188212121 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:38:47.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.751+0000 7f3ef37fe6c0 1 --2- 10.20.193.96:0/188212121 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3ef4115420 0x7f3ef4175cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:47.754 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.751+0000 7f3ef3fff6c0 1 --2- 10.20.193.96:0/188212121 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3ef410f210 0x7f3ef40f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:47.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.751+0000 7f3ef8c9a6c0 1 -- 10.20.193.96:0/188212121 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3ef4115420 msgr2=0x7f3ef4175cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:47.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.751+0000 7f3ef8c9a6c0 1 --2- 10.20.193.96:0/188212121 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3ef4115420 0x7f3ef4175cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:47.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.751+0000 7f3ef8c9a6c0 1 -- 10.20.193.96:0/188212121 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3ef410f210 msgr2=0x7f3ef40f4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:47.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.751+0000 7f3ef8c9a6c0 1 --2- 10.20.193.96:0/188212121 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3ef410f210 0x7f3ef40f4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:47.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.751+0000 7f3ef8c9a6c0 1 -- 10.20.193.96:0/188212121 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee4009590 con 0x7f3ef40f5240 2026-02-13T03:38:47.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.751+0000 7f3ef8c9a6c0 1 --2- 10.20.193.96:0/188212121 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3ef40f5240 0x7f3ef40fa510 secure :-1 s=READY pgs=476 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ee8006ea0 tx=0x7f3ee800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:47.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.751+0000 7f3ef17fa6c0 1 -- 10.20.193.96:0/188212121 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3ee8003a30 con 0x7f3ef40f5240 2026-02-13T03:38:47.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.751+0000 7f3ef17fa6c0 1 -- 10.20.193.96:0/188212121 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f3ee8005510 con 0x7f3ef40f5240 2026-02-13T03:38:47.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.751+0000 7f3efa7246c0 1 -- 10.20.193.96:0/188212121 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ef40faef0 con 0x7f3ef40f5240 2026-02-13T03:38:47.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.751+0000 7f3ef17fa6c0 1 -- 10.20.193.96:0/188212121 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3ee800dd70 con 0x7f3ef40f5240 2026-02-13T03:38:47.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.751+0000 7f3efa7246c0 1 -- 10.20.193.96:0/188212121 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ef40fb680 con 0x7f3ef40f5240 2026-02-13T03:38:47.755 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.752+0000 7f3efa7246c0 1 -- 10.20.193.96:0/188212121 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ef40fb3d0 con 0x7f3ef40f5240 2026-02-13T03:38:47.756 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.753+0000 7f3ef17fa6c0 1 -- 10.20.193.96:0/188212121 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f3ee8003b90 con 0x7f3ef40f5240 2026-02-13T03:38:47.756 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.753+0000 7f3ef17fa6c0 1 --2- 10.20.193.96:0/188212121 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f3ec80b5680 0x7f3ec80d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:47.756 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.753+0000 7f3ef17fa6c0 1 -- 10.20.193.96:0/188212121 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f3ee80e4ad0 con 0x7f3ef40f5240 2026-02-13T03:38:47.756 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.753+0000 7f3ef3fff6c0 1 --2- 10.20.193.96:0/188212121 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f3ec80b5680 0x7f3ec80d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:47.757 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.754+0000 7f3ef3fff6c0 1 --2- 10.20.193.96:0/188212121 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f3ec80b5680 0x7f3ec80d5b30 secure :-1 s=READY pgs=302 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ee0005980 tx=0x7f3ee00094b0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:47.757 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.754+0000 7f3ef17fa6c0 1 -- 10.20.193.96:0/188212121 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3ee80a7530 con 0x7f3ef40f5240 2026-02-13T03:38:47.871 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.868+0000 7f3efa7246c0 1 -- 10.20.193.96:0/188212121 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3ef41104e0 con 0x7f3ef40f5240 2026-02-13T03:38:47.871 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:47 trial096 ceph-mon[24671]: pgmap v328: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:47.871 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.868+0000 7f3ef17fa6c0 1 -- 10.20.193.96:0/188212121 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f3ee80aa6e0 con 0x7f3ef40f5240 2026-02-13T03:38:47.871 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:38:47.871 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:38:47.872 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.869+0000 7f3efa7246c0 1 -- 10.20.193.96:0/188212121 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f3ec80b5680 msgr2=0x7f3ec80d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:47.872 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.869+0000 7f3efa7246c0 1 --2- 10.20.193.96:0/188212121 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f3ec80b5680 0x7f3ec80d5b30 secure :-1 s=READY pgs=302 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ee0005980 tx=0x7f3ee00094b0 comp rx=0 tx=0).stop 2026-02-13T03:38:47.872 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.869+0000 7f3efa7246c0 1 -- 10.20.193.96:0/188212121 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3ef40f5240 msgr2=0x7f3ef40fa510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:47.872 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.869+0000 7f3efa7246c0 1 --2- 10.20.193.96:0/188212121 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3ef40f5240 0x7f3ef40fa510 secure :-1 s=READY pgs=476 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ee8006ea0 tx=0x7f3ee800cca0 comp rx=0 tx=0).stop 2026-02-13T03:38:47.872 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.869+0000 7f3efa7246c0 1 -- 10.20.193.96:0/188212121 shutdown_connections 2026-02-13T03:38:47.872 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.869+0000 7f3efa7246c0 1 --2- 10.20.193.96:0/188212121 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f3ec80b5680 0x7f3ec80d5b30 unknown :-1 s=CLOSED pgs=302 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:47.872 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.869+0000 7f3efa7246c0 1 --2- 10.20.193.96:0/188212121 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f3ef40f5240 0x7f3ef40fa510 unknown :-1 s=CLOSED pgs=476 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:47.872 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.869+0000 7f3efa7246c0 1 --2- 10.20.193.96:0/188212121 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f3ef4115420 0x7f3ef4175cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:47.872 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.869+0000 7f3efa7246c0 1 --2- 10.20.193.96:0/188212121 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f3ef410f210 0x7f3ef40f4c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:47.872 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.869+0000 7f3efa7246c0 1 -- 10.20.193.96:0/188212121 >> 10.20.193.96:0/188212121 conn(0x7f3ef40ecb30 msgr2=0x7f3ef4111be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:47.872 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.869+0000 7f3efa7246c0 1 -- 10.20.193.96:0/188212121 shutdown_connections 2026-02-13T03:38:47.872 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:47.869+0000 7f3efa7246c0 1 -- 10.20.193.96:0/188212121 wait complete. 2026-02-13T03:38:47.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:47 trial132 ceph-mon[26888]: pgmap v328: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:48.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:47 trial133 ceph-mon[26943]: pgmap v328: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:48.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:48 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/188212121' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:49.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:48 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/188212121' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:49.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:48 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/188212121' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:49.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:49 trial132 ceph-mon[26888]: pgmap v329: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:50.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:49 trial133 ceph-mon[26943]: pgmap v329: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:50.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:49 trial096 ceph-mon[24671]: pgmap v329: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:50.913 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:38:51.031 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:38:51.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.148+0000 7f57991306c0 1 -- 10.20.193.96:0/585266236 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5794115410 msgr2=0x7f5794175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:51.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.148+0000 7f57991306c0 1 --2- 10.20.193.96:0/585266236 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5794115410 0x7f5794175db0 secure :-1 s=READY pgs=477 gs=1 cs=0 l=1 c_cookie=4367763717068833942 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f578400aa70 tx=0x7f578402fde0 comp rx=0 tx=0).stop 2026-02-13T03:38:51.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f57991306c0 1 -- 10.20.193.96:0/585266236 shutdown_connections 2026-02-13T03:38:51.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f57991306c0 1 --2- 10.20.193.96:0/585266236 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5794115410 0x7f5794175db0 unknown :-1 s=CLOSED pgs=477 gs=1 cs=0 l=1 c_cookie=4367763717068833942 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:51.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f57991306c0 1 --2- 10.20.193.96:0/585266236 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f579410fbf0 0x7f5794114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:51.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f57991306c0 1 --2- 10.20.193.96:0/585266236 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f579410f200 0x7f579410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:51.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f57991306c0 1 -- 10.20.193.96:0/585266236 >> 10.20.193.96:0/585266236 conn(0x7f57940ecb00 msgr2=0x7f579410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:51.154 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f57991306c0 1 -- 10.20.193.96:0/585266236 shutdown_connections 2026-02-13T03:38:51.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f57991306c0 1 -- 10.20.193.96:0/585266236 wait complete. 2026-02-13T03:38:51.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f57991306c0 1 Processor -- start 2026-02-13T03:38:51.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f57991306c0 1 -- start start 2026-02-13T03:38:51.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f57991306c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f579410f200 0x7f579411d0e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:51.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f57991306c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5794115410 0x7f579411d620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:51.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f57991306c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f57941229e0 0x7f5794122e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:51.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f57991306c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f57941233f0 con 0x7f57941229e0 2026-02-13T03:38:51.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f57991306c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5794123560 con 0x7f579410f200 2026-02-13T03:38:51.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f57991306c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5794123720 con 0x7f5794115410 2026-02-13T03:38:51.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f57935776c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f57941229e0 0x7f5794122e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:51.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f57935776c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f57941229e0 0x7f5794122e80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:49330/0 (socket says 10.20.193.96:49330) 2026-02-13T03:38:51.155 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f57935776c0 1 -- 10.20.193.96:0/2768154574 learned_addr learned my addr 10.20.193.96:0/2768154574 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:38:51.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f5792d766c0 1 --2- 10.20.193.96:0/2768154574 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f579410f200 0x7f579411d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:51.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f57935776c0 1 -- 10.20.193.96:0/2768154574 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5794115410 msgr2=0x7f579411d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:51.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f57935776c0 1 --2- 10.20.193.96:0/2768154574 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5794115410 0x7f579411d620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:51.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f57935776c0 1 -- 10.20.193.96:0/2768154574 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f579410f200 msgr2=0x7f579411d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:51.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f57935776c0 1 --2- 10.20.193.96:0/2768154574 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f579410f200 0x7f579411d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:51.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f57935776c0 1 -- 10.20.193.96:0/2768154574 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578400a660 con 0x7f57941229e0 2026-02-13T03:38:51.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f57935776c0 1 --2- 10.20.193.96:0/2768154574 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f57941229e0 0x7f5794122e80 secure :-1 s=READY pgs=478 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f578400ab70 tx=0x7f57840054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:51.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.149+0000 7f5773fff6c0 1 -- 10.20.193.96:0/2768154574 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5784030d10 con 0x7f57941229e0 2026-02-13T03:38:51.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.150+0000 7f5773fff6c0 1 -- 10.20.193.96:0/2768154574 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f5784030e70 con 0x7f57941229e0 2026-02-13T03:38:51.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.150+0000 7f5773fff6c0 1 -- 10.20.193.96:0/2768154574 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5784008430 con 0x7f57941229e0 2026-02-13T03:38:51.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.150+0000 7f57991306c0 1 -- 10.20.193.96:0/2768154574 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5794163b70 con 0x7f57941229e0 2026-02-13T03:38:51.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.150+0000 7f57991306c0 1 -- 10.20.193.96:0/2768154574 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5794163fa0 con 0x7f57941229e0 2026-02-13T03:38:51.156 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.150+0000 7f57991306c0 1 -- 10.20.193.96:0/2768154574 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57941104d0 con 0x7f57941229e0 2026-02-13T03:38:51.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.152+0000 7f5773fff6c0 1 -- 10.20.193.96:0/2768154574 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f5784003810 con 0x7f57941229e0 2026-02-13T03:38:51.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.152+0000 7f5773fff6c0 1 --2- 10.20.193.96:0/2768154574 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f57680b5680 0x7f57680d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:51.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.152+0000 7f5792d766c0 1 --2- 10.20.193.96:0/2768154574 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f57680b5680 0x7f57680d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:51.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.152+0000 7f5773fff6c0 1 -- 10.20.193.96:0/2768154574 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f5784108f10 con 0x7f57941229e0 2026-02-13T03:38:51.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.152+0000 7f5792d766c0 1 --2- 10.20.193.96:0/2768154574 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f57680b5680 0x7f57680d5b30 secure :-1 s=READY pgs=303 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5788005980 tx=0x7f5788005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:51.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.153+0000 7f5773fff6c0 1 -- 10.20.193.96:0/2768154574 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f57840cb970 con 0x7f57941229e0 2026-02-13T03:38:51.272 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.268+0000 7f57991306c0 1 -- 10.20.193.96:0/2768154574 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f579410f5d0 con 0x7f57941229e0 2026-02-13T03:38:51.272 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.269+0000 7f5773fff6c0 1 -- 10.20.193.96:0/2768154574 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f57840ceb20 con 0x7f57941229e0 2026-02-13T03:38:51.273 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:38:51.273 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:38:51.274 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.270+0000 7f57991306c0 1 -- 10.20.193.96:0/2768154574 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f57680b5680 msgr2=0x7f57680d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:51.274 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.270+0000 7f57991306c0 1 --2- 10.20.193.96:0/2768154574 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f57680b5680 0x7f57680d5b30 secure :-1 s=READY pgs=303 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5788005980 tx=0x7f5788005910 comp rx=0 tx=0).stop 2026-02-13T03:38:51.274 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.270+0000 7f57991306c0 1 -- 10.20.193.96:0/2768154574 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f57941229e0 msgr2=0x7f5794122e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:51.274 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.270+0000 7f57991306c0 1 --2- 10.20.193.96:0/2768154574 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f57941229e0 0x7f5794122e80 secure :-1 s=READY pgs=478 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f578400ab70 tx=0x7f57840054b0 comp rx=0 tx=0).stop 2026-02-13T03:38:51.274 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.270+0000 7f57991306c0 1 -- 10.20.193.96:0/2768154574 shutdown_connections 2026-02-13T03:38:51.274 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.270+0000 7f57991306c0 1 --2- 10.20.193.96:0/2768154574 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f57680b5680 0x7f57680d5b30 unknown :-1 s=CLOSED pgs=303 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:51.274 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.270+0000 7f57991306c0 1 --2- 10.20.193.96:0/2768154574 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f57941229e0 0x7f5794122e80 unknown :-1 s=CLOSED pgs=478 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:51.274 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.270+0000 7f57991306c0 1 --2- 10.20.193.96:0/2768154574 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f5794115410 0x7f579411d620 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:51.274 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.270+0000 7f57991306c0 1 --2- 10.20.193.96:0/2768154574 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f579410f200 0x7f579411d0e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:51.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.270+0000 7f57991306c0 1 -- 10.20.193.96:0/2768154574 >> 10.20.193.96:0/2768154574 conn(0x7f57940ecb00 msgr2=0x7f579410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:51.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.270+0000 7f57991306c0 1 -- 10.20.193.96:0/2768154574 shutdown_connections 2026-02-13T03:38:51.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:51.270+0000 7f57991306c0 1 -- 10.20.193.96:0/2768154574 wait complete. 2026-02-13T03:38:51.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:51 trial132 ceph-mon[26888]: pgmap v330: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:51.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:51 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2768154574' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:52.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:51 trial133 ceph-mon[26943]: pgmap v330: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:52.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:51 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2768154574' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:52.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:51 trial096 ceph-mon[24671]: pgmap v330: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:52.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:51 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2768154574' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:53.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:53 trial132 ceph-mon[26888]: pgmap v331: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:54.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:53 trial133 ceph-mon[26943]: pgmap v331: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:54.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:53 trial096 ceph-mon[24671]: pgmap v331: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:38:54.313 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:38:54.433 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:38:54.552 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.546+0000 7fbc8bfbc6c0 1 -- 10.20.193.96:0/771637126 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbc8410f230 msgr2=0x7fbc8410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:54.552 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.546+0000 7fbc8bfbc6c0 1 --2- 10.20.193.96:0/771637126 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbc8410f230 0x7fbc8410f600 secure :-1 s=READY pgs=479 gs=1 cs=0 l=1 c_cookie=3962689313776437104 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc740099a0 tx=0x7fbc7402ed20 comp rx=0 tx=0).stop 2026-02-13T03:38:54.552 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.546+0000 7fbc8bfbc6c0 1 -- 10.20.193.96:0/771637126 shutdown_connections 2026-02-13T03:38:54.552 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.546+0000 7fbc8bfbc6c0 1 --2- 10.20.193.96:0/771637126 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fbc84115440 0x7fbc84175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:54.552 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.546+0000 7fbc8bfbc6c0 1 --2- 10.20.193.96:0/771637126 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fbc8410fc20 0x7fbc84114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:54.552 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.546+0000 7fbc8bfbc6c0 1 --2- 10.20.193.96:0/771637126 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbc8410f230 0x7fbc8410f600 unknown :-1 s=CLOSED pgs=479 gs=1 cs=0 l=1 c_cookie=3962689313776437104 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:54.552 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.546+0000 7fbc8bfbc6c0 1 -- 10.20.193.96:0/771637126 >> 10.20.193.96:0/771637126 conn(0x7fbc840ecb30 msgr2=0x7fbc8410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:54.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.546+0000 7fbc8bfbc6c0 1 -- 10.20.193.96:0/771637126 shutdown_connections 2026-02-13T03:38:54.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.546+0000 7fbc8bfbc6c0 1 -- 10.20.193.96:0/771637126 wait complete. 2026-02-13T03:38:54.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.547+0000 7fbc8bfbc6c0 1 Processor -- start 2026-02-13T03:38:54.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.547+0000 7fbc8bfbc6c0 1 -- start start 2026-02-13T03:38:54.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.547+0000 7fbc8bfbc6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbc8410f230 0x7fbc8411d180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:54.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.547+0000 7fbc8bfbc6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fbc84115440 0x7fbc8411d6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:54.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.547+0000 7fbc8bfbc6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fbc84122a80 0x7fbc84122f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:54.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.547+0000 7fbc8bfbc6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fbc84123490 con 0x7fbc8410f230 2026-02-13T03:38:54.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.547+0000 7fbc8bfbc6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbc84123600 con 0x7fbc84115440 2026-02-13T03:38:54.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.547+0000 7fbc8bfbc6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbc841237c0 con 0x7fbc84122a80 2026-02-13T03:38:54.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.547+0000 7fbc89d2d6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbc8410f230 0x7fbc8411d180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:54.553 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.547+0000 7fbc89d2d6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbc8410f230 0x7fbc8411d180 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:46364/0 (socket says 10.20.193.96:46364) 2026-02-13T03:38:54.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.547+0000 7fbc89d2d6c0 1 -- 10.20.193.96:0/1974916587 learned_addr learned my addr 10.20.193.96:0/1974916587 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:38:54.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.547+0000 7fbc89d2d6c0 1 -- 10.20.193.96:0/1974916587 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fbc84122a80 msgr2=0x7fbc84122f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:54.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.547+0000 7fbc89d2d6c0 1 --2- 10.20.193.96:0/1974916587 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fbc84122a80 0x7fbc84122f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:54.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.547+0000 7fbc89d2d6c0 1 -- 10.20.193.96:0/1974916587 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fbc84115440 msgr2=0x7fbc8411d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:54.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.547+0000 7fbc89d2d6c0 1 --2- 10.20.193.96:0/1974916587 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fbc84115440 0x7fbc8411d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:54.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.547+0000 7fbc89d2d6c0 1 -- 10.20.193.96:0/1974916587 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc74009590 con 0x7fbc8410f230 2026-02-13T03:38:54.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.547+0000 7fbc89d2d6c0 1 --2- 10.20.193.96:0/1974916587 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbc8410f230 0x7fbc8411d180 secure :-1 s=READY pgs=480 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc740098c0 tx=0x7fbc740047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:54.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.547+0000 7fbc72ffd6c0 1 -- 10.20.193.96:0/1974916587 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc74002ae0 con 0x7fbc8410f230 2026-02-13T03:38:54.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.547+0000 7fbc72ffd6c0 1 -- 10.20.193.96:0/1974916587 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fbc74002c40 con 0x7fbc8410f230 2026-02-13T03:38:54.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.547+0000 7fbc8bfbc6c0 1 -- 10.20.193.96:0/1974916587 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc84163c10 con 0x7fbc8410f230 2026-02-13T03:38:54.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.547+0000 7fbc72ffd6c0 1 -- 10.20.193.96:0/1974916587 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc740372f0 con 0x7fbc8410f230 2026-02-13T03:38:54.554 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.547+0000 7fbc8bfbc6c0 1 -- 10.20.193.96:0/1974916587 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc84164090 con 0x7fbc8410f230 2026-02-13T03:38:54.555 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.548+0000 7fbc8bfbc6c0 1 -- 10.20.193.96:0/1974916587 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc84110500 con 0x7fbc8410f230 2026-02-13T03:38:54.555 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.549+0000 7fbc72ffd6c0 1 -- 10.20.193.96:0/1974916587 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fbc74007960 con 0x7fbc8410f230 2026-02-13T03:38:54.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.549+0000 7fbc72ffd6c0 1 --2- 10.20.193.96:0/1974916587 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fbc600b5680 0x7fbc600d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:54.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.549+0000 7fbc8952c6c0 1 --2- 10.20.193.96:0/1974916587 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fbc600b5680 0x7fbc600d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:54.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.550+0000 7fbc72ffd6c0 1 -- 10.20.193.96:0/1974916587 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7fbc74107d20 con 0x7fbc8410f230 2026-02-13T03:38:54.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.550+0000 7fbc8952c6c0 1 --2- 10.20.193.96:0/1974916587 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fbc600b5680 0x7fbc600d5b30 secure :-1 s=READY pgs=304 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc78005980 tx=0x7fbc78005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:54.556 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.550+0000 7fbc72ffd6c0 1 -- 10.20.193.96:0/1974916587 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbc740ce1e0 con 0x7fbc8410f230 2026-02-13T03:38:54.669 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.665+0000 7fbc8bfbc6c0 1 -- 10.20.193.96:0/1974916587 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbc8410f600 con 0x7fbc8410f230 2026-02-13T03:38:54.669 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.666+0000 7fbc72ffd6c0 1 -- 10.20.193.96:0/1974916587 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fbc74002db0 con 0x7fbc8410f230 2026-02-13T03:38:54.669 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:38:54.670 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:38:54.671 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.667+0000 7fbc8bfbc6c0 1 -- 10.20.193.96:0/1974916587 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fbc600b5680 msgr2=0x7fbc600d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:54.671 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.667+0000 7fbc8bfbc6c0 1 --2- 10.20.193.96:0/1974916587 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fbc600b5680 0x7fbc600d5b30 secure :-1 s=READY pgs=304 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc78005980 tx=0x7fbc78005910 comp rx=0 tx=0).stop 2026-02-13T03:38:54.671 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.667+0000 7fbc8bfbc6c0 1 -- 10.20.193.96:0/1974916587 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbc8410f230 msgr2=0x7fbc8411d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:54.671 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.667+0000 7fbc8bfbc6c0 1 --2- 10.20.193.96:0/1974916587 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbc8410f230 0x7fbc8411d180 secure :-1 s=READY pgs=480 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc740098c0 tx=0x7fbc740047f0 comp rx=0 tx=0).stop 2026-02-13T03:38:54.671 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.667+0000 7fbc8bfbc6c0 1 -- 10.20.193.96:0/1974916587 shutdown_connections 2026-02-13T03:38:54.671 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.667+0000 7fbc8bfbc6c0 1 --2- 10.20.193.96:0/1974916587 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fbc600b5680 0x7fbc600d5b30 unknown :-1 s=CLOSED pgs=304 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:54.671 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.667+0000 7fbc8bfbc6c0 1 --2- 10.20.193.96:0/1974916587 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fbc84122a80 0x7fbc84122f20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:54.671 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.667+0000 7fbc8bfbc6c0 1 --2- 10.20.193.96:0/1974916587 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fbc84115440 0x7fbc8411d6c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:54.671 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.667+0000 7fbc8bfbc6c0 1 --2- 10.20.193.96:0/1974916587 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fbc8410f230 0x7fbc8411d180 unknown :-1 s=CLOSED pgs=480 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:54.672 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.667+0000 7fbc8bfbc6c0 1 -- 10.20.193.96:0/1974916587 >> 10.20.193.96:0/1974916587 conn(0x7fbc840ecb30 msgr2=0x7fbc8410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:54.672 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.667+0000 7fbc8bfbc6c0 1 -- 10.20.193.96:0/1974916587 shutdown_connections 2026-02-13T03:38:54.672 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:54.667+0000 7fbc8bfbc6c0 1 -- 10.20.193.96:0/1974916587 wait complete. 2026-02-13T03:38:54.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:54 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1974916587' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:54.982 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:54 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1974916587' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:55.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:54 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1974916587' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:56.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:55 trial133 ceph-mon[26943]: pgmap v332: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:38:56.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:55 trial096 ceph-mon[24671]: pgmap v332: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:38:56.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:55 trial132 ceph-mon[26888]: pgmap v332: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:38:57.713 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:38:57.833 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:38:57.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.944+0000 7fec474936c0 1 -- 10.20.193.96:0/1309017188 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fec4010fbf0 msgr2=0x7fec40114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:57.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.944+0000 7fec474936c0 1 --2- 10.20.193.96:0/1309017188 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fec4010fbf0 0x7fec40114c30 secure :-1 s=READY pgs=481 gs=1 cs=0 l=1 c_cookie=2224267845472283562 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec340099a0 tx=0x7fec3402ed00 comp rx=0 tx=0).stop 2026-02-13T03:38:57.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.944+0000 7fec474936c0 1 -- 10.20.193.96:0/1309017188 shutdown_connections 2026-02-13T03:38:57.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.944+0000 7fec474936c0 1 --2- 10.20.193.96:0/1309017188 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fec40115410 0x7fec40175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:57.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.944+0000 7fec474936c0 1 --2- 10.20.193.96:0/1309017188 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fec4010fbf0 0x7fec40114c30 unknown :-1 s=CLOSED pgs=481 gs=1 cs=0 l=1 c_cookie=2224267845472283562 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:57.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.944+0000 7fec474936c0 1 --2- 10.20.193.96:0/1309017188 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fec4010f200 0x7fec4010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:57.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.944+0000 7fec474936c0 1 -- 10.20.193.96:0/1309017188 >> 10.20.193.96:0/1309017188 conn(0x7fec400ecb00 msgr2=0x7fec4010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:57.950 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.944+0000 7fec474936c0 1 -- 10.20.193.96:0/1309017188 shutdown_connections 2026-02-13T03:38:57.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.944+0000 7fec474936c0 1 -- 10.20.193.96:0/1309017188 wait complete. 2026-02-13T03:38:57.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.945+0000 7fec474936c0 1 Processor -- start 2026-02-13T03:38:57.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.945+0000 7fec474936c0 1 -- start start 2026-02-13T03:38:57.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.945+0000 7fec474936c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fec4010f200 0x7fec4011d160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:57.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.945+0000 7fec474936c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fec40115410 0x7fec4011d6a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:57.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.945+0000 7fec474936c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fec40122a60 0x7fec40122f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:57.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.945+0000 7fec474936c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fec40123440 con 0x7fec4010f200 2026-02-13T03:38:57.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.945+0000 7fec474936c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fec401235b0 con 0x7fec40115410 2026-02-13T03:38:57.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.945+0000 7fec474936c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fec40123770 con 0x7fec40122a60 2026-02-13T03:38:57.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.945+0000 7fec452046c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fec4010f200 0x7fec4011d160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:57.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.945+0000 7fec452046c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fec4010f200 0x7fec4011d160 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:46382/0 (socket says 10.20.193.96:46382) 2026-02-13T03:38:57.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.945+0000 7fec452046c0 1 -- 10.20.193.96:0/3257871912 learned_addr learned my addr 10.20.193.96:0/3257871912 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:38:57.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.945+0000 7fec45a056c0 1 --2- 10.20.193.96:0/3257871912 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fec40122a60 0x7fec40122f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:57.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.945+0000 7fec452046c0 1 -- 10.20.193.96:0/3257871912 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fec40122a60 msgr2=0x7fec40122f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:57.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.945+0000 7fec452046c0 1 --2- 10.20.193.96:0/3257871912 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fec40122a60 0x7fec40122f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:57.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.945+0000 7fec452046c0 1 -- 10.20.193.96:0/3257871912 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fec40115410 msgr2=0x7fec4011d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:57.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.945+0000 7fec452046c0 1 --2- 10.20.193.96:0/3257871912 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fec40115410 0x7fec4011d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:57.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.945+0000 7fec452046c0 1 -- 10.20.193.96:0/3257871912 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec34009590 con 0x7fec4010f200 2026-02-13T03:38:57.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.945+0000 7fec452046c0 1 --2- 10.20.193.96:0/3257871912 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fec4010f200 0x7fec4011d160 secure :-1 s=READY pgs=482 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec3000b6c0 tx=0x7fec3000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:57.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.945+0000 7fec2e7fc6c0 1 -- 10.20.193.96:0/3257871912 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec30004560 con 0x7fec4010f200 2026-02-13T03:38:57.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.945+0000 7fec2e7fc6c0 1 -- 10.20.193.96:0/3257871912 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fec30009030 con 0x7fec4010f200 2026-02-13T03:38:57.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.945+0000 7fec474936c0 1 -- 10.20.193.96:0/3257871912 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec40163bf0 con 0x7fec4010f200 2026-02-13T03:38:57.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.945+0000 7fec2e7fc6c0 1 -- 10.20.193.96:0/3257871912 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec3000ce20 con 0x7fec4010f200 2026-02-13T03:38:57.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.945+0000 7fec474936c0 1 -- 10.20.193.96:0/3257871912 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec401640d0 con 0x7fec4010f200 2026-02-13T03:38:57.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.946+0000 7fec474936c0 1 -- 10.20.193.96:0/3257871912 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec401104d0 con 0x7fec4010f200 2026-02-13T03:38:57.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.947+0000 7fec2e7fc6c0 1 -- 10.20.193.96:0/3257871912 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fec300026b0 con 0x7fec4010f200 2026-02-13T03:38:57.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.947+0000 7fec2e7fc6c0 1 --2- 10.20.193.96:0/3257871912 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fec1c0b5600 0x7fec1c0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:38:57.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.948+0000 7fec44a036c0 1 --2- 10.20.193.96:0/3257871912 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fec1c0b5600 0x7fec1c0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:38:57.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.948+0000 7fec2e7fc6c0 1 -- 10.20.193.96:0/3257871912 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7fec300e39a0 con 0x7fec4010f200 2026-02-13T03:38:57.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.948+0000 7fec2e7fc6c0 1 -- 10.20.193.96:0/3257871912 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fec300a6400 con 0x7fec4010f200 2026-02-13T03:38:57.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:57.948+0000 7fec44a036c0 1 --2- 10.20.193.96:0/3257871912 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fec1c0b5600 0x7fec1c0d5ab0 secure :-1 s=READY pgs=305 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec340098c0 tx=0x7fec34005bc0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:38:58.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:57 trial133 ceph-mon[26943]: pgmap v333: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:58.067 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:58.064+0000 7fec474936c0 1 -- 10.20.193.96:0/3257871912 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fec4011e310 con 0x7fec4010f200 2026-02-13T03:38:58.068 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:57 trial096 ceph-mon[24671]: pgmap v333: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:58.068 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:58.064+0000 7fec2e7fc6c0 1 -- 10.20.193.96:0/3257871912 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fec300a95b0 con 0x7fec4010f200 2026-02-13T03:38:58.069 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:38:58.069 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:38:58.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:58.066+0000 7fec474936c0 1 -- 10.20.193.96:0/3257871912 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fec1c0b5600 msgr2=0x7fec1c0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:58.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:58.066+0000 7fec474936c0 1 --2- 10.20.193.96:0/3257871912 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fec1c0b5600 0x7fec1c0d5ab0 secure :-1 s=READY pgs=305 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec340098c0 tx=0x7fec34005bc0 comp rx=0 tx=0).stop 2026-02-13T03:38:58.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:58.066+0000 7fec474936c0 1 -- 10.20.193.96:0/3257871912 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fec4010f200 msgr2=0x7fec4011d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:38:58.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:58.066+0000 7fec474936c0 1 --2- 10.20.193.96:0/3257871912 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fec4010f200 0x7fec4011d160 secure :-1 s=READY pgs=482 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec3000b6c0 tx=0x7fec3000bb90 comp rx=0 tx=0).stop 2026-02-13T03:38:58.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:58.066+0000 7fec474936c0 1 -- 10.20.193.96:0/3257871912 shutdown_connections 2026-02-13T03:38:58.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:58.066+0000 7fec474936c0 1 --2- 10.20.193.96:0/3257871912 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fec1c0b5600 0x7fec1c0d5ab0 unknown :-1 s=CLOSED pgs=305 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:58.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:58.066+0000 7fec474936c0 1 --2- 10.20.193.96:0/3257871912 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fec40122a60 0x7fec40122f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:58.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:58.066+0000 7fec474936c0 1 --2- 10.20.193.96:0/3257871912 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fec40115410 0x7fec4011d6a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:58.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:58.066+0000 7fec474936c0 1 --2- 10.20.193.96:0/3257871912 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fec4010f200 0x7fec4011d160 unknown :-1 s=CLOSED pgs=482 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:38:58.071 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:58.066+0000 7fec474936c0 1 -- 10.20.193.96:0/3257871912 >> 10.20.193.96:0/3257871912 conn(0x7fec400ecb00 msgr2=0x7fec4010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:38:58.071 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:58.066+0000 7fec474936c0 1 -- 10.20.193.96:0/3257871912 shutdown_connections 2026-02-13T03:38:58.071 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:38:58.066+0000 7fec474936c0 1 -- 10.20.193.96:0/3257871912 wait complete. 2026-02-13T03:38:58.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:57 trial132 ceph-mon[26888]: pgmap v333: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:38:59.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:58 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3257871912' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:59.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:58 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3257871912' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:38:59.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:58 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3257871912' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:00.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:38:59 trial133 ceph-mon[26943]: pgmap v334: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:39:00.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:38:59 trial096 ceph-mon[24671]: pgmap v334: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:39:00.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:38:59 trial132 ceph-mon[26888]: pgmap v334: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:39:01.130 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:39:01.249 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:39:01.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.368+0000 7ff8b0de06c0 1 -- 10.20.193.96:0/3515159058 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8ac10f230 msgr2=0x7ff8ac10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:01.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.368+0000 7ff8b0de06c0 1 --2- 10.20.193.96:0/3515159058 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8ac10f230 0x7ff8ac10f600 secure :-1 s=READY pgs=483 gs=1 cs=0 l=1 c_cookie=13659399476117660458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8a00099a0 tx=0x7ff8a002ed20 comp rx=0 tx=0).stop 2026-02-13T03:39:01.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.368+0000 7ff8b0de06c0 1 -- 10.20.193.96:0/3515159058 shutdown_connections 2026-02-13T03:39:01.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.368+0000 7ff8b0de06c0 1 --2- 10.20.193.96:0/3515159058 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff8ac115440 0x7ff8ac175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:01.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.368+0000 7ff8b0de06c0 1 --2- 10.20.193.96:0/3515159058 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff8ac10fc20 0x7ff8ac114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:01.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.368+0000 7ff8b0de06c0 1 --2- 10.20.193.96:0/3515159058 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8ac10f230 0x7ff8ac10f600 unknown :-1 s=CLOSED pgs=483 gs=1 cs=0 l=1 c_cookie=13659399476117660458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:01.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.368+0000 7ff8b0de06c0 1 -- 10.20.193.96:0/3515159058 >> 10.20.193.96:0/3515159058 conn(0x7ff8ac0ecb30 msgr2=0x7ff8ac10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:39:01.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.368+0000 7ff8b0de06c0 1 -- 10.20.193.96:0/3515159058 shutdown_connections 2026-02-13T03:39:01.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.368+0000 7ff8b0de06c0 1 -- 10.20.193.96:0/3515159058 wait complete. 2026-02-13T03:39:01.371 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.368+0000 7ff8b0de06c0 1 Processor -- start 2026-02-13T03:39:01.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.368+0000 7ff8b0de06c0 1 -- start start 2026-02-13T03:39:01.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.368+0000 7ff8b0de06c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8ac10f230 0x7ff8ac11d220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:01.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.368+0000 7ff8b0de06c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff8ac115440 0x7ff8ac11d760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:01.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.368+0000 7ff8b0de06c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff8ac122b20 0x7ff8ac122fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:01.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.368+0000 7ff8b0de06c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ac123530 con 0x7ff8ac10f230 2026-02-13T03:39:01.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.368+0000 7ff8b0de06c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ac1236a0 con 0x7ff8ac122b20 2026-02-13T03:39:01.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.368+0000 7ff8b0de06c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ac123860 con 0x7ff8ac115440 2026-02-13T03:39:01.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.369+0000 7ff8aa5756c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8ac10f230 0x7ff8ac11d220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:01.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.369+0000 7ff8aa5756c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8ac10f230 0x7ff8ac11d220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:46388/0 (socket says 10.20.193.96:46388) 2026-02-13T03:39:01.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.369+0000 7ff8aa5756c0 1 -- 10.20.193.96:0/66198915 learned_addr learned my addr 10.20.193.96:0/66198915 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:39:01.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.369+0000 7ff8aa5756c0 1 -- 10.20.193.96:0/66198915 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff8ac115440 msgr2=0x7ff8ac11d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:01.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.369+0000 7ff8a9d746c0 1 --2- 10.20.193.96:0/66198915 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff8ac115440 0x7ff8ac11d760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:01.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.369+0000 7ff8aa5756c0 1 --2- 10.20.193.96:0/66198915 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff8ac115440 0x7ff8ac11d760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:01.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.369+0000 7ff8aad766c0 1 --2- 10.20.193.96:0/66198915 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff8ac122b20 0x7ff8ac122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:01.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.369+0000 7ff8aa5756c0 1 -- 10.20.193.96:0/66198915 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff8ac122b20 msgr2=0x7ff8ac122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:01.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.369+0000 7ff8aa5756c0 1 --2- 10.20.193.96:0/66198915 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff8ac122b20 0x7ff8ac122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:01.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.369+0000 7ff8aa5756c0 1 -- 10.20.193.96:0/66198915 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8a0009590 con 0x7ff8ac10f230 2026-02-13T03:39:01.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.369+0000 7ff8a9d746c0 1 --2- 10.20.193.96:0/66198915 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff8ac115440 0x7ff8ac11d760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:39:01.372 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.369+0000 7ff8aad766c0 1 --2- 10.20.193.96:0/66198915 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff8ac122b20 0x7ff8ac122fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:39:01.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.369+0000 7ff8aa5756c0 1 --2- 10.20.193.96:0/66198915 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8ac10f230 0x7ff8ac11d220 secure :-1 s=READY pgs=484 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8a00098c0 tx=0x7ff8a00047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:39:01.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.369+0000 7ff8937fe6c0 1 -- 10.20.193.96:0/66198915 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8a0002ae0 con 0x7ff8ac10f230 2026-02-13T03:39:01.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.369+0000 7ff8b0de06c0 1 -- 10.20.193.96:0/66198915 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8ac163cb0 con 0x7ff8ac10f230 2026-02-13T03:39:01.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.369+0000 7ff8937fe6c0 1 -- 10.20.193.96:0/66198915 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7ff8a0007740 con 0x7ff8ac10f230 2026-02-13T03:39:01.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.369+0000 7ff8937fe6c0 1 -- 10.20.193.96:0/66198915 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8a0037690 con 0x7ff8ac10f230 2026-02-13T03:39:01.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.369+0000 7ff8b0de06c0 1 -- 10.20.193.96:0/66198915 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8ac164130 con 0x7ff8ac10f230 2026-02-13T03:39:01.373 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.369+0000 7ff8b0de06c0 1 -- 10.20.193.96:0/66198915 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8ac110500 con 0x7ff8ac10f230 2026-02-13T03:39:01.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.371+0000 7ff8937fe6c0 1 -- 10.20.193.96:0/66198915 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7ff8a0002c80 con 0x7ff8ac10f230 2026-02-13T03:39:01.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.371+0000 7ff8937fe6c0 1 --2- 10.20.193.96:0/66198915 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff8840b5600 0x7ff8840d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:01.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.371+0000 7ff8937fe6c0 1 -- 10.20.193.96:0/66198915 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7ff8a0107d60 con 0x7ff8ac10f230 2026-02-13T03:39:01.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.371+0000 7ff8a9d746c0 1 --2- 10.20.193.96:0/66198915 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff8840b5600 0x7ff8840d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:01.374 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.371+0000 7ff8937fe6c0 1 -- 10.20.193.96:0/66198915 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff8a01081e0 con 0x7ff8ac10f230 2026-02-13T03:39:01.375 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.372+0000 7ff8a9d746c0 1 --2- 10.20.193.96:0/66198915 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff8840b5600 0x7ff8840d5ab0 secure :-1 s=READY pgs=306 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8ac123bb0 tx=0x7ff894005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:39:01.489 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.486+0000 7ff8b0de06c0 1 -- 10.20.193.96:0/66198915 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff8ac10f600 con 0x7ff8ac10f230 2026-02-13T03:39:01.489 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.487+0000 7ff8937fe6c0 1 -- 10.20.193.96:0/66198915 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff8ac10f600 con 0x7ff8ac10f230 2026-02-13T03:39:01.490 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:39:01.490 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:39:01.491 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.488+0000 7ff8b0de06c0 1 -- 10.20.193.96:0/66198915 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff8840b5600 msgr2=0x7ff8840d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:01.491 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.488+0000 7ff8b0de06c0 1 --2- 10.20.193.96:0/66198915 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff8840b5600 0x7ff8840d5ab0 secure :-1 s=READY pgs=306 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8ac123bb0 tx=0x7ff894005f10 comp rx=0 tx=0).stop 2026-02-13T03:39:01.491 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.488+0000 7ff8b0de06c0 1 -- 10.20.193.96:0/66198915 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8ac10f230 msgr2=0x7ff8ac11d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:01.491 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.488+0000 7ff8b0de06c0 1 --2- 10.20.193.96:0/66198915 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8ac10f230 0x7ff8ac11d220 secure :-1 s=READY pgs=484 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8a00098c0 tx=0x7ff8a00047f0 comp rx=0 tx=0).stop 2026-02-13T03:39:01.491 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.488+0000 7ff8b0de06c0 1 -- 10.20.193.96:0/66198915 shutdown_connections 2026-02-13T03:39:01.491 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.488+0000 7ff8b0de06c0 1 --2- 10.20.193.96:0/66198915 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7ff8840b5600 0x7ff8840d5ab0 unknown :-1 s=CLOSED pgs=306 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:01.491 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.488+0000 7ff8b0de06c0 1 --2- 10.20.193.96:0/66198915 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7ff8ac122b20 0x7ff8ac122fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:01.491 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.488+0000 7ff8b0de06c0 1 --2- 10.20.193.96:0/66198915 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7ff8ac115440 0x7ff8ac11d760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:01.491 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.488+0000 7ff8b0de06c0 1 --2- 10.20.193.96:0/66198915 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7ff8ac10f230 0x7ff8ac11d220 unknown :-1 s=CLOSED pgs=484 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:01.491 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.488+0000 7ff8b0de06c0 1 -- 10.20.193.96:0/66198915 >> 10.20.193.96:0/66198915 conn(0x7ff8ac0ecb30 msgr2=0x7ff8ac10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:39:01.491 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.488+0000 7ff8b0de06c0 1 -- 10.20.193.96:0/66198915 shutdown_connections 2026-02-13T03:39:01.491 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:01.488+0000 7ff8b0de06c0 1 -- 10.20.193.96:0/66198915 wait complete. 2026-02-13T03:39:02.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:01 trial133 ceph-mon[26943]: pgmap v335: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:39:02.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:01 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/66198915' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:02.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:01 trial096 ceph-mon[24671]: pgmap v335: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:39:02.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:01 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/66198915' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:02.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:01 trial132 ceph-mon[26888]: pgmap v335: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:39:02.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:01 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/66198915' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:04.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:03 trial133 ceph-mon[26943]: pgmap v336: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:39:04.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:03 trial096 ceph-mon[24671]: pgmap v336: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:39:04.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:03 trial132 ceph-mon[26888]: pgmap v336: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:39:04.532 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:39:04.651 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:39:04.769 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.764+0000 7f0b0f2916c0 1 -- 10.20.193.96:0/1515390003 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0b0810f200 msgr2=0x7f0b0810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:04.769 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.764+0000 7f0b0f2916c0 1 --2- 10.20.193.96:0/1515390003 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0b0810f200 0x7f0b0810f5d0 secure :-1 s=READY pgs=485 gs=1 cs=0 l=1 c_cookie=17649177186662383469 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0af80099a0 tx=0x7f0af802ed20 comp rx=0 tx=0).stop 2026-02-13T03:39:04.769 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.764+0000 7f0b0f2916c0 1 -- 10.20.193.96:0/1515390003 shutdown_connections 2026-02-13T03:39:04.770 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.764+0000 7f0b0f2916c0 1 --2- 10.20.193.96:0/1515390003 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0b08115410 0x7f0b08175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:04.770 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.764+0000 7f0b0f2916c0 1 --2- 10.20.193.96:0/1515390003 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0b0810fbf0 0x7f0b08114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:04.770 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.764+0000 7f0b0f2916c0 1 --2- 10.20.193.96:0/1515390003 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0b0810f200 0x7f0b0810f5d0 unknown :-1 s=CLOSED pgs=485 gs=1 cs=0 l=1 c_cookie=17649177186662383469 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:04.770 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.764+0000 7f0b0f2916c0 1 -- 10.20.193.96:0/1515390003 >> 10.20.193.96:0/1515390003 conn(0x7f0b080ecb00 msgr2=0x7f0b0810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:39:04.770 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.764+0000 7f0b0f2916c0 1 -- 10.20.193.96:0/1515390003 shutdown_connections 2026-02-13T03:39:04.770 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.764+0000 7f0b0f2916c0 1 -- 10.20.193.96:0/1515390003 wait complete. 2026-02-13T03:39:04.770 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.764+0000 7f0b0f2916c0 1 Processor -- start 2026-02-13T03:39:04.770 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.765+0000 7f0b0f2916c0 1 -- start start 2026-02-13T03:39:04.770 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.765+0000 7f0b0f2916c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0b0810f200 0x7f0b0811d210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:04.770 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.765+0000 7f0b0f2916c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0b08115410 0x7f0b0811d750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:04.770 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.765+0000 7f0b0f2916c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0b08122b10 0x7f0b08122fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:04.770 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.765+0000 7f0b0f2916c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0b08123520 con 0x7f0b08122b10 2026-02-13T03:39:04.771 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.765+0000 7f0b0f2916c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0b08123690 con 0x7f0b08115410 2026-02-13T03:39:04.771 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.765+0000 7f0b0f2916c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0b08123850 con 0x7f0b0810f200 2026-02-13T03:39:04.771 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.765+0000 7f0b0d8036c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0b08122b10 0x7f0b08122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:04.771 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.765+0000 7f0b0d8036c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0b08122b10 0x7f0b08122fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:41930/0 (socket says 10.20.193.96:41930) 2026-02-13T03:39:04.771 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.765+0000 7f0b0d8036c0 1 -- 10.20.193.96:0/2483111345 learned_addr learned my addr 10.20.193.96:0/2483111345 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:39:04.771 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.765+0000 7f0b0d8036c0 1 -- 10.20.193.96:0/2483111345 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0b0810f200 msgr2=0x7f0b0811d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:04.771 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.765+0000 7f0b0d8036c0 1 --2- 10.20.193.96:0/2483111345 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0b0810f200 0x7f0b0811d210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:04.771 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.765+0000 7f0b0d8036c0 1 -- 10.20.193.96:0/2483111345 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0b08115410 msgr2=0x7f0b0811d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:04.771 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.765+0000 7f0b0d8036c0 1 --2- 10.20.193.96:0/2483111345 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0b08115410 0x7f0b0811d750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:04.771 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.765+0000 7f0b0d8036c0 1 -- 10.20.193.96:0/2483111345 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af8009590 con 0x7f0b08122b10 2026-02-13T03:39:04.771 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.765+0000 7f0b0d8036c0 1 --2- 10.20.193.96:0/2483111345 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0b08122b10 0x7f0b08122fb0 secure :-1 s=READY pgs=486 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b04006ea0 tx=0x7f0b0400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:39:04.771 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.765+0000 7f0af67fc6c0 1 -- 10.20.193.96:0/2483111345 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b04003a30 con 0x7f0b08122b10 2026-02-13T03:39:04.772 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.765+0000 7f0af67fc6c0 1 -- 10.20.193.96:0/2483111345 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f0b04005510 con 0x7f0b08122b10 2026-02-13T03:39:04.772 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.765+0000 7f0af67fc6c0 1 -- 10.20.193.96:0/2483111345 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b0400dd70 con 0x7f0b08122b10 2026-02-13T03:39:04.772 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.765+0000 7f0b0f2916c0 1 -- 10.20.193.96:0/2483111345 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b08163d00 con 0x7f0b08122b10 2026-02-13T03:39:04.772 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.765+0000 7f0b0f2916c0 1 -- 10.20.193.96:0/2483111345 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b08164190 con 0x7f0b08122b10 2026-02-13T03:39:04.772 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.765+0000 7f0b0f2916c0 1 -- 10.20.193.96:0/2483111345 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b081104d0 con 0x7f0b08122b10 2026-02-13T03:39:04.773 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.766+0000 7f0af67fc6c0 1 -- 10.20.193.96:0/2483111345 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f0b04003b90 con 0x7f0b08122b10 2026-02-13T03:39:04.773 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.767+0000 7f0af67fc6c0 1 --2- 10.20.193.96:0/2483111345 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f0ae40b5680 0x7f0ae40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:04.773 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.767+0000 7f0af67fc6c0 1 -- 10.20.193.96:0/2483111345 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f0b040e4b10 con 0x7f0b08122b10 2026-02-13T03:39:04.773 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.767+0000 7f0b0d0026c0 1 --2- 10.20.193.96:0/2483111345 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f0ae40b5680 0x7f0ae40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:04.773 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.767+0000 7f0b0d0026c0 1 --2- 10.20.193.96:0/2483111345 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f0ae40b5680 0x7f0ae40d5b30 secure :-1 s=READY pgs=307 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0af8005b40 tx=0x7f0af8005c20 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:39:04.773 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.768+0000 7f0af67fc6c0 1 -- 10.20.193.96:0/2483111345 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0b040a7570 con 0x7f0b08122b10 2026-02-13T03:39:04.885 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.882+0000 7f0b0f2916c0 1 -- 10.20.193.96:0/2483111345 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0b0810f5d0 con 0x7f0b08122b10 2026-02-13T03:39:04.885 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.882+0000 7f0af67fc6c0 1 -- 10.20.193.96:0/2483111345 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f0b040aa720 con 0x7f0b08122b10 2026-02-13T03:39:04.886 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:39:04.886 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:39:04.887 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.883+0000 7f0b0f2916c0 1 -- 10.20.193.96:0/2483111345 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f0ae40b5680 msgr2=0x7f0ae40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:04.887 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.883+0000 7f0b0f2916c0 1 --2- 10.20.193.96:0/2483111345 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f0ae40b5680 0x7f0ae40d5b30 secure :-1 s=READY pgs=307 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0af8005b40 tx=0x7f0af8005c20 comp rx=0 tx=0).stop 2026-02-13T03:39:04.887 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.883+0000 7f0b0f2916c0 1 -- 10.20.193.96:0/2483111345 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0b08122b10 msgr2=0x7f0b08122fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:04.887 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.883+0000 7f0b0f2916c0 1 --2- 10.20.193.96:0/2483111345 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0b08122b10 0x7f0b08122fb0 secure :-1 s=READY pgs=486 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b04006ea0 tx=0x7f0b0400cca0 comp rx=0 tx=0).stop 2026-02-13T03:39:04.887 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.883+0000 7f0b0f2916c0 1 -- 10.20.193.96:0/2483111345 shutdown_connections 2026-02-13T03:39:04.887 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.883+0000 7f0b0f2916c0 1 --2- 10.20.193.96:0/2483111345 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f0ae40b5680 0x7f0ae40d5b30 unknown :-1 s=CLOSED pgs=307 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:04.887 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.883+0000 7f0b0f2916c0 1 --2- 10.20.193.96:0/2483111345 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f0b08122b10 0x7f0b08122fb0 unknown :-1 s=CLOSED pgs=486 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:04.887 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.883+0000 7f0b0f2916c0 1 --2- 10.20.193.96:0/2483111345 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f0b08115410 0x7f0b0811d750 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:04.888 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.883+0000 7f0b0f2916c0 1 --2- 10.20.193.96:0/2483111345 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f0b0810f200 0x7f0b0811d210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:04.888 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.883+0000 7f0b0f2916c0 1 -- 10.20.193.96:0/2483111345 >> 10.20.193.96:0/2483111345 conn(0x7f0b080ecb00 msgr2=0x7f0b0810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:39:04.888 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.883+0000 7f0b0f2916c0 1 -- 10.20.193.96:0/2483111345 shutdown_connections 2026-02-13T03:39:04.888 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:04.883+0000 7f0b0f2916c0 1 -- 10.20.193.96:0/2483111345 wait complete. 2026-02-13T03:39:06.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:05 trial133 ceph-mon[26943]: pgmap v337: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:39:06.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:05 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2483111345' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:06.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:05 trial096 ceph-mon[24671]: pgmap v337: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:39:06.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:05 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2483111345' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:06.231 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:05 trial132 ceph-mon[26888]: pgmap v337: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:39:06.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:05 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2483111345' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:07.929 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:39:08.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:07 trial133 ceph-mon[26943]: pgmap v338: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:39:08.044 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:39:08.067 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:07 trial096 ceph-mon[24671]: pgmap v338: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:39:08.157 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.154+0000 7f181f8486c0 1 -- 10.20.193.96:0/1966604257 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f181810fc20 msgr2=0x7f1818114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:08.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.154+0000 7f181f8486c0 1 --2- 10.20.193.96:0/1966604257 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f181810fc20 0x7f1818114c60 secure :-1 s=READY pgs=487 gs=1 cs=0 l=1 c_cookie=15208187551155914400 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f180c0099a0 tx=0x7f180c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:39:08.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.154+0000 7f181f8486c0 1 -- 10.20.193.96:0/1966604257 shutdown_connections 2026-02-13T03:39:08.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.154+0000 7f181f8486c0 1 --2- 10.20.193.96:0/1966604257 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f1818115440 0x7f1818175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:08.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.154+0000 7f181f8486c0 1 --2- 10.20.193.96:0/1966604257 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f181810fc20 0x7f1818114c60 unknown :-1 s=CLOSED pgs=487 gs=1 cs=0 l=1 c_cookie=15208187551155914400 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:08.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.154+0000 7f181f8486c0 1 --2- 10.20.193.96:0/1966604257 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f181810f230 0x7f181810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:08.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.154+0000 7f181f8486c0 1 -- 10.20.193.96:0/1966604257 >> 10.20.193.96:0/1966604257 conn(0x7f18180ecb30 msgr2=0x7f181810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:39:08.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.154+0000 7f181f8486c0 1 -- 10.20.193.96:0/1966604257 shutdown_connections 2026-02-13T03:39:08.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.154+0000 7f181f8486c0 1 -- 10.20.193.96:0/1966604257 wait complete. 2026-02-13T03:39:08.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f181f8486c0 1 Processor -- start 2026-02-13T03:39:08.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f181f8486c0 1 -- start start 2026-02-13T03:39:08.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f181f8486c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f181810f230 0x7f18180f4ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:08.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f181f8486c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1818115440 0x7f1818175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:08.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f181f8486c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f18180f51d0 0x7f18180fa4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:08.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f181f8486c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f18180f58c0 con 0x7f18180f51d0 2026-02-13T03:39:08.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f181f8486c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f18180fa9e0 con 0x7f181810f230 2026-02-13T03:39:08.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f181f8486c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f18180faba0 con 0x7f1818115440 2026-02-13T03:39:08.158 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f181ddbe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f18180f51d0 0x7f18180fa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:08.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f181ddbe6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f18180f51d0 0x7f18180fa4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:41942/0 (socket says 10.20.193.96:41942) 2026-02-13T03:39:08.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f181ddbe6c0 1 -- 10.20.193.96:0/2629512224 learned_addr learned my addr 10.20.193.96:0/2629512224 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:39:08.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f181cdbc6c0 1 --2- 10.20.193.96:0/2629512224 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1818115440 0x7f1818175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:08.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f181d5bd6c0 1 --2- 10.20.193.96:0/2629512224 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f181810f230 0x7f18180f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:08.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f181ddbe6c0 1 -- 10.20.193.96:0/2629512224 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1818115440 msgr2=0x7f1818175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:08.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f181ddbe6c0 1 --2- 10.20.193.96:0/2629512224 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1818115440 0x7f1818175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:08.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f181ddbe6c0 1 -- 10.20.193.96:0/2629512224 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f181810f230 msgr2=0x7f18180f4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:08.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f181ddbe6c0 1 --2- 10.20.193.96:0/2629512224 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f181810f230 0x7f18180f4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:08.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f181ddbe6c0 1 -- 10.20.193.96:0/2629512224 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f180c009590 con 0x7f18180f51d0 2026-02-13T03:39:08.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f181d5bd6c0 1 --2- 10.20.193.96:0/2629512224 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f181810f230 0x7f18180f4ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:39:08.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f181ddbe6c0 1 --2- 10.20.193.96:0/2629512224 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f18180f51d0 0x7f18180fa4a0 secure :-1 s=READY pgs=488 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1814006ea0 tx=0x7f181400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:39:08.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f18067fc6c0 1 -- 10.20.193.96:0/2629512224 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1814003a30 con 0x7f18180f51d0 2026-02-13T03:39:08.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f18067fc6c0 1 -- 10.20.193.96:0/2629512224 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f1814005510 con 0x7f18180f51d0 2026-02-13T03:39:08.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f181f8486c0 1 -- 10.20.193.96:0/2629512224 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18180fae80 con 0x7f18180f51d0 2026-02-13T03:39:08.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f18067fc6c0 1 -- 10.20.193.96:0/2629512224 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f181400dd70 con 0x7f18180f51d0 2026-02-13T03:39:08.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.155+0000 7f181f8486c0 1 -- 10.20.193.96:0/2629512224 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18180fb610 con 0x7f18180f51d0 2026-02-13T03:39:08.159 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.156+0000 7f181f8486c0 1 -- 10.20.193.96:0/2629512224 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1818110500 con 0x7f18180f51d0 2026-02-13T03:39:08.160 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.157+0000 7f18067fc6c0 1 -- 10.20.193.96:0/2629512224 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f1814003b90 con 0x7f18180f51d0 2026-02-13T03:39:08.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.158+0000 7f18067fc6c0 1 --2- 10.20.193.96:0/2629512224 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f17f40b5680 0x7f17f40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:08.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.158+0000 7f181d5bd6c0 1 --2- 10.20.193.96:0/2629512224 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f17f40b5680 0x7f17f40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:08.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.158+0000 7f18067fc6c0 1 -- 10.20.193.96:0/2629512224 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f18140e4a80 con 0x7f18180f51d0 2026-02-13T03:39:08.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.158+0000 7f18067fc6c0 1 -- 10.20.193.96:0/2629512224 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f18140aa870 con 0x7f18180f51d0 2026-02-13T03:39:08.161 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.158+0000 7f181d5bd6c0 1 --2- 10.20.193.96:0/2629512224 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f17f40b5680 0x7f17f40d5b30 secure :-1 s=READY pgs=308 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1808004750 tx=0x7f1808005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:39:08.231 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:07 trial132 ceph-mon[26888]: pgmap v338: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:39:08.274 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.271+0000 7f181f8486c0 1 -- 10.20.193.96:0/2629512224 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f18180f5cf0 con 0x7f18180f51d0 2026-02-13T03:39:08.274 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.271+0000 7f18067fc6c0 1 -- 10.20.193.96:0/2629512224 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f18140aaa60 con 0x7f18180f51d0 2026-02-13T03:39:08.274 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:39:08.274 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:39:08.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.272+0000 7f181f8486c0 1 -- 10.20.193.96:0/2629512224 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f17f40b5680 msgr2=0x7f17f40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:08.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.272+0000 7f181f8486c0 1 --2- 10.20.193.96:0/2629512224 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f17f40b5680 0x7f17f40d5b30 secure :-1 s=READY pgs=308 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1808004750 tx=0x7f1808005f10 comp rx=0 tx=0).stop 2026-02-13T03:39:08.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.272+0000 7f181f8486c0 1 -- 10.20.193.96:0/2629512224 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f18180f51d0 msgr2=0x7f18180fa4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:08.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.272+0000 7f181f8486c0 1 --2- 10.20.193.96:0/2629512224 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f18180f51d0 0x7f18180fa4a0 secure :-1 s=READY pgs=488 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1814006ea0 tx=0x7f181400cca0 comp rx=0 tx=0).stop 2026-02-13T03:39:08.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.272+0000 7f181f8486c0 1 -- 10.20.193.96:0/2629512224 shutdown_connections 2026-02-13T03:39:08.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.272+0000 7f181f8486c0 1 --2- 10.20.193.96:0/2629512224 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f17f40b5680 0x7f17f40d5b30 unknown :-1 s=CLOSED pgs=308 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:08.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.272+0000 7f181f8486c0 1 --2- 10.20.193.96:0/2629512224 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f18180f51d0 0x7f18180fa4a0 unknown :-1 s=CLOSED pgs=488 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:08.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.272+0000 7f181f8486c0 1 --2- 10.20.193.96:0/2629512224 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1818115440 0x7f1818175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:08.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.272+0000 7f181f8486c0 1 --2- 10.20.193.96:0/2629512224 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f181810f230 0x7f18180f4ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:08.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.272+0000 7f181f8486c0 1 -- 10.20.193.96:0/2629512224 >> 10.20.193.96:0/2629512224 conn(0x7f18180ecb30 msgr2=0x7f1818113c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:39:08.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.272+0000 7f181f8486c0 1 -- 10.20.193.96:0/2629512224 shutdown_connections 2026-02-13T03:39:08.275 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:08.272+0000 7f181f8486c0 1 -- 10.20.193.96:0/2629512224 wait complete. 2026-02-13T03:39:09.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:08 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2629512224' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:09.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:08 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2629512224' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:09.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:08 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2629512224' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:10.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:09 trial133 ceph-mon[26943]: pgmap v339: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:39:10.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:09 trial096 ceph-mon[24671]: pgmap v339: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:39:10.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:09 trial132 ceph-mon[26888]: pgmap v339: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:39:11.315 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:39:11.432 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:39:11.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.540+0000 7f594cc986c0 1 -- 10.20.193.96:0/3142269635 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f594810fbf0 msgr2=0x7f5948114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:11.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.540+0000 7f594cc986c0 1 --2- 10.20.193.96:0/3142269635 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f594810fbf0 0x7f5948114c30 secure :-1 s=READY pgs=489 gs=1 cs=0 l=1 c_cookie=3798661032273283697 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59300099a0 tx=0x7f593002ed20 comp rx=0 tx=0).stop 2026-02-13T03:39:11.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.540+0000 7f594cc986c0 1 -- 10.20.193.96:0/3142269635 shutdown_connections 2026-02-13T03:39:11.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.540+0000 7f594cc986c0 1 --2- 10.20.193.96:0/3142269635 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5948115410 0x7f5948175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:11.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.540+0000 7f594cc986c0 1 --2- 10.20.193.96:0/3142269635 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f594810fbf0 0x7f5948114c30 unknown :-1 s=CLOSED pgs=489 gs=1 cs=0 l=1 c_cookie=3798661032273283697 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:11.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.541+0000 7f594cc986c0 1 --2- 10.20.193.96:0/3142269635 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f594810f200 0x7f594810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:11.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.541+0000 7f594cc986c0 1 -- 10.20.193.96:0/3142269635 >> 10.20.193.96:0/3142269635 conn(0x7f59480ecb00 msgr2=0x7f594810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:39:11.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.541+0000 7f594cc986c0 1 -- 10.20.193.96:0/3142269635 shutdown_connections 2026-02-13T03:39:11.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.541+0000 7f594cc986c0 1 -- 10.20.193.96:0/3142269635 wait complete. 2026-02-13T03:39:11.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.541+0000 7f594cc986c0 1 Processor -- start 2026-02-13T03:39:11.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.541+0000 7f594cc986c0 1 -- start start 2026-02-13T03:39:11.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.541+0000 7f594cc986c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f594810f200 0x7f594811d2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:11.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.541+0000 7f594cc986c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5948115410 0x7f594811d830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:11.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.541+0000 7f594cc986c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5948122bf0 0x7f5948123090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:11.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.541+0000 7f594cc986c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5948123600 con 0x7f5948122bf0 2026-02-13T03:39:11.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.541+0000 7f594cc986c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5948123770 con 0x7f5948115410 2026-02-13T03:39:11.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.541+0000 7f594cc986c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5948123930 con 0x7f594810f200 2026-02-13T03:39:11.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.541+0000 7f5946d766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5948122bf0 0x7f5948123090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:11.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.541+0000 7f5946d766c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5948122bf0 0x7f5948123090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:41962/0 (socket says 10.20.193.96:41962) 2026-02-13T03:39:11.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.541+0000 7f5946d766c0 1 -- 10.20.193.96:0/3828224001 learned_addr learned my addr 10.20.193.96:0/3828224001 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:39:11.544 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.541+0000 7f59465756c0 1 --2- 10.20.193.96:0/3828224001 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f594810f200 0x7f594811d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:11.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.541+0000 7f5945d746c0 1 --2- 10.20.193.96:0/3828224001 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5948115410 0x7f594811d830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:11.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.541+0000 7f5946d766c0 1 -- 10.20.193.96:0/3828224001 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f594810f200 msgr2=0x7f594811d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:11.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.541+0000 7f5946d766c0 1 --2- 10.20.193.96:0/3828224001 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f594810f200 0x7f594811d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:11.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.541+0000 7f5946d766c0 1 -- 10.20.193.96:0/3828224001 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5948115410 msgr2=0x7f594811d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:11.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.541+0000 7f5946d766c0 1 --2- 10.20.193.96:0/3828224001 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5948115410 0x7f594811d830 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:11.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.541+0000 7f5946d766c0 1 -- 10.20.193.96:0/3828224001 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5930009590 con 0x7f5948122bf0 2026-02-13T03:39:11.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.542+0000 7f5946d766c0 1 --2- 10.20.193.96:0/3828224001 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5948122bf0 0x7f5948123090 secure :-1 s=READY pgs=490 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5938006ea0 tx=0x7f593800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:39:11.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.542+0000 7f592f7fe6c0 1 -- 10.20.193.96:0/3828224001 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5938003a30 con 0x7f5948122bf0 2026-02-13T03:39:11.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.542+0000 7f592f7fe6c0 1 -- 10.20.193.96:0/3828224001 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f5938005510 con 0x7f5948122bf0 2026-02-13T03:39:11.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.542+0000 7f594cc986c0 1 -- 10.20.193.96:0/3828224001 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5948163de0 con 0x7f5948122bf0 2026-02-13T03:39:11.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.542+0000 7f592f7fe6c0 1 -- 10.20.193.96:0/3828224001 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f593800dd70 con 0x7f5948122bf0 2026-02-13T03:39:11.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.542+0000 7f594cc986c0 1 -- 10.20.193.96:0/3828224001 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5948164270 con 0x7f5948122bf0 2026-02-13T03:39:11.545 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.542+0000 7f594cc986c0 1 -- 10.20.193.96:0/3828224001 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59481104d0 con 0x7f5948122bf0 2026-02-13T03:39:11.546 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.543+0000 7f592f7fe6c0 1 -- 10.20.193.96:0/3828224001 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f5938003b90 con 0x7f5948122bf0 2026-02-13T03:39:11.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.544+0000 7f592f7fe6c0 1 --2- 10.20.193.96:0/3828224001 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f59200b5600 0x7f59200d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:11.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.544+0000 7f59465756c0 1 --2- 10.20.193.96:0/3828224001 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f59200b5600 0x7f59200d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:11.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.544+0000 7f592f7fe6c0 1 -- 10.20.193.96:0/3828224001 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f59380e49b0 con 0x7f5948122bf0 2026-02-13T03:39:11.547 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.545+0000 7f59465756c0 1 --2- 10.20.193.96:0/3828224001 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f59200b5600 0x7f59200d5ab0 secure :-1 s=READY pgs=309 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f593c004750 tx=0x7f593c009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:39:11.548 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.545+0000 7f592f7fe6c0 1 -- 10.20.193.96:0/3828224001 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f59380a7410 con 0x7f5948122bf0 2026-02-13T03:39:11.661 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.658+0000 7f594cc986c0 1 -- 10.20.193.96:0/3828224001 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f594810f5d0 con 0x7f5948122bf0 2026-02-13T03:39:11.662 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.658+0000 7f592f7fe6c0 1 -- 10.20.193.96:0/3828224001 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f59380aa5c0 con 0x7f5948122bf0 2026-02-13T03:39:11.662 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:39:11.662 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:39:11.663 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.660+0000 7f594cc986c0 1 -- 10.20.193.96:0/3828224001 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f59200b5600 msgr2=0x7f59200d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:11.663 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.660+0000 7f594cc986c0 1 --2- 10.20.193.96:0/3828224001 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f59200b5600 0x7f59200d5ab0 secure :-1 s=READY pgs=309 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f593c004750 tx=0x7f593c009260 comp rx=0 tx=0).stop 2026-02-13T03:39:11.663 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.660+0000 7f594cc986c0 1 -- 10.20.193.96:0/3828224001 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5948122bf0 msgr2=0x7f5948123090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:11.663 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.660+0000 7f594cc986c0 1 --2- 10.20.193.96:0/3828224001 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5948122bf0 0x7f5948123090 secure :-1 s=READY pgs=490 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5938006ea0 tx=0x7f593800cca0 comp rx=0 tx=0).stop 2026-02-13T03:39:11.663 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.660+0000 7f594cc986c0 1 -- 10.20.193.96:0/3828224001 shutdown_connections 2026-02-13T03:39:11.663 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.660+0000 7f594cc986c0 1 --2- 10.20.193.96:0/3828224001 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f59200b5600 0x7f59200d5ab0 unknown :-1 s=CLOSED pgs=309 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:11.663 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.660+0000 7f594cc986c0 1 --2- 10.20.193.96:0/3828224001 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f5948122bf0 0x7f5948123090 unknown :-1 s=CLOSED pgs=490 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:11.663 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.660+0000 7f594cc986c0 1 --2- 10.20.193.96:0/3828224001 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f5948115410 0x7f594811d830 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:11.663 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.660+0000 7f594cc986c0 1 --2- 10.20.193.96:0/3828224001 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f594810f200 0x7f594811d2f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:11.663 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.660+0000 7f594cc986c0 1 -- 10.20.193.96:0/3828224001 >> 10.20.193.96:0/3828224001 conn(0x7f59480ecb00 msgr2=0x7f594810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:39:11.663 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.660+0000 7f594cc986c0 1 -- 10.20.193.96:0/3828224001 shutdown_connections 2026-02-13T03:39:11.663 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:11.660+0000 7f594cc986c0 1 -- 10.20.193.96:0/3828224001 wait complete. 2026-02-13T03:39:11.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:11 trial096 ceph-mon[24671]: pgmap v340: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:39:11.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:11 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3828224001' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:12.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:11 trial133 ceph-mon[26943]: pgmap v340: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:39:12.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:11 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3828224001' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:12.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:11 trial132 ceph-mon[26888]: pgmap v340: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:39:12.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:11 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3828224001' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:14.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:13 trial133 ceph-mon[26943]: pgmap v341: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:39:14.034 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:13 trial132 ceph-mon[26888]: pgmap v341: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:39:14.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:13 trial096 ceph-mon[24671]: pgmap v341: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:39:14.716 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:39:14.835 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:39:14.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.947+0000 7f144bc9b6c0 1 -- 10.20.193.96:0/3813949647 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f144410fc20 msgr2=0x7f1444114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:14.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.947+0000 7f144bc9b6c0 1 --2- 10.20.193.96:0/3813949647 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f144410fc20 0x7f1444114c60 secure :-1 s=READY pgs=491 gs=1 cs=0 l=1 c_cookie=8684945927877248529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14380099a0 tx=0x7f143802ed20 comp rx=0 tx=0).stop 2026-02-13T03:39:14.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.947+0000 7f144bc9b6c0 1 -- 10.20.193.96:0/3813949647 shutdown_connections 2026-02-13T03:39:14.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.947+0000 7f144bc9b6c0 1 --2- 10.20.193.96:0/3813949647 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1444115440 0x7f1444175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:14.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.947+0000 7f144bc9b6c0 1 --2- 10.20.193.96:0/3813949647 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f144410fc20 0x7f1444114c60 unknown :-1 s=CLOSED pgs=491 gs=1 cs=0 l=1 c_cookie=8684945927877248529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:14.951 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.947+0000 7f144bc9b6c0 1 --2- 10.20.193.96:0/3813949647 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f144410f230 0x7f144410f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:14.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.947+0000 7f144bc9b6c0 1 -- 10.20.193.96:0/3813949647 >> 10.20.193.96:0/3813949647 conn(0x7f14440ecb30 msgr2=0x7f144410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:39:14.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.947+0000 7f144bc9b6c0 1 -- 10.20.193.96:0/3813949647 shutdown_connections 2026-02-13T03:39:14.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.947+0000 7f144bc9b6c0 1 -- 10.20.193.96:0/3813949647 wait complete. 2026-02-13T03:39:14.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.947+0000 7f144bc9b6c0 1 Processor -- start 2026-02-13T03:39:14.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.947+0000 7f144bc9b6c0 1 -- start start 2026-02-13T03:39:14.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.947+0000 7f144bc9b6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f144410f230 0x7f144411d210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:14.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.947+0000 7f144bc9b6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1444115440 0x7f144411d750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:14.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.947+0000 7f144bc9b6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1444122b10 0x7f1444122fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:14.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.947+0000 7f144bc9b6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1444123520 con 0x7f1444115440 2026-02-13T03:39:14.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.947+0000 7f144bc9b6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1444123690 con 0x7f144410f230 2026-02-13T03:39:14.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.947+0000 7f144bc9b6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1444123850 con 0x7f1444122b10 2026-02-13T03:39:14.952 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.947+0000 7f144920b6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1444115440 0x7f144411d750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:14.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.947+0000 7f144920b6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1444115440 0x7f144411d750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:48498/0 (socket says 10.20.193.96:48498) 2026-02-13T03:39:14.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.947+0000 7f144920b6c0 1 -- 10.20.193.96:0/1997673146 learned_addr learned my addr 10.20.193.96:0/1997673146 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:39:14.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.947+0000 7f1449a0c6c0 1 --2- 10.20.193.96:0/1997673146 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f144410f230 0x7f144411d210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:14.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.948+0000 7f144920b6c0 1 -- 10.20.193.96:0/1997673146 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1444122b10 msgr2=0x7f1444122fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:14.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.948+0000 7f144920b6c0 1 --2- 10.20.193.96:0/1997673146 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1444122b10 0x7f1444122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:14.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.948+0000 7f144920b6c0 1 -- 10.20.193.96:0/1997673146 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f144410f230 msgr2=0x7f144411d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:14.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.948+0000 7f144920b6c0 1 --2- 10.20.193.96:0/1997673146 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f144410f230 0x7f144411d210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:14.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.948+0000 7f144920b6c0 1 -- 10.20.193.96:0/1997673146 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1438009590 con 0x7f1444115440 2026-02-13T03:39:14.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.948+0000 7f144920b6c0 1 --2- 10.20.193.96:0/1997673146 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1444115440 0x7f144411d750 secure :-1 s=READY pgs=492 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f143802f230 tx=0x7f143802fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:39:14.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.948+0000 7f1432ffd6c0 1 -- 10.20.193.96:0/1997673146 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1438002ae0 con 0x7f1444115440 2026-02-13T03:39:14.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.948+0000 7f1432ffd6c0 1 -- 10.20.193.96:0/1997673146 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f1438002c40 con 0x7f1444115440 2026-02-13T03:39:14.953 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.948+0000 7f144bc9b6c0 1 -- 10.20.193.96:0/1997673146 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1444163ca0 con 0x7f1444115440 2026-02-13T03:39:14.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.948+0000 7f1432ffd6c0 1 -- 10.20.193.96:0/1997673146 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14380312b0 con 0x7f1444115440 2026-02-13T03:39:14.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.948+0000 7f144bc9b6c0 1 -- 10.20.193.96:0/1997673146 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14441640d0 con 0x7f1444115440 2026-02-13T03:39:14.954 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.948+0000 7f144bc9b6c0 1 -- 10.20.193.96:0/1997673146 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1444110500 con 0x7f1444115440 2026-02-13T03:39:14.955 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.949+0000 7f1432ffd6c0 1 -- 10.20.193.96:0/1997673146 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f1438007980 con 0x7f1444115440 2026-02-13T03:39:14.955 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.950+0000 7f1432ffd6c0 1 --2- 10.20.193.96:0/1997673146 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f14200b5600 0x7f14200d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:14.955 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.950+0000 7f1449a0c6c0 1 --2- 10.20.193.96:0/1997673146 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f14200b5600 0x7f14200d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:14.955 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.951+0000 7f1432ffd6c0 1 -- 10.20.193.96:0/1997673146 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f1438107ce0 con 0x7f1444115440 2026-02-13T03:39:14.955 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.951+0000 7f1449a0c6c0 1 --2- 10.20.193.96:0/1997673146 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f14200b5600 0x7f14200d5ab0 secure :-1 s=READY pgs=310 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1434005980 tx=0x7f1434005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:39:14.955 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:14.951+0000 7f1432ffd6c0 1 -- 10.20.193.96:0/1997673146 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1438108160 con 0x7f1444115440 2026-02-13T03:39:15.067 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:15.065+0000 7f144bc9b6c0 1 -- 10.20.193.96:0/1997673146 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f144410f600 con 0x7f1444115440 2026-02-13T03:39:15.067 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:15.065+0000 7f1432ffd6c0 1 -- 10.20.193.96:0/1997673146 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f14380ca740 con 0x7f1444115440 2026-02-13T03:39:15.068 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:39:15.068 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:39:15.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:15.066+0000 7f144bc9b6c0 1 -- 10.20.193.96:0/1997673146 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f14200b5600 msgr2=0x7f14200d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:15.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:15.066+0000 7f144bc9b6c0 1 --2- 10.20.193.96:0/1997673146 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f14200b5600 0x7f14200d5ab0 secure :-1 s=READY pgs=310 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1434005980 tx=0x7f1434005910 comp rx=0 tx=0).stop 2026-02-13T03:39:15.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:15.066+0000 7f144bc9b6c0 1 -- 10.20.193.96:0/1997673146 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1444115440 msgr2=0x7f144411d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:15.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:15.066+0000 7f144bc9b6c0 1 --2- 10.20.193.96:0/1997673146 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1444115440 0x7f144411d750 secure :-1 s=READY pgs=492 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f143802f230 tx=0x7f143802fc60 comp rx=0 tx=0).stop 2026-02-13T03:39:15.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:15.066+0000 7f144bc9b6c0 1 -- 10.20.193.96:0/1997673146 shutdown_connections 2026-02-13T03:39:15.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:15.066+0000 7f144bc9b6c0 1 --2- 10.20.193.96:0/1997673146 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f14200b5600 0x7f14200d5ab0 unknown :-1 s=CLOSED pgs=310 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:15.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:15.066+0000 7f144bc9b6c0 1 --2- 10.20.193.96:0/1997673146 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f1444122b10 0x7f1444122fb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:15.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:15.066+0000 7f144bc9b6c0 1 --2- 10.20.193.96:0/1997673146 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f1444115440 0x7f144411d750 unknown :-1 s=CLOSED pgs=492 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:15.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:15.066+0000 7f144bc9b6c0 1 --2- 10.20.193.96:0/1997673146 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f144410f230 0x7f144411d210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:15.069 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:15.066+0000 7f144bc9b6c0 1 -- 10.20.193.96:0/1997673146 >> 10.20.193.96:0/1997673146 conn(0x7f14440ecb30 msgr2=0x7f144410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:39:15.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:15.066+0000 7f144bc9b6c0 1 -- 10.20.193.96:0/1997673146 shutdown_connections 2026-02-13T03:39:15.070 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:15.066+0000 7f144bc9b6c0 1 -- 10.20.193.96:0/1997673146 wait complete. 2026-02-13T03:39:16.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:15 trial133 ceph-mon[26943]: pgmap v342: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:39:16.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:15 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1997673146' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:16.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:15 trial096 ceph-mon[24671]: pgmap v342: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:39:16.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:15 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1997673146' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:16.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:15 trial132 ceph-mon[26888]: pgmap v342: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T03:39:16.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:15 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1997673146' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:18.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:17 trial133 ceph-mon[26943]: pgmap v343: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:39:18.110 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:39:18.135 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:17 trial096 ceph-mon[24671]: pgmap v343: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:39:18.228 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:39:18.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:17 trial132 ceph-mon[26888]: pgmap v343: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T03:39:18.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.341+0000 7f7241f9c6c0 1 -- 10.20.193.96:0/3336609090 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f723c10fbf0 msgr2=0x7f723c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:18.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.341+0000 7f7241f9c6c0 1 --2- 10.20.193.96:0/3336609090 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f723c10fbf0 0x7f723c114c30 secure :-1 s=READY pgs=493 gs=1 cs=0 l=1 c_cookie=5271798844706512464 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f722c0099a0 tx=0x7f722c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:39:18.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f7241f9c6c0 1 -- 10.20.193.96:0/3336609090 shutdown_connections 2026-02-13T03:39:18.346 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f7241f9c6c0 1 --2- 10.20.193.96:0/3336609090 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f723c115410 0x7f723c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:18.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f7241f9c6c0 1 --2- 10.20.193.96:0/3336609090 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f723c10fbf0 0x7f723c114c30 unknown :-1 s=CLOSED pgs=493 gs=1 cs=0 l=1 c_cookie=5271798844706512464 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:18.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f7241f9c6c0 1 --2- 10.20.193.96:0/3336609090 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f723c10f200 0x7f723c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:18.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f7241f9c6c0 1 -- 10.20.193.96:0/3336609090 >> 10.20.193.96:0/3336609090 conn(0x7f723c0ecb00 msgr2=0x7f723c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:39:18.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f7241f9c6c0 1 -- 10.20.193.96:0/3336609090 shutdown_connections 2026-02-13T03:39:18.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f7241f9c6c0 1 -- 10.20.193.96:0/3336609090 wait complete. 2026-02-13T03:39:18.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f7241f9c6c0 1 Processor -- start 2026-02-13T03:39:18.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f7241f9c6c0 1 -- start start 2026-02-13T03:39:18.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f7241f9c6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f723c10f200 0x7f723c11d2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:18.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f7241f9c6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f723c115410 0x7f723c11d7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:18.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f7241f9c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f723c122bb0 0x7f723c123050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:18.347 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f7241f9c6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f723c1235c0 con 0x7f723c122bb0 2026-02-13T03:39:18.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f7241f9c6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f723c123730 con 0x7f723c10f200 2026-02-13T03:39:18.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f7241f9c6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f723c1238f0 con 0x7f723c115410 2026-02-13T03:39:18.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f723bfff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f723c122bb0 0x7f723c123050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:18.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f723bfff6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f723c122bb0 0x7f723c123050 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:48510/0 (socket says 10.20.193.96:48510) 2026-02-13T03:39:18.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f723bfff6c0 1 -- 10.20.193.96:0/2526875455 learned_addr learned my addr 10.20.193.96:0/2526875455 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:39:18.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f723b7fe6c0 1 --2- 10.20.193.96:0/2526875455 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f723c10f200 0x7f723c11d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:18.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f723affd6c0 1 --2- 10.20.193.96:0/2526875455 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f723c115410 0x7f723c11d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:18.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f723bfff6c0 1 -- 10.20.193.96:0/2526875455 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f723c115410 msgr2=0x7f723c11d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:18.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f723bfff6c0 1 --2- 10.20.193.96:0/2526875455 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f723c115410 0x7f723c11d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:18.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f723bfff6c0 1 -- 10.20.193.96:0/2526875455 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f723c10f200 msgr2=0x7f723c11d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:18.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f723bfff6c0 1 --2- 10.20.193.96:0/2526875455 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f723c10f200 0x7f723c11d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:18.348 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f723bfff6c0 1 -- 10.20.193.96:0/2526875455 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f722c009590 con 0x7f723c122bb0 2026-02-13T03:39:18.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f723affd6c0 1 --2- 10.20.193.96:0/2526875455 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f723c115410 0x7f723c11d7f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:39:18.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.342+0000 7f723bfff6c0 1 --2- 10.20.193.96:0/2526875455 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f723c122bb0 0x7f723c123050 secure :-1 s=READY pgs=494 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7230006ea0 tx=0x7f723000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:39:18.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.343+0000 7f7238ff96c0 1 -- 10.20.193.96:0/2526875455 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7230003a30 con 0x7f723c122bb0 2026-02-13T03:39:18.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.343+0000 7f7241f9c6c0 1 -- 10.20.193.96:0/2526875455 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f723c163da0 con 0x7f723c122bb0 2026-02-13T03:39:18.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.343+0000 7f7238ff96c0 1 -- 10.20.193.96:0/2526875455 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f7230005510 con 0x7f723c122bb0 2026-02-13T03:39:18.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.343+0000 7f7238ff96c0 1 -- 10.20.193.96:0/2526875455 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f723000dd70 con 0x7f723c122bb0 2026-02-13T03:39:18.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.343+0000 7f7241f9c6c0 1 -- 10.20.193.96:0/2526875455 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f723c164230 con 0x7f723c122bb0 2026-02-13T03:39:18.349 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.343+0000 7f7241f9c6c0 1 -- 10.20.193.96:0/2526875455 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f723c1104d0 con 0x7f723c122bb0 2026-02-13T03:39:18.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.344+0000 7f7238ff96c0 1 -- 10.20.193.96:0/2526875455 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f7230003b90 con 0x7f723c122bb0 2026-02-13T03:39:18.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.345+0000 7f7238ff96c0 1 --2- 10.20.193.96:0/2526875455 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f72100b5600 0x7f72100d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:18.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.345+0000 7f7238ff96c0 1 -- 10.20.193.96:0/2526875455 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f72300e4b70 con 0x7f723c122bb0 2026-02-13T03:39:18.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.345+0000 7f723b7fe6c0 1 --2- 10.20.193.96:0/2526875455 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f72100b5600 0x7f72100d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:18.350 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.345+0000 7f7238ff96c0 1 -- 10.20.193.96:0/2526875455 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f72300a75d0 con 0x7f723c122bb0 2026-02-13T03:39:18.351 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.345+0000 7f723b7fe6c0 1 --2- 10.20.193.96:0/2526875455 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f72100b5600 0x7f72100d5ab0 secure :-1 s=READY pgs=311 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7228005980 tx=0x7f7228005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:39:18.463 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.460+0000 7f7241f9c6c0 1 -- 10.20.193.96:0/2526875455 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f723c10f5d0 con 0x7f723c122bb0 2026-02-13T03:39:18.463 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.460+0000 7f7238ff96c0 1 -- 10.20.193.96:0/2526875455 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f72300aa780 con 0x7f723c122bb0 2026-02-13T03:39:18.463 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:39:18.463 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:39:18.465 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.462+0000 7f7241f9c6c0 1 -- 10.20.193.96:0/2526875455 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f72100b5600 msgr2=0x7f72100d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:18.465 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.462+0000 7f7241f9c6c0 1 --2- 10.20.193.96:0/2526875455 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f72100b5600 0x7f72100d5ab0 secure :-1 s=READY pgs=311 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7228005980 tx=0x7f7228005910 comp rx=0 tx=0).stop 2026-02-13T03:39:18.465 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.462+0000 7f7241f9c6c0 1 -- 10.20.193.96:0/2526875455 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f723c122bb0 msgr2=0x7f723c123050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:18.465 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.462+0000 7f7241f9c6c0 1 --2- 10.20.193.96:0/2526875455 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f723c122bb0 0x7f723c123050 secure :-1 s=READY pgs=494 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7230006ea0 tx=0x7f723000cca0 comp rx=0 tx=0).stop 2026-02-13T03:39:18.465 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.462+0000 7f7241f9c6c0 1 -- 10.20.193.96:0/2526875455 shutdown_connections 2026-02-13T03:39:18.465 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.462+0000 7f7241f9c6c0 1 --2- 10.20.193.96:0/2526875455 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f72100b5600 0x7f72100d5ab0 unknown :-1 s=CLOSED pgs=311 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:18.465 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.462+0000 7f7241f9c6c0 1 --2- 10.20.193.96:0/2526875455 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f723c122bb0 0x7f723c123050 unknown :-1 s=CLOSED pgs=494 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:18.465 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.462+0000 7f7241f9c6c0 1 --2- 10.20.193.96:0/2526875455 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f723c115410 0x7f723c11d7f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:18.465 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.462+0000 7f7241f9c6c0 1 --2- 10.20.193.96:0/2526875455 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f723c10f200 0x7f723c11d2b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:18.465 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.462+0000 7f7241f9c6c0 1 -- 10.20.193.96:0/2526875455 >> 10.20.193.96:0/2526875455 conn(0x7f723c0ecb00 msgr2=0x7f723c10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:39:18.465 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.462+0000 7f7241f9c6c0 1 -- 10.20.193.96:0/2526875455 shutdown_connections 2026-02-13T03:39:18.466 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:18.462+0000 7f7241f9c6c0 1 -- 10.20.193.96:0/2526875455 wait complete. 2026-02-13T03:39:19.013 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:39:19.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:18 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/2526875455' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:19.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:39:19.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:39:19.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:39:19.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:39:19.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:39:19.014 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:18 trial133 ceph-mon[26943]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:39:19.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:39:19.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:18 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/2526875455' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:19.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:39:19.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:39:19.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:39:19.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:39:19.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:39:19.175 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:18 trial096 ceph-mon[24671]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:39:19.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:39:19.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:18 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/2526875455' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:19.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:39:19.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:39:19.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' 2026-02-13T03:39:19.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:39:19.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:39:19.233 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:18 trial132 ceph-mon[26888]: from='mgr.14116 10.20.193.96:0/185383864' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:39:20.075 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:19 trial096 ceph-mon[24671]: pgmap v344: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:39:20.075 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:19 trial096 ceph-mon[24671]: pgmap v345: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T03:39:20.076 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:19 trial096 ceph-mon[24671]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:39:20.076 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:19 trial096 ceph-mon[24671]: Cluster is now healthy 2026-02-13T03:39:20.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:19 trial132 ceph-mon[26888]: pgmap v344: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:39:20.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:19 trial132 ceph-mon[26888]: pgmap v345: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T03:39:20.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:19 trial132 ceph-mon[26888]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:39:20.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:19 trial132 ceph-mon[26888]: Cluster is now healthy 2026-02-13T03:39:20.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:19 trial133 ceph-mon[26943]: pgmap v344: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T03:39:20.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:19 trial133 ceph-mon[26943]: pgmap v345: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T03:39:20.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:19 trial133 ceph-mon[26943]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:39:20.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:19 trial133 ceph-mon[26943]: Cluster is now healthy 2026-02-13T03:39:21.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:20 trial096 ceph-mon[24671]: pgmap v346: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s rd, 3 op/s 2026-02-13T03:39:21.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:20 trial096 ceph-mon[24671]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:39:21.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:20 trial132 ceph-mon[26888]: pgmap v346: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s rd, 3 op/s 2026-02-13T03:39:21.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:20 trial132 ceph-mon[26888]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:39:21.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:20 trial133 ceph-mon[26943]: pgmap v346: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s rd, 3 op/s 2026-02-13T03:39:21.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:20 trial133 ceph-mon[26943]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:39:21.508 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:39:21.628 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:39:21.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.742+0000 7f02d00846c0 1 -- 10.20.193.96:0/3421655228 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f02c810f200 msgr2=0x7f02c810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:21.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.742+0000 7f02d00846c0 1 --2- 10.20.193.96:0/3421655228 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f02c810f200 0x7f02c810f5d0 secure :-1 s=READY pgs=495 gs=1 cs=0 l=1 c_cookie=5389120421589360549 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02b80099a0 tx=0x7f02b802ed20 comp rx=0 tx=0).stop 2026-02-13T03:39:21.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.742+0000 7f02d00846c0 1 -- 10.20.193.96:0/3421655228 shutdown_connections 2026-02-13T03:39:21.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.742+0000 7f02d00846c0 1 --2- 10.20.193.96:0/3421655228 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f02c8115410 0x7f02c8175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:21.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.742+0000 7f02d00846c0 1 --2- 10.20.193.96:0/3421655228 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f02c810fbf0 0x7f02c8114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:21.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.742+0000 7f02d00846c0 1 --2- 10.20.193.96:0/3421655228 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f02c810f200 0x7f02c810f5d0 unknown :-1 s=CLOSED pgs=495 gs=1 cs=0 l=1 c_cookie=5389120421589360549 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:21.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.742+0000 7f02d00846c0 1 -- 10.20.193.96:0/3421655228 >> 10.20.193.96:0/3421655228 conn(0x7f02c80ecb00 msgr2=0x7f02c810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:39:21.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.742+0000 7f02d00846c0 1 -- 10.20.193.96:0/3421655228 shutdown_connections 2026-02-13T03:39:21.747 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.742+0000 7f02d00846c0 1 -- 10.20.193.96:0/3421655228 wait complete. 2026-02-13T03:39:21.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.743+0000 7f02d00846c0 1 Processor -- start 2026-02-13T03:39:21.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.743+0000 7f02d00846c0 1 -- start start 2026-02-13T03:39:21.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.743+0000 7f02d00846c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f02c810f200 0x7f02c811d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:21.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.743+0000 7f02d00846c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f02c8115410 0x7f02c811d7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:21.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.743+0000 7f02d00846c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f02c8122b60 0x7f02c8123000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:21.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.743+0000 7f02d00846c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f02c8123570 con 0x7f02c810f200 2026-02-13T03:39:21.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.743+0000 7f02d00846c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f02c81236e0 con 0x7f02c8115410 2026-02-13T03:39:21.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.743+0000 7f02d00846c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f02c81238a0 con 0x7f02c8122b60 2026-02-13T03:39:21.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.743+0000 7f02cddf56c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f02c810f200 0x7f02c811d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:21.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.743+0000 7f02cddf56c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f02c810f200 0x7f02c811d260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:48532/0 (socket says 10.20.193.96:48532) 2026-02-13T03:39:21.748 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.743+0000 7f02cddf56c0 1 -- 10.20.193.96:0/285468291 learned_addr learned my addr 10.20.193.96:0/285468291 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:39:21.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.743+0000 7f02cd5f46c0 1 --2- 10.20.193.96:0/285468291 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f02c8115410 0x7f02c811d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:21.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.743+0000 7f02cddf56c0 1 -- 10.20.193.96:0/285468291 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f02c8122b60 msgr2=0x7f02c8123000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:21.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.743+0000 7f02cddf56c0 1 --2- 10.20.193.96:0/285468291 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f02c8122b60 0x7f02c8123000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:21.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.743+0000 7f02cddf56c0 1 -- 10.20.193.96:0/285468291 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f02c8115410 msgr2=0x7f02c811d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:21.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.743+0000 7f02cddf56c0 1 --2- 10.20.193.96:0/285468291 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f02c8115410 0x7f02c811d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:21.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.743+0000 7f02cddf56c0 1 -- 10.20.193.96:0/285468291 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b8009590 con 0x7f02c810f200 2026-02-13T03:39:21.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.743+0000 7f02cddf56c0 1 --2- 10.20.193.96:0/285468291 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f02c810f200 0x7f02c811d260 secure :-1 s=READY pgs=496 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02b80098c0 tx=0x7f02b80047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:39:21.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.743+0000 7f02b6ffd6c0 1 -- 10.20.193.96:0/285468291 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f02b8002ae0 con 0x7f02c810f200 2026-02-13T03:39:21.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.743+0000 7f02b6ffd6c0 1 -- 10.20.193.96:0/285468291 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f02b8002c40 con 0x7f02c810f200 2026-02-13T03:39:21.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.743+0000 7f02b6ffd6c0 1 -- 10.20.193.96:0/285468291 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f02b80372f0 con 0x7f02c810f200 2026-02-13T03:39:21.749 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.743+0000 7f02d00846c0 1 -- 10.20.193.96:0/285468291 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c8163cf0 con 0x7f02c810f200 2026-02-13T03:39:21.750 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.743+0000 7f02d00846c0 1 -- 10.20.193.96:0/285468291 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c8164120 con 0x7f02c810f200 2026-02-13T03:39:21.750 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.744+0000 7f02d00846c0 1 -- 10.20.193.96:0/285468291 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02c81104d0 con 0x7f02c810f200 2026-02-13T03:39:21.751 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.745+0000 7f02b6ffd6c0 1 -- 10.20.193.96:0/285468291 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f02b8007960 con 0x7f02c810f200 2026-02-13T03:39:21.751 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.746+0000 7f02b6ffd6c0 1 --2- 10.20.193.96:0/285468291 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f02a40b5600 0x7f02a40d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:21.751 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.746+0000 7f02b6ffd6c0 1 -- 10.20.193.96:0/285468291 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f02b8107cf0 con 0x7f02c810f200 2026-02-13T03:39:21.751 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.746+0000 7f02cd5f46c0 1 --2- 10.20.193.96:0/285468291 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f02a40b5600 0x7f02a40d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:21.751 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.746+0000 7f02cd5f46c0 1 --2- 10.20.193.96:0/285468291 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f02a40b5600 0x7f02a40d5ab0 secure :-1 s=READY pgs=312 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02c8123bf0 tx=0x7f02bc005ee0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:39:21.751 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.746+0000 7f02b6ffd6c0 1 -- 10.20.193.96:0/285468291 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f02b80ca750 con 0x7f02c810f200 2026-02-13T03:39:21.864 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.862+0000 7f02d00846c0 1 -- 10.20.193.96:0/285468291 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f02c810f5d0 con 0x7f02c810f200 2026-02-13T03:39:21.865 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.863+0000 7f02b6ffd6c0 1 -- 10.20.193.96:0/285468291 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f02b8002db0 con 0x7f02c810f200 2026-02-13T03:39:21.865 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:39:21.865 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:39:21.866 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.864+0000 7f02d00846c0 1 -- 10.20.193.96:0/285468291 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f02a40b5600 msgr2=0x7f02a40d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:21.867 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.864+0000 7f02d00846c0 1 --2- 10.20.193.96:0/285468291 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f02a40b5600 0x7f02a40d5ab0 secure :-1 s=READY pgs=312 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02c8123bf0 tx=0x7f02bc005ee0 comp rx=0 tx=0).stop 2026-02-13T03:39:21.867 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.864+0000 7f02d00846c0 1 -- 10.20.193.96:0/285468291 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f02c810f200 msgr2=0x7f02c811d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:21.867 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.864+0000 7f02d00846c0 1 --2- 10.20.193.96:0/285468291 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f02c810f200 0x7f02c811d260 secure :-1 s=READY pgs=496 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02b80098c0 tx=0x7f02b80047f0 comp rx=0 tx=0).stop 2026-02-13T03:39:21.867 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.864+0000 7f02d00846c0 1 -- 10.20.193.96:0/285468291 shutdown_connections 2026-02-13T03:39:21.867 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.864+0000 7f02d00846c0 1 --2- 10.20.193.96:0/285468291 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f02a40b5600 0x7f02a40d5ab0 unknown :-1 s=CLOSED pgs=312 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:21.867 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.864+0000 7f02d00846c0 1 --2- 10.20.193.96:0/285468291 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f02c8122b60 0x7f02c8123000 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:21.867 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.864+0000 7f02d00846c0 1 --2- 10.20.193.96:0/285468291 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f02c8115410 0x7f02c811d7a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:21.867 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.864+0000 7f02d00846c0 1 --2- 10.20.193.96:0/285468291 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f02c810f200 0x7f02c811d260 unknown :-1 s=CLOSED pgs=496 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:21.867 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.864+0000 7f02d00846c0 1 -- 10.20.193.96:0/285468291 >> 10.20.193.96:0/285468291 conn(0x7f02c80ecb00 msgr2=0x7f02c810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:39:21.867 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.864+0000 7f02d00846c0 1 -- 10.20.193.96:0/285468291 shutdown_connections 2026-02-13T03:39:21.868 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:21.864+0000 7f02d00846c0 1 -- 10.20.193.96:0/285468291 wait complete. 2026-02-13T03:39:23.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:22 trial096 ceph-mon[24671]: pgmap v347: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:39:23.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:22 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/285468291' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:23.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:22 trial132 ceph-mon[26888]: pgmap v347: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:39:23.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:22 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/285468291' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:23.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:22 trial133 ceph-mon[26943]: pgmap v347: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:39:23.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:22 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/285468291' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:24.910 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:39:25.028 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:39:25.051 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:24 trial096 ceph-mon[24671]: pgmap v348: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:39:25.144 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.140+0000 7fe8ed1746c0 1 -- 10.20.193.96:0/1478688843 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe8e810f200 msgr2=0x7fe8e810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:25.144 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.140+0000 7fe8ed1746c0 1 --2- 10.20.193.96:0/1478688843 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe8e810f200 0x7fe8e810f5d0 secure :-1 s=READY pgs=497 gs=1 cs=0 l=1 c_cookie=10895796632903474721 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8dc0099a0 tx=0x7fe8dc02ed20 comp rx=0 tx=0).stop 2026-02-13T03:39:25.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.140+0000 7fe8ed1746c0 1 -- 10.20.193.96:0/1478688843 shutdown_connections 2026-02-13T03:39:25.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.140+0000 7fe8ed1746c0 1 --2- 10.20.193.96:0/1478688843 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe8e8115410 0x7fe8e8175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:25.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.140+0000 7fe8ed1746c0 1 --2- 10.20.193.96:0/1478688843 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe8e810fbf0 0x7fe8e8114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:25.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.140+0000 7fe8ed1746c0 1 --2- 10.20.193.96:0/1478688843 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe8e810f200 0x7fe8e810f5d0 unknown :-1 s=CLOSED pgs=497 gs=1 cs=0 l=1 c_cookie=10895796632903474721 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:25.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.140+0000 7fe8ed1746c0 1 -- 10.20.193.96:0/1478688843 >> 10.20.193.96:0/1478688843 conn(0x7fe8e80ecb00 msgr2=0x7fe8e810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:39:25.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.140+0000 7fe8ed1746c0 1 -- 10.20.193.96:0/1478688843 shutdown_connections 2026-02-13T03:39:25.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.140+0000 7fe8ed1746c0 1 -- 10.20.193.96:0/1478688843 wait complete. 2026-02-13T03:39:25.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.140+0000 7fe8ed1746c0 1 Processor -- start 2026-02-13T03:39:25.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.140+0000 7fe8ed1746c0 1 -- start start 2026-02-13T03:39:25.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.141+0000 7fe8ed1746c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe8e810f200 0x7fe8e811d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:25.145 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.141+0000 7fe8ed1746c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe8e8115410 0x7fe8e811d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:25.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.141+0000 7fe8ed1746c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe8e8122b50 0x7fe8e8122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:25.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.141+0000 7fe8ed1746c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e8123560 con 0x7fe8e8122b50 2026-02-13T03:39:25.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.141+0000 7fe8ed1746c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e81236d0 con 0x7fe8e8115410 2026-02-13T03:39:25.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.141+0000 7fe8ed1746c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e8123890 con 0x7fe8e810f200 2026-02-13T03:39:25.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.141+0000 7fe8e75776c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe8e8122b50 0x7fe8e8122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:25.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.141+0000 7fe8e75776c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe8e8122b50 0x7fe8e8122ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:43578/0 (socket says 10.20.193.96:43578) 2026-02-13T03:39:25.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.141+0000 7fe8e75776c0 1 -- 10.20.193.96:0/3904869846 learned_addr learned my addr 10.20.193.96:0/3904869846 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:39:25.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.141+0000 7fe8e65756c0 1 --2- 10.20.193.96:0/3904869846 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe8e8115410 0x7fe8e811d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:25.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.141+0000 7fe8e6d766c0 1 --2- 10.20.193.96:0/3904869846 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe8e810f200 0x7fe8e811d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:25.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.141+0000 7fe8e75776c0 1 -- 10.20.193.96:0/3904869846 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe8e810f200 msgr2=0x7fe8e811d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:25.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.141+0000 7fe8e75776c0 1 --2- 10.20.193.96:0/3904869846 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe8e810f200 0x7fe8e811d250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:25.146 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.141+0000 7fe8e75776c0 1 -- 10.20.193.96:0/3904869846 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe8e8115410 msgr2=0x7fe8e811d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:25.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.141+0000 7fe8e75776c0 1 --2- 10.20.193.96:0/3904869846 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe8e8115410 0x7fe8e811d790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:25.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.141+0000 7fe8e75776c0 1 -- 10.20.193.96:0/3904869846 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8dc009590 con 0x7fe8e8122b50 2026-02-13T03:39:25.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.141+0000 7fe8e6d766c0 1 --2- 10.20.193.96:0/3904869846 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe8e810f200 0x7fe8e811d250 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:39:25.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.141+0000 7fe8e75776c0 1 --2- 10.20.193.96:0/3904869846 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe8e8122b50 0x7fe8e8122ff0 secure :-1 s=READY pgs=498 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8d8006ea0 tx=0x7fe8d800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:39:25.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.141+0000 7fe8c7fff6c0 1 -- 10.20.193.96:0/3904869846 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe8d8003a30 con 0x7fe8e8122b50 2026-02-13T03:39:25.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.141+0000 7fe8ed1746c0 1 -- 10.20.193.96:0/3904869846 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e8163d40 con 0x7fe8e8122b50 2026-02-13T03:39:25.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.141+0000 7fe8c7fff6c0 1 -- 10.20.193.96:0/3904869846 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fe8d8005510 con 0x7fe8e8122b50 2026-02-13T03:39:25.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.141+0000 7fe8c7fff6c0 1 -- 10.20.193.96:0/3904869846 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe8d800dd70 con 0x7fe8e8122b50 2026-02-13T03:39:25.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.141+0000 7fe8ed1746c0 1 -- 10.20.193.96:0/3904869846 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e81641d0 con 0x7fe8e8122b50 2026-02-13T03:39:25.147 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.141+0000 7fe8ed1746c0 1 -- 10.20.193.96:0/3904869846 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8e81104d0 con 0x7fe8e8122b50 2026-02-13T03:39:25.148 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.143+0000 7fe8c7fff6c0 1 -- 10.20.193.96:0/3904869846 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fe8d8003b90 con 0x7fe8e8122b50 2026-02-13T03:39:25.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.143+0000 7fe8c7fff6c0 1 --2- 10.20.193.96:0/3904869846 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe8bc0b5680 0x7fe8bc0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:25.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.143+0000 7fe8e6d766c0 1 --2- 10.20.193.96:0/3904869846 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe8bc0b5680 0x7fe8bc0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:25.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.144+0000 7fe8c7fff6c0 1 -- 10.20.193.96:0/3904869846 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7fe8d80e4ae0 con 0x7fe8e8122b50 2026-02-13T03:39:25.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.144+0000 7fe8e6d766c0 1 --2- 10.20.193.96:0/3904869846 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe8bc0b5680 0x7fe8bc0d5b30 secure :-1 s=READY pgs=313 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8dc0098c0 tx=0x7fe8dc0091a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:39:25.149 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.144+0000 7fe8c7fff6c0 1 -- 10.20.193.96:0/3904869846 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe8d80a7540 con 0x7fe8e8122b50 2026-02-13T03:39:25.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:24 trial132 ceph-mon[26888]: pgmap v348: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:39:25.261 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.259+0000 7fe8ed1746c0 1 -- 10.20.193.96:0/3904869846 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe8e810f5d0 con 0x7fe8e8122b50 2026-02-13T03:39:25.261 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.259+0000 7fe8c7fff6c0 1 -- 10.20.193.96:0/3904869846 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe8d80aa6f0 con 0x7fe8e8122b50 2026-02-13T03:39:25.261 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:39:25.261 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:39:25.262 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.260+0000 7fe8ed1746c0 1 -- 10.20.193.96:0/3904869846 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe8bc0b5680 msgr2=0x7fe8bc0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:25.263 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.260+0000 7fe8ed1746c0 1 --2- 10.20.193.96:0/3904869846 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe8bc0b5680 0x7fe8bc0d5b30 secure :-1 s=READY pgs=313 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8dc0098c0 tx=0x7fe8dc0091a0 comp rx=0 tx=0).stop 2026-02-13T03:39:25.263 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.260+0000 7fe8ed1746c0 1 -- 10.20.193.96:0/3904869846 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe8e8122b50 msgr2=0x7fe8e8122ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:25.263 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.260+0000 7fe8ed1746c0 1 --2- 10.20.193.96:0/3904869846 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe8e8122b50 0x7fe8e8122ff0 secure :-1 s=READY pgs=498 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8d8006ea0 tx=0x7fe8d800cca0 comp rx=0 tx=0).stop 2026-02-13T03:39:25.263 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.260+0000 7fe8ed1746c0 1 -- 10.20.193.96:0/3904869846 shutdown_connections 2026-02-13T03:39:25.263 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.260+0000 7fe8ed1746c0 1 --2- 10.20.193.96:0/3904869846 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fe8bc0b5680 0x7fe8bc0d5b30 unknown :-1 s=CLOSED pgs=313 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:25.263 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.260+0000 7fe8ed1746c0 1 --2- 10.20.193.96:0/3904869846 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fe8e8122b50 0x7fe8e8122ff0 unknown :-1 s=CLOSED pgs=498 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:25.263 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.260+0000 7fe8ed1746c0 1 --2- 10.20.193.96:0/3904869846 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fe8e8115410 0x7fe8e811d790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:25.263 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.260+0000 7fe8ed1746c0 1 --2- 10.20.193.96:0/3904869846 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fe8e810f200 0x7fe8e811d250 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:25.263 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.260+0000 7fe8ed1746c0 1 -- 10.20.193.96:0/3904869846 >> 10.20.193.96:0/3904869846 conn(0x7fe8e80ecb00 msgr2=0x7fe8e810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:39:25.263 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.260+0000 7fe8ed1746c0 1 -- 10.20.193.96:0/3904869846 shutdown_connections 2026-02-13T03:39:25.263 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:25.260+0000 7fe8ed1746c0 1 -- 10.20.193.96:0/3904869846 wait complete. 2026-02-13T03:39:25.264 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:24 trial133 ceph-mon[26943]: pgmap v348: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:39:26.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:25 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/3904869846' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:26.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:25 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/3904869846' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:26.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:25 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/3904869846' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:27.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:26 trial096 ceph-mon[24671]: pgmap v349: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:39:27.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:26 trial132 ceph-mon[26888]: pgmap v349: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:39:27.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:26 trial133 ceph-mon[26943]: pgmap v349: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:39:28.302 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:39:28.420 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:39:28.532 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.528+0000 7fed40e0c6c0 1 -- 10.20.193.96:0/2687189093 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fed3c10fbf0 msgr2=0x7fed3c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:28.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.528+0000 7fed40e0c6c0 1 --2- 10.20.193.96:0/2687189093 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fed3c10fbf0 0x7fed3c114c30 secure :-1 s=READY pgs=499 gs=1 cs=0 l=1 c_cookie=628000953500819067 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed240099a0 tx=0x7fed2402ed20 comp rx=0 tx=0).stop 2026-02-13T03:39:28.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.528+0000 7fed40e0c6c0 1 -- 10.20.193.96:0/2687189093 shutdown_connections 2026-02-13T03:39:28.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.528+0000 7fed40e0c6c0 1 --2- 10.20.193.96:0/2687189093 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fed3c115410 0x7fed3c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:28.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.528+0000 7fed40e0c6c0 1 --2- 10.20.193.96:0/2687189093 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fed3c10fbf0 0x7fed3c114c30 unknown :-1 s=CLOSED pgs=499 gs=1 cs=0 l=1 c_cookie=628000953500819067 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:28.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.528+0000 7fed40e0c6c0 1 --2- 10.20.193.96:0/2687189093 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fed3c10f200 0x7fed3c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:28.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.528+0000 7fed40e0c6c0 1 -- 10.20.193.96:0/2687189093 >> 10.20.193.96:0/2687189093 conn(0x7fed3c0ecb00 msgr2=0x7fed3c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:39:28.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.528+0000 7fed40e0c6c0 1 -- 10.20.193.96:0/2687189093 shutdown_connections 2026-02-13T03:39:28.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.528+0000 7fed40e0c6c0 1 -- 10.20.193.96:0/2687189093 wait complete. 2026-02-13T03:39:28.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.528+0000 7fed40e0c6c0 1 Processor -- start 2026-02-13T03:39:28.533 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.528+0000 7fed40e0c6c0 1 -- start start 2026-02-13T03:39:28.534 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.529+0000 7fed40e0c6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fed3c10f200 0x7fed3c0f4d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:28.534 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.529+0000 7fed40e0c6c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fed3c115410 0x7fed3c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:28.534 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.529+0000 7fed40e0c6c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fed3c0f53a0 0x7fed3c0fa620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:28.534 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.529+0000 7fed40e0c6c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7fed3c0f5a90 con 0x7fed3c10f200 2026-02-13T03:39:28.534 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.529+0000 7fed40e0c6c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7fed3c0fab60 con 0x7fed3c0f53a0 2026-02-13T03:39:28.534 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.529+0000 7fed40e0c6c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7fed3c0fad20 con 0x7fed3c115410 2026-02-13T03:39:28.534 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.529+0000 7fed3a5756c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fed3c10f200 0x7fed3c0f4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:28.534 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.529+0000 7fed3a5756c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fed3c10f200 0x7fed3c0f4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:43596/0 (socket says 10.20.193.96:43596) 2026-02-13T03:39:28.534 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.529+0000 7fed3a5756c0 1 -- 10.20.193.96:0/1941397092 learned_addr learned my addr 10.20.193.96:0/1941397092 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:39:28.534 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.529+0000 7fed3ad766c0 1 --2- 10.20.193.96:0/1941397092 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fed3c0f53a0 0x7fed3c0fa620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:28.534 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.529+0000 7fed3a5756c0 1 -- 10.20.193.96:0/1941397092 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fed3c115410 msgr2=0x7fed3c175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:28.534 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.529+0000 7fed3a5756c0 1 --2- 10.20.193.96:0/1941397092 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fed3c115410 0x7fed3c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:28.535 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.529+0000 7fed3a5756c0 1 -- 10.20.193.96:0/1941397092 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fed3c0f53a0 msgr2=0x7fed3c0fa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:28.535 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.529+0000 7fed3a5756c0 1 --2- 10.20.193.96:0/1941397092 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fed3c0f53a0 0x7fed3c0fa620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:28.535 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.529+0000 7fed3a5756c0 1 -- 10.20.193.96:0/1941397092 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed24009590 con 0x7fed3c10f200 2026-02-13T03:39:28.535 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.529+0000 7fed3a5756c0 1 --2- 10.20.193.96:0/1941397092 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fed3c10f200 0x7fed3c0f4d70 secure :-1 s=READY pgs=500 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed3000b710 tx=0x7fed3000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:39:28.535 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.529+0000 7fed237fe6c0 1 -- 10.20.193.96:0/1941397092 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed30004250 con 0x7fed3c10f200 2026-02-13T03:39:28.535 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.529+0000 7fed40e0c6c0 1 -- 10.20.193.96:0/1941397092 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed3c0fb000 con 0x7fed3c10f200 2026-02-13T03:39:28.535 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.529+0000 7fed237fe6c0 1 -- 10.20.193.96:0/1941397092 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7fed30002da0 con 0x7fed3c10f200 2026-02-13T03:39:28.535 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.529+0000 7fed237fe6c0 1 -- 10.20.193.96:0/1941397092 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed3000ce50 con 0x7fed3c10f200 2026-02-13T03:39:28.535 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.529+0000 7fed40e0c6c0 1 -- 10.20.193.96:0/1941397092 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed3c0fb790 con 0x7fed3c10f200 2026-02-13T03:39:28.535 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.530+0000 7fed40e0c6c0 1 -- 10.20.193.96:0/1941397092 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed3c1104d0 con 0x7fed3c10f200 2026-02-13T03:39:28.536 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.531+0000 7fed237fe6c0 1 -- 10.20.193.96:0/1941397092 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fed300043b0 con 0x7fed3c10f200 2026-02-13T03:39:28.536 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.531+0000 7fed237fe6c0 1 --2- 10.20.193.96:0/1941397092 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fed140b5670 0x7fed140d5b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:28.537 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.532+0000 7fed237fe6c0 1 -- 10.20.193.96:0/1941397092 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7fed300e3b10 con 0x7fed3c10f200 2026-02-13T03:39:28.537 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.532+0000 7fed39d746c0 1 --2- 10.20.193.96:0/1941397092 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fed140b5670 0x7fed140d5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:28.537 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.532+0000 7fed237fe6c0 1 -- 10.20.193.96:0/1941397092 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fed300a6570 con 0x7fed3c10f200 2026-02-13T03:39:28.537 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.532+0000 7fed39d746c0 1 --2- 10.20.193.96:0/1941397092 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fed140b5670 0x7fed140d5b20 secure :-1 s=READY pgs=314 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed24005b40 tx=0x7fed24005c20 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:39:28.649 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.647+0000 7fed40e0c6c0 1 -- 10.20.193.96:0/1941397092 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fed3c0f5e70 con 0x7fed3c10f200 2026-02-13T03:39:28.649 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.647+0000 7fed237fe6c0 1 -- 10.20.193.96:0/1941397092 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fed300a9720 con 0x7fed3c10f200 2026-02-13T03:39:28.650 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:39:28.650 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:39:28.651 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.648+0000 7fed40e0c6c0 1 -- 10.20.193.96:0/1941397092 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fed140b5670 msgr2=0x7fed140d5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:28.651 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.648+0000 7fed40e0c6c0 1 --2- 10.20.193.96:0/1941397092 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fed140b5670 0x7fed140d5b20 secure :-1 s=READY pgs=314 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed24005b40 tx=0x7fed24005c20 comp rx=0 tx=0).stop 2026-02-13T03:39:28.651 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.648+0000 7fed40e0c6c0 1 -- 10.20.193.96:0/1941397092 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fed3c10f200 msgr2=0x7fed3c0f4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:28.651 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.648+0000 7fed40e0c6c0 1 --2- 10.20.193.96:0/1941397092 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fed3c10f200 0x7fed3c0f4d70 secure :-1 s=READY pgs=500 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed3000b710 tx=0x7fed3000bbe0 comp rx=0 tx=0).stop 2026-02-13T03:39:28.651 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.648+0000 7fed40e0c6c0 1 -- 10.20.193.96:0/1941397092 shutdown_connections 2026-02-13T03:39:28.651 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.648+0000 7fed40e0c6c0 1 --2- 10.20.193.96:0/1941397092 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7fed140b5670 0x7fed140d5b20 unknown :-1 s=CLOSED pgs=314 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:28.651 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.648+0000 7fed40e0c6c0 1 --2- 10.20.193.96:0/1941397092 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7fed3c0f53a0 0x7fed3c0fa620 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:28.652 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.648+0000 7fed40e0c6c0 1 --2- 10.20.193.96:0/1941397092 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7fed3c115410 0x7fed3c175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:28.652 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.648+0000 7fed40e0c6c0 1 --2- 10.20.193.96:0/1941397092 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7fed3c10f200 0x7fed3c0f4d70 unknown :-1 s=CLOSED pgs=500 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:28.652 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.648+0000 7fed40e0c6c0 1 -- 10.20.193.96:0/1941397092 >> 10.20.193.96:0/1941397092 conn(0x7fed3c0ecb00 msgr2=0x7fed3c111c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:39:28.652 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.648+0000 7fed40e0c6c0 1 -- 10.20.193.96:0/1941397092 shutdown_connections 2026-02-13T03:39:28.652 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:28.648+0000 7fed40e0c6c0 1 -- 10.20.193.96:0/1941397092 wait complete. 2026-02-13T03:39:28.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:28 trial096 ceph-mon[24671]: pgmap v350: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:39:28.924 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:28 trial096 ceph-mon[24671]: from='client.? 10.20.193.96:0/1941397092' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:29.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:28 trial132 ceph-mon[26888]: pgmap v350: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:39:29.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:28 trial132 ceph-mon[26888]: from='client.? 10.20.193.96:0/1941397092' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:29.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:28 trial133 ceph-mon[26943]: pgmap v350: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T03:39:29.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:28 trial133 ceph-mon[26943]: from='client.? 10.20.193.96:0/1941397092' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:39:31.174 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:30 trial096 ceph-mon[24671]: pgmap v351: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T03:39:31.232 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:30 trial132 ceph-mon[26888]: pgmap v351: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T03:39:31.263 INFO:journalctl@ceph.mon.c.trial133.stdout:Feb 13 03:39:30 trial133 ceph-mon[26943]: pgmap v351: 97 pgs: 97 active+clean; 650 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T03:39:31.692 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:39:31.811 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:39:31.931 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.926+0000 7f767a8a86c0 1 -- 10.20.193.96:0/1033768208 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f767410f200 msgr2=0x7f767410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:31.932 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.926+0000 7f767a8a86c0 1 --2- 10.20.193.96:0/1033768208 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f767410f200 0x7f767410f5d0 secure :-1 s=READY pgs=501 gs=1 cs=0 l=1 c_cookie=17581750510752569802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76600099a0 tx=0x7f766002ed20 comp rx=0 tx=0).stop 2026-02-13T03:39:31.932 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.926+0000 7f767a8a86c0 1 -- 10.20.193.96:0/1033768208 shutdown_connections 2026-02-13T03:39:31.932 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.926+0000 7f767a8a86c0 1 --2- 10.20.193.96:0/1033768208 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f7674115410 0x7f7674175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:31.932 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.926+0000 7f767a8a86c0 1 --2- 10.20.193.96:0/1033768208 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f767410fbf0 0x7f7674114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:31.932 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.926+0000 7f767a8a86c0 1 --2- 10.20.193.96:0/1033768208 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f767410f200 0x7f767410f5d0 unknown :-1 s=CLOSED pgs=501 gs=1 cs=0 l=1 c_cookie=17581750510752569802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:31.932 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.926+0000 7f767a8a86c0 1 -- 10.20.193.96:0/1033768208 >> 10.20.193.96:0/1033768208 conn(0x7f76740ecb00 msgr2=0x7f767410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:39:31.932 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.926+0000 7f767a8a86c0 1 -- 10.20.193.96:0/1033768208 shutdown_connections 2026-02-13T03:39:31.932 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.926+0000 7f767a8a86c0 1 -- 10.20.193.96:0/1033768208 wait complete. 2026-02-13T03:39:31.932 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.927+0000 7f767a8a86c0 1 Processor -- start 2026-02-13T03:39:31.933 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.927+0000 7f767a8a86c0 1 -- start start 2026-02-13T03:39:31.933 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.927+0000 7f767a8a86c0 1 --2- >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f767410f200 0x7f767411d210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:31.933 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.927+0000 7f767a8a86c0 1 --2- >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7674115410 0x7f767411d750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:31.933 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.927+0000 7f767a8a86c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7674122b10 0x7f7674122fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:31.933 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.927+0000 7f767a8a86c0 1 -- --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_getmap magic: 0 -- 0x7f76741234f0 con 0x7f7674122b10 2026-02-13T03:39:31.933 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.927+0000 7f767a8a86c0 1 -- --> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7674123660 con 0x7f767410f200 2026-02-13T03:39:31.933 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.927+0000 7f767a8a86c0 1 -- --> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7674123820 con 0x7f7674115410 2026-02-13T03:39:31.933 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.927+0000 7f7678e1a6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7674122b10 0x7f7674122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:31.933 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.927+0000 7f7678e1a6c0 1 --2- >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7674122b10 0x7f7674122fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.96:3300/0 says I am v2:10.20.193.96:43614/0 (socket says 10.20.193.96:43614) 2026-02-13T03:39:31.933 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.927+0000 7f7678e1a6c0 1 -- 10.20.193.96:0/793734619 learned_addr learned my addr 10.20.193.96:0/793734619 (peer_addr_for_me v2:10.20.193.96:0/0) 2026-02-13T03:39:31.933 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.927+0000 7f7673fff6c0 1 --2- 10.20.193.96:0/793734619 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f767410f200 0x7f767411d210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:31.933 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.927+0000 7f7678e1a6c0 1 -- 10.20.193.96:0/793734619 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7674115410 msgr2=0x7f767411d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:31.934 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.927+0000 7f7678e1a6c0 1 --2- 10.20.193.96:0/793734619 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7674115410 0x7f767411d750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:31.934 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.927+0000 7f7678e1a6c0 1 -- 10.20.193.96:0/793734619 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f767410f200 msgr2=0x7f767411d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:31.934 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.927+0000 7f7678e1a6c0 1 --2- 10.20.193.96:0/793734619 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f767410f200 0x7f767411d210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:31.934 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.927+0000 7f7678e1a6c0 1 -- 10.20.193.96:0/793734619 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7660009590 con 0x7f7674122b10 2026-02-13T03:39:31.934 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.927+0000 7f7678e1a6c0 1 --2- 10.20.193.96:0/793734619 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7674122b10 0x7f7674122fb0 secure :-1 s=READY pgs=502 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7668006ea0 tx=0x7f766800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:39:31.934 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.927+0000 7f76717fa6c0 1 -- 10.20.193.96:0/793734619 <== mon.0 v2:10.20.193.96:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7668003a30 con 0x7f7674122b10 2026-02-13T03:39:31.934 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.927+0000 7f76717fa6c0 1 -- 10.20.193.96:0/793734619 <== mon.0 v2:10.20.193.96:3300/0 2 ==== config(28 keys) ==== 1146+0+0 (secure 0 0 0) 0x7f7668005510 con 0x7f7674122b10 2026-02-13T03:39:31.934 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.927+0000 7f767a8a86c0 1 -- 10.20.193.96:0/793734619 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7674163ca0 con 0x7f7674122b10 2026-02-13T03:39:31.934 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.927+0000 7f76717fa6c0 1 -- 10.20.193.96:0/793734619 <== mon.0 v2:10.20.193.96:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f766800dd70 con 0x7f7674122b10 2026-02-13T03:39:31.934 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.927+0000 7f767a8a86c0 1 -- 10.20.193.96:0/793734619 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76741641d0 con 0x7f7674122b10 2026-02-13T03:39:31.934 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.928+0000 7f767a8a86c0 1 -- 10.20.193.96:0/793734619 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76741104d0 con 0x7f7674122b10 2026-02-13T03:39:31.935 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.929+0000 7f76717fa6c0 1 -- 10.20.193.96:0/793734619 <== mon.0 v2:10.20.193.96:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f7668003b90 con 0x7f7674122b10 2026-02-13T03:39:31.935 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.930+0000 7f76717fa6c0 1 --2- 10.20.193.96:0/793734619 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f76480b5680 0x7f76480d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:39:31.936 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.930+0000 7f76717fa6c0 1 -- 10.20.193.96:0/793734619 <== mon.0 v2:10.20.193.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8060+0+0 (secure 0 0 0) 0x7f76680e4a80 con 0x7f7674122b10 2026-02-13T03:39:31.936 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.930+0000 7f7673fff6c0 1 --2- 10.20.193.96:0/793734619 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f76480b5680 0x7f76480d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:39:31.936 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.930+0000 7f7673fff6c0 1 --2- 10.20.193.96:0/793734619 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f76480b5680 0x7f76480d5b30 secure :-1 s=READY pgs=315 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76600023e0 tx=0x7f7660005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:39:31.936 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:31.930+0000 7f76717fa6c0 1 -- 10.20.193.96:0/793734619 <== mon.0 v2:10.20.193.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f76680a74e0 con 0x7f7674122b10 2026-02-13T03:39:32.050 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:32.046+0000 7f767a8a86c0 1 -- 10.20.193.96:0/793734619 --> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f767411e360 con 0x7f7674122b10 2026-02-13T03:39:32.050 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:32.047+0000 7f76717fa6c0 1 -- 10.20.193.96:0/793734619 <== mon.0 v2:10.20.193.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f76680aa690 con 0x7f7674122b10 2026-02-13T03:39:32.050 INFO:teuthology.orchestra.run.trial096.stdout: 2026-02-13T03:39:32.050 INFO:teuthology.orchestra.run.trial096.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:39:32.051 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:32.048+0000 7f767a8a86c0 1 -- 10.20.193.96:0/793734619 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f76480b5680 msgr2=0x7f76480d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:32.052 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:32.048+0000 7f767a8a86c0 1 --2- 10.20.193.96:0/793734619 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f76480b5680 0x7f76480d5b30 secure :-1 s=READY pgs=315 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76600023e0 tx=0x7f7660005c00 comp rx=0 tx=0).stop 2026-02-13T03:39:32.052 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:32.048+0000 7f767a8a86c0 1 -- 10.20.193.96:0/793734619 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7674122b10 msgr2=0x7f7674122fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:39:32.052 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:32.048+0000 7f767a8a86c0 1 --2- 10.20.193.96:0/793734619 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7674122b10 0x7f7674122fb0 secure :-1 s=READY pgs=502 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7668006ea0 tx=0x7f766800cca0 comp rx=0 tx=0).stop 2026-02-13T03:39:32.052 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:32.048+0000 7f767a8a86c0 1 -- 10.20.193.96:0/793734619 shutdown_connections 2026-02-13T03:39:32.052 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:32.048+0000 7f767a8a86c0 1 --2- 10.20.193.96:0/793734619 >> [v2:10.20.193.96:6800/1736050816,v1:10.20.193.96:6801/1736050816] conn(0x7f76480b5680 0x7f76480d5b30 unknown :-1 s=CLOSED pgs=315 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:32.052 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:32.048+0000 7f767a8a86c0 1 --2- 10.20.193.96:0/793734619 >> [v2:10.20.193.96:3300/0,v1:10.20.193.96:6789/0] conn(0x7f7674122b10 0x7f7674122fb0 unknown :-1 s=CLOSED pgs=502 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:32.052 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:32.048+0000 7f767a8a86c0 1 --2- 10.20.193.96:0/793734619 >> [v2:10.20.193.133:3300/0,v1:10.20.193.133:6789/0] conn(0x7f7674115410 0x7f767411d750 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:32.052 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:32.048+0000 7f767a8a86c0 1 --2- 10.20.193.96:0/793734619 >> [v2:10.20.193.132:3300/0,v1:10.20.193.132:6789/0] conn(0x7f767410f200 0x7f767411d210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:39:32.052 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:32.048+0000 7f767a8a86c0 1 -- 10.20.193.96:0/793734619 >> 10.20.193.96:0/793734619 conn(0x7f76740ecb00 msgr2=0x7f767410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:39:32.052 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:32.048+0000 7f767a8a86c0 1 -- 10.20.193.96:0/793734619 shutdown_connections 2026-02-13T03:39:32.052 INFO:teuthology.orchestra.run.trial096.stderr:2026-02-13T03:39:32.048+0000 7f767a8a86c0 1 -- 10.20.193.96:0/793734619 wait complete. 2026-02-13T03:39:32.092 INFO:tasks.cephadm:Teardown begin 2026-02-13T03:39:32.093 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephadm.py", line 2025, in task healthy(ctx=ctx, config=config) File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/ceph.py", line 1557, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/ceph_manager.py", line 3393, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy 2026-02-13T03:39:32.097 DEBUG:teuthology.orchestra.run.trial096:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T03:39:32.122 DEBUG:teuthology.orchestra.run.trial132:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T03:39:32.151 DEBUG:teuthology.orchestra.run.trial133:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T03:39:32.179 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-13T03:39:32.179 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-13T03:39:32.295 INFO:teuthology.orchestra.run.trial096.stderr:Inferring config /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/mon.a/config 2026-02-13T03:39:32.313 INFO:teuthology.orchestra.run.trial096.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-13T03:39:32.330 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-13T03:39:32.330 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-13T03:39:32.331 DEBUG:teuthology.orchestra.run.trial096:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T03:39:32.348 DEBUG:teuthology.orchestra.run.trial132:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T03:39:32.364 DEBUG:teuthology.orchestra.run.trial133:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T03:39:32.382 INFO:tasks.cephadm:Stopping all daemons... 2026-02-13T03:39:32.382 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-13T03:39:32.382 DEBUG:teuthology.orchestra.run.trial096:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mon.a 2026-02-13T03:39:32.650 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:32 trial096 systemd[1]: Stopping Ceph mon.a for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:39:32.650 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:32 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mon-a[24667]: 2026-02-13T03:39:32.485+0000 7fbaf3d9c6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:39:32.650 INFO:journalctl@ceph.mon.a.trial096.stdout:Feb 13 03:39:32 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mon-a[24667]: 2026-02-13T03:39:32.485+0000 7fbaf3d9c6c0 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2026-02-13T03:39:32.723 DEBUG:teuthology.orchestra.run.trial096:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mon.a.service' 2026-02-13T03:39:32.760 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:39:32.761 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-13T03:39:32.761 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2026-02-13T03:39:32.761 DEBUG:teuthology.orchestra.run.trial132:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mon.b 2026-02-13T03:39:33.053 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:32 trial132 systemd[1]: Stopping Ceph mon.b for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:39:33.053 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:32 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mon-b[26884]: 2026-02-13T03:39:32.869+0000 7f7bd913d6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:39:33.053 INFO:journalctl@ceph.mon.b.trial132.stdout:Feb 13 03:39:32 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mon-b[26884]: 2026-02-13T03:39:32.869+0000 7f7bd913d6c0 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2026-02-13T03:39:33.136 DEBUG:teuthology.orchestra.run.trial132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mon.b.service' 2026-02-13T03:39:33.173 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:39:33.173 INFO:tasks.cephadm.mon.c:Stopped mon.b 2026-02-13T03:39:33.173 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2026-02-13T03:39:33.173 DEBUG:teuthology.orchestra.run.trial133:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mon.c 2026-02-13T03:39:33.388 DEBUG:teuthology.orchestra.run.trial133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mon.c.service' 2026-02-13T03:39:33.426 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:39:33.426 INFO:tasks.cephadm.mon.c:Stopped mon.c 2026-02-13T03:39:33.426 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2026-02-13T03:39:33.427 DEBUG:teuthology.orchestra.run.trial096:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mgr.x 2026-02-13T03:39:33.657 DEBUG:teuthology.orchestra.run.trial096:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mgr.x.service' 2026-02-13T03:39:33.691 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:39:33.692 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2026-02-13T03:39:33.692 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2026-02-13T03:39:33.692 DEBUG:teuthology.orchestra.run.trial132:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mgr.y 2026-02-13T03:39:33.809 INFO:journalctl@ceph.mgr.y.trial132.stdout:Feb 13 03:39:33 trial132 systemd[1]: Stopping Ceph mgr.y for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:39:33.891 DEBUG:teuthology.orchestra.run.trial132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mgr.y.service' 2026-02-13T03:39:33.928 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:39:33.928 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2026-02-13T03:39:33.928 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2026-02-13T03:39:33.928 DEBUG:teuthology.orchestra.run.trial133:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mgr.z 2026-02-13T03:39:34.144 DEBUG:teuthology.orchestra.run.trial133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mgr.z.service' 2026-02-13T03:39:34.180 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:39:34.180 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2026-02-13T03:39:34.181 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-13T03:39:34.181 DEBUG:teuthology.orchestra.run.trial096:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.0 2026-02-13T03:39:34.674 INFO:journalctl@ceph.osd.0.trial096.stdout:Feb 13 03:39:34 trial096 systemd[1]: Stopping Ceph osd.0 for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:39:34.675 INFO:journalctl@ceph.osd.0.trial096.stdout:Feb 13 03:39:34 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-0[36795]: 2026-02-13T03:39:34.271+0000 7f7c12a896c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T03:39:34.675 INFO:journalctl@ceph.osd.0.trial096.stdout:Feb 13 03:39:34 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-0[36795]: 2026-02-13T03:39:34.271+0000 7f7c12a896c0 -1 osd.0 72 *** Got signal Terminated *** 2026-02-13T03:39:34.675 INFO:journalctl@ceph.osd.0.trial096.stdout:Feb 13 03:39:34 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-0[36795]: 2026-02-13T03:39:34.271+0000 7f7c12a896c0 -1 osd.0 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T03:39:39.636 INFO:journalctl@ceph.osd.0.trial096.stdout:Feb 13 03:39:39 trial096 podman[80505]: 2026-02-13 03:39:39.3219809 +0000 UTC m=+5.062090984 container died bb83185a4d7a4d2a1157ab5c9eb591a9be484b7ca267393306a72ac40baad9ff (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-0, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, name=rockylinux) 2026-02-13T03:39:39.636 INFO:journalctl@ceph.osd.0.trial096.stdout:Feb 13 03:39:39 trial096 podman[80505]: 2026-02-13 03:39:39.331508491 +0000 UTC m=+5.071618575 container remove bb83185a4d7a4d2a1157ab5c9eb591a9be484b7ca267393306a72ac40baad9ff (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-0, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, license=BSD-3-Clause, io.buildah.version=1.33.7, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux) 2026-02-13T03:39:39.636 INFO:journalctl@ceph.osd.0.trial096.stdout:Feb 13 03:39:39 trial096 bash[80505]: ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-0 2026-02-13T03:39:39.636 INFO:journalctl@ceph.osd.0.trial096.stdout:Feb 13 03:39:39 trial096 podman[80633]: 2026-02-13 03:39:39.463696586 +0000 UTC m=+0.015178202 container create 0f0f5731bfed90a8d6a98abde03806a15bd12ab9e5fd7dfda7a94ab579163184 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-0-deactivate, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T03:39:39.636 INFO:journalctl@ceph.osd.0.trial096.stdout:Feb 13 03:39:39 trial096 podman[80633]: 2026-02-13 03:39:39.498367519 +0000 UTC m=+0.049849125 container init 0f0f5731bfed90a8d6a98abde03806a15bd12ab9e5fd7dfda7a94ab579163184 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-0-deactivate, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , ceph=True, name=rockylinux, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux) 2026-02-13T03:39:39.637 INFO:journalctl@ceph.osd.0.trial096.stdout:Feb 13 03:39:39 trial096 podman[80633]: 2026-02-13 03:39:39.500983541 +0000 UTC m=+0.052465157 container start 0f0f5731bfed90a8d6a98abde03806a15bd12ab9e5fd7dfda7a94ab579163184 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-0-deactivate, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, license=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T03:39:39.637 INFO:journalctl@ceph.osd.0.trial096.stdout:Feb 13 03:39:39 trial096 podman[80633]: 2026-02-13 03:39:39.501436571 +0000 UTC m=+0.052918197 container attach 0f0f5731bfed90a8d6a98abde03806a15bd12ab9e5fd7dfda7a94ab579163184 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-0-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T03:39:39.637 INFO:journalctl@ceph.osd.0.trial096.stdout:Feb 13 03:39:39 trial096 podman[80633]: 2026-02-13 03:39:39.45778395 +0000 UTC m=+0.009265576 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T03:39:39.637 INFO:journalctl@ceph.osd.0.trial096.stdout:Feb 13 03:39:39 trial096 podman[80633]: 2026-02-13 03:39:39.63364296 +0000 UTC m=+0.185124576 container died 0f0f5731bfed90a8d6a98abde03806a15bd12ab9e5fd7dfda7a94ab579163184 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-0-deactivate, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, org.opencontainers.image.title=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7) 2026-02-13T03:39:39.670 DEBUG:teuthology.orchestra.run.trial096:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.0.service' 2026-02-13T03:39:39.705 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:39:39.706 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-13T03:39:39.706 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-13T03:39:39.706 DEBUG:teuthology.orchestra.run.trial132:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.1 2026-02-13T03:39:39.982 INFO:journalctl@ceph.osd.1.trial132.stdout:Feb 13 03:39:39 trial132 systemd[1]: Stopping Ceph osd.1 for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:39:39.982 INFO:journalctl@ceph.osd.1.trial132.stdout:Feb 13 03:39:39 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-1[31703]: 2026-02-13T03:39:39.815+0000 7f4e4403a6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T03:39:39.982 INFO:journalctl@ceph.osd.1.trial132.stdout:Feb 13 03:39:39 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-1[31703]: 2026-02-13T03:39:39.815+0000 7f4e4403a6c0 -1 osd.1 72 *** Got signal Terminated *** 2026-02-13T03:39:39.982 INFO:journalctl@ceph.osd.1.trial132.stdout:Feb 13 03:39:39 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-1[31703]: 2026-02-13T03:39:39.815+0000 7f4e4403a6c0 -1 osd.1 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T03:39:45.177 INFO:journalctl@ceph.osd.1.trial132.stdout:Feb 13 03:39:44 trial132 podman[58183]: 2026-02-13 03:39:44.875156874 +0000 UTC m=+5.071675772 container died 110fdd959a90bc0fd1671aafd73b549f61baadc92ba29ee4ad16ba8afd9e99d0 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-1, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, ceph=True) 2026-02-13T03:39:45.177 INFO:journalctl@ceph.osd.1.trial132.stdout:Feb 13 03:39:44 trial132 podman[58183]: 2026-02-13 03:39:44.884581996 +0000 UTC m=+5.081100894 container remove 110fdd959a90bc0fd1671aafd73b549f61baadc92ba29ee4ad16ba8afd9e99d0 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-1, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, name=rockylinux, ceph=True, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T03:39:45.177 INFO:journalctl@ceph.osd.1.trial132.stdout:Feb 13 03:39:44 trial132 bash[58183]: ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-1 2026-02-13T03:39:45.177 INFO:journalctl@ceph.osd.1.trial132.stdout:Feb 13 03:39:45 trial132 podman[58317]: 2026-02-13 03:39:45.013324864 +0000 UTC m=+0.015776871 container create 1329bc2a13c57b4eb76dab010d13c0344efab972d8e71acb919c8026660c2606 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-1-deactivate, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, name=rockylinux, summary=Rocky Linux Base image, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7) 2026-02-13T03:39:45.177 INFO:journalctl@ceph.osd.1.trial132.stdout:Feb 13 03:39:45 trial132 podman[58317]: 2026-02-13 03:39:45.049606516 +0000 UTC m=+0.052058573 container init 1329bc2a13c57b4eb76dab010d13c0344efab972d8e71acb919c8026660c2606 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-1-deactivate, ceph=True, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, version=10, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause) 2026-02-13T03:39:45.177 INFO:journalctl@ceph.osd.1.trial132.stdout:Feb 13 03:39:45 trial132 podman[58317]: 2026-02-13 03:39:45.052143715 +0000 UTC m=+0.054595742 container start 1329bc2a13c57b4eb76dab010d13c0344efab972d8e71acb919c8026660c2606 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, version=10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True) 2026-02-13T03:39:45.178 INFO:journalctl@ceph.osd.1.trial132.stdout:Feb 13 03:39:45 trial132 podman[58317]: 2026-02-13 03:39:45.05273431 +0000 UTC m=+0.055186327 container attach 1329bc2a13c57b4eb76dab010d13c0344efab972d8e71acb919c8026660c2606 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, io.buildah.version=1.33.7, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10) 2026-02-13T03:39:45.178 INFO:journalctl@ceph.osd.1.trial132.stdout:Feb 13 03:39:45 trial132 podman[58317]: 2026-02-13 03:39:45.006712538 +0000 UTC m=+0.009164565 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T03:39:45.212 DEBUG:teuthology.orchestra.run.trial132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.1.service' 2026-02-13T03:39:45.248 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:39:45.249 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-13T03:39:45.249 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-13T03:39:45.249 DEBUG:teuthology.orchestra.run.trial133:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.2 2026-02-13T03:39:45.763 INFO:journalctl@ceph.osd.2.trial133.stdout:Feb 13 03:39:45 trial133 systemd[1]: Stopping Ceph osd.2 for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:39:45.763 INFO:journalctl@ceph.osd.2.trial133.stdout:Feb 13 03:39:45 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-2[32173]: 2026-02-13T03:39:45.344+0000 7f2c16f1d6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T03:39:45.763 INFO:journalctl@ceph.osd.2.trial133.stdout:Feb 13 03:39:45 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-2[32173]: 2026-02-13T03:39:45.344+0000 7f2c16f1d6c0 -1 osd.2 72 *** Got signal Terminated *** 2026-02-13T03:39:45.763 INFO:journalctl@ceph.osd.2.trial133.stdout:Feb 13 03:39:45 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-2[32173]: 2026-02-13T03:39:45.344+0000 7f2c16f1d6c0 -1 osd.2 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T03:39:50.725 INFO:journalctl@ceph.osd.2.trial133.stdout:Feb 13 03:39:50 trial133 podman[59893]: 2026-02-13 03:39:50.414874534 +0000 UTC m=+5.081938536 container died ccd63028e2171f0b19de5aec96f6450ab25c2b725014f1a217377f9ae2fea100 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-2, io.buildah.version=1.33.7, ceph=True, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux) 2026-02-13T03:39:50.725 INFO:journalctl@ceph.osd.2.trial133.stdout:Feb 13 03:39:50 trial133 podman[59893]: 2026-02-13 03:39:50.424121417 +0000 UTC m=+5.091185419 container remove ccd63028e2171f0b19de5aec96f6450ab25c2b725014f1a217377f9ae2fea100 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-2, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , version=10, name=rockylinux, summary=Rocky Linux Base image, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T03:39:50.725 INFO:journalctl@ceph.osd.2.trial133.stdout:Feb 13 03:39:50 trial133 bash[59893]: ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-2 2026-02-13T03:39:50.725 INFO:journalctl@ceph.osd.2.trial133.stdout:Feb 13 03:39:50 trial133 podman[60027]: 2026-02-13 03:39:50.557342211 +0000 UTC m=+0.015944142 container create a4997e75e36b754ca8b19d37abd9ccc63aeaf083d62960f60599a7af19a2944e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-2-deactivate, org.opencontainers.image.title=rockylinux, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, OSD_FLAVOR=default, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T03:39:50.725 INFO:journalctl@ceph.osd.2.trial133.stdout:Feb 13 03:39:50 trial133 podman[60027]: 2026-02-13 03:39:50.598394392 +0000 UTC m=+0.056996343 container init a4997e75e36b754ca8b19d37abd9ccc63aeaf083d62960f60599a7af19a2944e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-2-deactivate, name=rockylinux, license=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , version=10, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T03:39:50.725 INFO:journalctl@ceph.osd.2.trial133.stdout:Feb 13 03:39:50 trial133 podman[60027]: 2026-02-13 03:39:50.600887522 +0000 UTC m=+0.059489463 container start a4997e75e36b754ca8b19d37abd9ccc63aeaf083d62960f60599a7af19a2944e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-2-deactivate, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, org.opencontainers.image.authors=Ceph Release Team , version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux) 2026-02-13T03:39:50.725 INFO:journalctl@ceph.osd.2.trial133.stdout:Feb 13 03:39:50 trial133 podman[60027]: 2026-02-13 03:39:50.601313388 +0000 UTC m=+0.059915339 container attach a4997e75e36b754ca8b19d37abd9ccc63aeaf083d62960f60599a7af19a2944e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-2-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , version=10, summary=Rocky Linux Base image, name=rockylinux, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T03:39:50.726 INFO:journalctl@ceph.osd.2.trial133.stdout:Feb 13 03:39:50 trial133 podman[60027]: 2026-02-13 03:39:50.551567527 +0000 UTC m=+0.010169469 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T03:39:50.726 INFO:journalctl@ceph.osd.2.trial133.stdout:Feb 13 03:39:50 trial133 podman[60027]: 2026-02-13 03:39:50.722427693 +0000 UTC m=+0.181029634 container died a4997e75e36b754ca8b19d37abd9ccc63aeaf083d62960f60599a7af19a2944e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-2-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, OSD_FLAVOR=default, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T03:39:50.750 DEBUG:teuthology.orchestra.run.trial133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.2.service' 2026-02-13T03:39:50.787 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:39:50.788 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-13T03:39:50.788 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-02-13T03:39:50.788 DEBUG:teuthology.orchestra.run.trial096:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.3 2026-02-13T03:39:51.174 INFO:journalctl@ceph.osd.3.trial096.stdout:Feb 13 03:39:50 trial096 systemd[1]: Stopping Ceph osd.3 for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:39:51.174 INFO:journalctl@ceph.osd.3.trial096.stdout:Feb 13 03:39:50 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-3[43162]: 2026-02-13T03:39:50.886+0000 7fb7c22466c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T03:39:51.175 INFO:journalctl@ceph.osd.3.trial096.stdout:Feb 13 03:39:50 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-3[43162]: 2026-02-13T03:39:50.886+0000 7fb7c22466c0 -1 osd.3 72 *** Got signal Terminated *** 2026-02-13T03:39:51.175 INFO:journalctl@ceph.osd.3.trial096.stdout:Feb 13 03:39:50 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-3[43162]: 2026-02-13T03:39:50.886+0000 7fb7c22466c0 -1 osd.3 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T03:39:56.237 INFO:journalctl@ceph.osd.3.trial096.stdout:Feb 13 03:39:55 trial096 podman[80769]: 2026-02-13 03:39:55.946451262 +0000 UTC m=+5.071075513 container died 169b6ff2b46ab79bb947b60ca5aaff52906c60b90f584ca1f65f4bdcbb5307fa (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-3, ceph=True, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, vendor=Rocky Enterprise Software Foundation, name=rockylinux, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image) 2026-02-13T03:39:56.237 INFO:journalctl@ceph.osd.3.trial096.stdout:Feb 13 03:39:55 trial096 podman[80769]: 2026-02-13 03:39:55.956285522 +0000 UTC m=+5.080909773 container remove 169b6ff2b46ab79bb947b60ca5aaff52906c60b90f584ca1f65f4bdcbb5307fa (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, name=rockylinux, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10) 2026-02-13T03:39:56.237 INFO:journalctl@ceph.osd.3.trial096.stdout:Feb 13 03:39:55 trial096 bash[80769]: ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-3 2026-02-13T03:39:56.237 INFO:journalctl@ceph.osd.3.trial096.stdout:Feb 13 03:39:56 trial096 podman[80898]: 2026-02-13 03:39:56.082895371 +0000 UTC m=+0.015447521 container create ffc8d435f63cfa7f8ce8784ee0d57452447a9051488b7649de47b0a63a4b2231 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-3-deactivate, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, OSD_FLAVOR=default, license=BSD-3-Clause, name=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, version=10, org.opencontainers.image.authors=Ceph Release Team , ceph=True) 2026-02-13T03:39:56.237 INFO:journalctl@ceph.osd.3.trial096.stdout:Feb 13 03:39:56 trial096 podman[80898]: 2026-02-13 03:39:56.110409791 +0000 UTC m=+0.042961881 container init ffc8d435f63cfa7f8ce8784ee0d57452447a9051488b7649de47b0a63a4b2231 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-3-deactivate, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, ceph=True, name=rockylinux, org.opencontainers.image.version=10, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T03:39:56.238 INFO:journalctl@ceph.osd.3.trial096.stdout:Feb 13 03:39:56 trial096 podman[80898]: 2026-02-13 03:39:56.11304559 +0000 UTC m=+0.045597670 container start ffc8d435f63cfa7f8ce8784ee0d57452447a9051488b7649de47b0a63a4b2231 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-3-deactivate, io.buildah.version=1.33.7, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T03:39:56.238 INFO:journalctl@ceph.osd.3.trial096.stdout:Feb 13 03:39:56 trial096 podman[80898]: 2026-02-13 03:39:56.113587294 +0000 UTC m=+0.046139374 container attach ffc8d435f63cfa7f8ce8784ee0d57452447a9051488b7649de47b0a63a4b2231 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-3-deactivate, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, ceph=True, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T03:39:56.238 INFO:journalctl@ceph.osd.3.trial096.stdout:Feb 13 03:39:56 trial096 podman[80898]: 2026-02-13 03:39:56.076538701 +0000 UTC m=+0.009090781 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T03:39:56.238 INFO:journalctl@ceph.osd.3.trial096.stdout:Feb 13 03:39:56 trial096 podman[80898]: 2026-02-13 03:39:56.234618367 +0000 UTC m=+0.167170457 container died ffc8d435f63cfa7f8ce8784ee0d57452447a9051488b7649de47b0a63a4b2231 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-3-deactivate, license=BSD-3-Clause, ceph=True, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image) 2026-02-13T03:39:56.273 DEBUG:teuthology.orchestra.run.trial096:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.3.service' 2026-02-13T03:39:56.309 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:39:56.310 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-02-13T03:39:56.310 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2026-02-13T03:39:56.310 DEBUG:teuthology.orchestra.run.trial132:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.4 2026-02-13T03:39:56.732 INFO:journalctl@ceph.osd.4.trial132.stdout:Feb 13 03:39:56 trial132 systemd[1]: Stopping Ceph osd.4 for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:39:56.732 INFO:journalctl@ceph.osd.4.trial132.stdout:Feb 13 03:39:56 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-4[37951]: 2026-02-13T03:39:56.416+0000 7fd7c644d6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T03:39:56.732 INFO:journalctl@ceph.osd.4.trial132.stdout:Feb 13 03:39:56 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-4[37951]: 2026-02-13T03:39:56.416+0000 7fd7c644d6c0 -1 osd.4 72 *** Got signal Terminated *** 2026-02-13T03:39:56.732 INFO:journalctl@ceph.osd.4.trial132.stdout:Feb 13 03:39:56 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-4[37951]: 2026-02-13T03:39:56.417+0000 7fd7c644d6c0 -1 osd.4 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T03:40:00.674 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:00 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6[49624]: 2026-02-13T03:40:00.318+0000 7ff3f71966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:35.335006+0000 front 2026-02-13T03:39:35.335021+0000 (oldest deadline 2026-02-13T03:39:59.435191+0000) 2026-02-13T03:40:00.732 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:00 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:00.306+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:01.617 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:01 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:01.276+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:01.617 INFO:journalctl@ceph.osd.4.trial132.stdout:Feb 13 03:40:01 trial132 podman[58452]: 2026-02-13 03:40:01.487114259 +0000 UTC m=+5.081153653 container died 78c9088547677d4651f34abba427dbcca5d34ab906c3fef56dfd04c127bbfa87 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-4, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, version=10, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, OSD_FLAVOR=default, ceph=True, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T03:40:01.617 INFO:journalctl@ceph.osd.4.trial132.stdout:Feb 13 03:40:01 trial132 podman[58452]: 2026-02-13 03:40:01.495885346 +0000 UTC m=+5.089924730 container remove 78c9088547677d4651f34abba427dbcca5d34ab906c3fef56dfd04c127bbfa87 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-4, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T03:40:01.617 INFO:journalctl@ceph.osd.4.trial132.stdout:Feb 13 03:40:01 trial132 bash[58452]: ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-4 2026-02-13T03:40:01.674 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:01 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6[49624]: 2026-02-13T03:40:01.283+0000 7ff3f71966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:35.335006+0000 front 2026-02-13T03:39:35.335021+0000 (oldest deadline 2026-02-13T03:39:59.435191+0000) 2026-02-13T03:40:01.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:01 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:01.408+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.561907+0000 front 2026-02-13T03:39:36.561858+0000 (oldest deadline 2026-02-13T03:40:00.661898+0000) 2026-02-13T03:40:01.806 DEBUG:teuthology.orchestra.run.trial132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.4.service' 2026-02-13T03:40:01.840 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:40:01.840 INFO:tasks.cephadm.osd.4:Stopped osd.4 2026-02-13T03:40:01.840 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2026-02-13T03:40:01.840 DEBUG:teuthology.orchestra.run.trial133:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.5 2026-02-13T03:40:02.263 INFO:journalctl@ceph.osd.5.trial133.stdout:Feb 13 03:40:01 trial133 systemd[1]: Stopping Ceph osd.5 for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:40:02.263 INFO:journalctl@ceph.osd.5.trial133.stdout:Feb 13 03:40:01 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-5[38366]: 2026-02-13T03:40:01.935+0000 7fb6f3e136c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T03:40:02.263 INFO:journalctl@ceph.osd.5.trial133.stdout:Feb 13 03:40:01 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-5[38366]: 2026-02-13T03:40:01.935+0000 7fb6f3e136c0 -1 osd.5 72 *** Got signal Terminated *** 2026-02-13T03:40:02.263 INFO:journalctl@ceph.osd.5.trial133.stdout:Feb 13 03:40:01 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-5[38366]: 2026-02-13T03:40:01.935+0000 7fb6f3e136c0 -1 osd.5 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T03:40:02.674 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:02 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6[49624]: 2026-02-13T03:40:02.256+0000 7ff3f71966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:35.335006+0000 front 2026-02-13T03:39:35.335021+0000 (oldest deadline 2026-02-13T03:39:59.435191+0000) 2026-02-13T03:40:02.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:02 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:02.477+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:02.732 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:02 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:02.294+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:02.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:02 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:02.386+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.561907+0000 front 2026-02-13T03:39:36.561858+0000 (oldest deadline 2026-02-13T03:40:00.661898+0000) 2026-02-13T03:40:02.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:02 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:02.498+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:03.524 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:03 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6[49624]: 2026-02-13T03:40:03.271+0000 7ff3f71966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:35.335006+0000 front 2026-02-13T03:39:35.335021+0000 (oldest deadline 2026-02-13T03:39:59.435191+0000) 2026-02-13T03:40:03.731 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:03 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:03.247+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:03.763 INFO:journalctl@ceph.osd.5.trial133.stdout:Feb 13 03:40:03 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-5[38366]: 2026-02-13T03:40:03.618+0000 7fb6f04d86c0 -1 osd.5 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.157815+0000 front 2026-02-13T03:39:39.158005+0000 (oldest deadline 2026-02-13T03:40:03.257911+0000) 2026-02-13T03:40:03.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:03 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:03.417+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.561907+0000 front 2026-02-13T03:39:36.561858+0000 (oldest deadline 2026-02-13T03:40:00.661898+0000) 2026-02-13T03:40:03.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:03 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:03.535+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:03.924 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:03 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:03.522+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:04.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:04 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:04.234+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:04.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:04 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:04.492+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:04.674 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:04 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6[49624]: 2026-02-13T03:40:04.315+0000 7ff3f71966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:35.335006+0000 front 2026-02-13T03:39:35.335021+0000 (oldest deadline 2026-02-13T03:39:59.435191+0000) 2026-02-13T03:40:04.763 INFO:journalctl@ceph.osd.5.trial133.stdout:Feb 13 03:40:04 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-5[38366]: 2026-02-13T03:40:04.602+0000 7fb6f04d86c0 -1 osd.5 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.157815+0000 front 2026-02-13T03:39:39.158005+0000 (oldest deadline 2026-02-13T03:40:03.257911+0000) 2026-02-13T03:40:04.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:04 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:04.581+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:04.764 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:04 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:04.448+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.561907+0000 front 2026-02-13T03:39:36.561858+0000 (oldest deadline 2026-02-13T03:40:00.661898+0000) 2026-02-13T03:40:05.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:05 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:05.195+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:05.482 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:05 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:40:05.230+0000 7fa17a76f6c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.183001+0000 front 2026-02-13T03:39:40.183014+0000 (oldest deadline 2026-02-13T03:40:04.883133+0000) 2026-02-13T03:40:05.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:05 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:05.501+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:05.674 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:05 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6[49624]: 2026-02-13T03:40:05.295+0000 7ff3f71966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:35.335006+0000 front 2026-02-13T03:39:35.335021+0000 (oldest deadline 2026-02-13T03:39:59.435191+0000) 2026-02-13T03:40:05.763 INFO:journalctl@ceph.osd.5.trial133.stdout:Feb 13 03:40:05 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-5[38366]: 2026-02-13T03:40:05.610+0000 7fb6f04d86c0 -1 osd.5 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.157815+0000 front 2026-02-13T03:39:39.158005+0000 (oldest deadline 2026-02-13T03:40:03.257911+0000) 2026-02-13T03:40:05.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:05 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:05.475+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.561907+0000 front 2026-02-13T03:39:36.561858+0000 (oldest deadline 2026-02-13T03:40:00.661898+0000) 2026-02-13T03:40:05.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:05 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:05.592+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:05.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:05 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:05.592+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:06.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:06 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:06.147+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:06.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:06 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:06.147+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:06.482 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:06 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:40:06.198+0000 7fa17a76f6c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.183001+0000 front 2026-02-13T03:39:40.183014+0000 (oldest deadline 2026-02-13T03:40:04.883133+0000) 2026-02-13T03:40:06.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:06 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:06.458+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:06.674 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:06 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6[49624]: 2026-02-13T03:40:06.287+0000 7ff3f71966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:35.335006+0000 front 2026-02-13T03:39:35.335021+0000 (oldest deadline 2026-02-13T03:39:59.435191+0000) 2026-02-13T03:40:06.763 INFO:journalctl@ceph.osd.5.trial133.stdout:Feb 13 03:40:06 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-5[38366]: 2026-02-13T03:40:06.599+0000 7fb6f04d86c0 -1 osd.5 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.157815+0000 front 2026-02-13T03:39:39.158005+0000 (oldest deadline 2026-02-13T03:40:03.257911+0000) 2026-02-13T03:40:06.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:06 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:06.453+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.561907+0000 front 2026-02-13T03:39:36.561858+0000 (oldest deadline 2026-02-13T03:40:00.661898+0000) 2026-02-13T03:40:06.764 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:06 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:06.453+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.662213+0000 front 2026-02-13T03:39:40.662069+0000 (oldest deadline 2026-02-13T03:40:05.962103+0000) 2026-02-13T03:40:06.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:06 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:06.619+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:06.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:06 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:06.619+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:07.264 INFO:journalctl@ceph.osd.5.trial133.stdout:Feb 13 03:40:07 trial133 podman[60159]: 2026-02-13 03:40:07.005129449 +0000 UTC m=+5.081430584 container died 96c38a593a57cdb4b73dca485744a82f8addd96dd5c821739d35e847934ab0f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-5, summary=Rocky Linux Base image, org.opencontainers.image.title=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, vendor=Rocky Enterprise Software Foundation, version=10, license=BSD-3-Clause) 2026-02-13T03:40:07.264 INFO:journalctl@ceph.osd.5.trial133.stdout:Feb 13 03:40:07 trial133 podman[60159]: 2026-02-13 03:40:07.014272398 +0000 UTC m=+5.090573523 container remove 96c38a593a57cdb4b73dca485744a82f8addd96dd5c821739d35e847934ab0f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-5, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.version=10, io.buildah.version=1.33.7, license=BSD-3-Clause, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T03:40:07.264 INFO:journalctl@ceph.osd.5.trial133.stdout:Feb 13 03:40:07 trial133 bash[60159]: ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-5 2026-02-13T03:40:07.264 INFO:journalctl@ceph.osd.5.trial133.stdout:Feb 13 03:40:07 trial133 podman[60291]: 2026-02-13 03:40:07.148314517 +0000 UTC m=+0.016235266 container create 5aa4da29e268d6053a267eee2330a78f898b7ef26ae287c7844c3094424d4a18 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-5-deactivate, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, summary=Rocky Linux Base image, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True) 2026-02-13T03:40:07.264 INFO:journalctl@ceph.osd.5.trial133.stdout:Feb 13 03:40:07 trial133 podman[60291]: 2026-02-13 03:40:07.183591163 +0000 UTC m=+0.051511912 container init 5aa4da29e268d6053a267eee2330a78f898b7ef26ae287c7844c3094424d4a18 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-5-deactivate, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, version=10, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T03:40:07.264 INFO:journalctl@ceph.osd.5.trial133.stdout:Feb 13 03:40:07 trial133 podman[60291]: 2026-02-13 03:40:07.186239794 +0000 UTC m=+0.054160543 container start 5aa4da29e268d6053a267eee2330a78f898b7ef26ae287c7844c3094424d4a18 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-5-deactivate, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T03:40:07.265 INFO:journalctl@ceph.osd.5.trial133.stdout:Feb 13 03:40:07 trial133 podman[60291]: 2026-02-13 03:40:07.186720382 +0000 UTC m=+0.054641141 container attach 5aa4da29e268d6053a267eee2330a78f898b7ef26ae287c7844c3094424d4a18 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-5-deactivate, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.opencontainers.image.version=10, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T03:40:07.265 INFO:journalctl@ceph.osd.5.trial133.stdout:Feb 13 03:40:07 trial133 podman[60291]: 2026-02-13 03:40:07.141774744 +0000 UTC m=+0.009695513 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T03:40:07.345 DEBUG:teuthology.orchestra.run.trial133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.5.service' 2026-02-13T03:40:07.380 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:40:07.380 INFO:tasks.cephadm.osd.5:Stopped osd.5 2026-02-13T03:40:07.380 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2026-02-13T03:40:07.380 DEBUG:teuthology.orchestra.run.trial096:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.6 2026-02-13T03:40:07.481 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:07 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:40:07.186+0000 7fa17a76f6c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.183001+0000 front 2026-02-13T03:39:40.183014+0000 (oldest deadline 2026-02-13T03:40:04.883133+0000) 2026-02-13T03:40:07.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:07 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:07.178+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:07.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:07 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:07.178+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:07.583 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:07 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:07.432+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.561907+0000 front 2026-02-13T03:39:36.561858+0000 (oldest deadline 2026-02-13T03:40:00.661898+0000) 2026-02-13T03:40:07.583 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:07 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:07.432+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.662213+0000 front 2026-02-13T03:39:40.662069+0000 (oldest deadline 2026-02-13T03:40:05.962103+0000) 2026-02-13T03:40:07.583 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:07 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:07.580+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:07.583 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:07 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:07.580+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:07.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:07 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:07.413+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:07.674 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:07 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6[49624]: 2026-02-13T03:40:07.245+0000 7ff3f71966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:35.335006+0000 front 2026-02-13T03:39:35.335021+0000 (oldest deadline 2026-02-13T03:39:59.435191+0000) 2026-02-13T03:40:07.674 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:07 trial096 systemd[1]: Stopping Ceph osd.6 for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:40:07.674 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:07 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6[49624]: 2026-02-13T03:40:07.474+0000 7ff3faad16c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T03:40:07.674 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:07 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6[49624]: 2026-02-13T03:40:07.474+0000 7ff3faad16c0 -1 osd.6 72 *** Got signal Terminated *** 2026-02-13T03:40:07.674 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:07 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6[49624]: 2026-02-13T03:40:07.474+0000 7ff3faad16c0 -1 osd.6 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T03:40:08.482 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:08 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:40:08.142+0000 7fa17a76f6c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.183001+0000 front 2026-02-13T03:39:40.183014+0000 (oldest deadline 2026-02-13T03:40:04.883133+0000) 2026-02-13T03:40:08.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:08 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:08.140+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:08.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:08 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:08.140+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:08.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:08 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:08.430+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:08.675 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:08 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6[49624]: 2026-02-13T03:40:08.203+0000 7ff3f71966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:35.335006+0000 front 2026-02-13T03:39:35.335021+0000 (oldest deadline 2026-02-13T03:39:59.435191+0000) 2026-02-13T03:40:08.675 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:08 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6[49624]: 2026-02-13T03:40:08.203+0000 7ff3f71966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.835848+0000 front 2026-02-13T03:39:42.835882+0000 (oldest deadline 2026-02-13T03:40:07.535922+0000) 2026-02-13T03:40:08.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:08 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:08.447+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.561907+0000 front 2026-02-13T03:39:36.561858+0000 (oldest deadline 2026-02-13T03:40:00.661898+0000) 2026-02-13T03:40:08.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:08 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:08.447+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.662213+0000 front 2026-02-13T03:39:40.662069+0000 (oldest deadline 2026-02-13T03:40:05.962103+0000) 2026-02-13T03:40:08.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:08 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:08.551+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:08.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:08 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:08.551+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:09.482 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:09 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:40:09.112+0000 7fa17a76f6c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.183001+0000 front 2026-02-13T03:39:40.183014+0000 (oldest deadline 2026-02-13T03:40:04.883133+0000) 2026-02-13T03:40:09.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:09 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:09.123+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:09.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:09 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:09.123+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:09.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:09 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:09.383+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:09.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:09 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:09.383+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:43.827921+0000 front 2026-02-13T03:39:43.827942+0000 (oldest deadline 2026-02-13T03:40:09.127882+0000) 2026-02-13T03:40:09.674 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:09 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6[49624]: 2026-02-13T03:40:09.247+0000 7ff3f71966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:35.335006+0000 front 2026-02-13T03:39:35.335021+0000 (oldest deadline 2026-02-13T03:39:59.435191+0000) 2026-02-13T03:40:09.675 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:09 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6[49624]: 2026-02-13T03:40:09.247+0000 7ff3f71966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.835848+0000 front 2026-02-13T03:39:42.835882+0000 (oldest deadline 2026-02-13T03:40:07.535922+0000) 2026-02-13T03:40:09.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:09 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:09.465+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.561907+0000 front 2026-02-13T03:39:36.561858+0000 (oldest deadline 2026-02-13T03:40:00.661898+0000) 2026-02-13T03:40:09.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:09 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:09.465+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.662213+0000 front 2026-02-13T03:39:40.662069+0000 (oldest deadline 2026-02-13T03:40:05.962103+0000) 2026-02-13T03:40:09.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:09 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:09.579+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:09.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:09 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:09.579+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:10.482 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:10 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:40:10.156+0000 7fa17a76f6c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.183001+0000 front 2026-02-13T03:39:40.183014+0000 (oldest deadline 2026-02-13T03:40:04.883133+0000) 2026-02-13T03:40:10.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:10 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:10.083+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:10.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:10 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:10.083+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:10.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:10 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:10.422+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:10.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:10 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:10.422+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:43.827921+0000 front 2026-02-13T03:39:43.827942+0000 (oldest deadline 2026-02-13T03:40:09.127882+0000) 2026-02-13T03:40:10.675 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:10 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6[49624]: 2026-02-13T03:40:10.243+0000 7ff3f71966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:35.335006+0000 front 2026-02-13T03:39:35.335021+0000 (oldest deadline 2026-02-13T03:39:59.435191+0000) 2026-02-13T03:40:10.675 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:10 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6[49624]: 2026-02-13T03:40:10.243+0000 7ff3f71966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.835848+0000 front 2026-02-13T03:39:42.835882+0000 (oldest deadline 2026-02-13T03:40:07.535922+0000) 2026-02-13T03:40:10.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:10 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:10.471+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.561907+0000 front 2026-02-13T03:39:36.561858+0000 (oldest deadline 2026-02-13T03:40:00.661898+0000) 2026-02-13T03:40:10.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:10 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:10.471+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.662213+0000 front 2026-02-13T03:39:40.662069+0000 (oldest deadline 2026-02-13T03:40:05.962103+0000) 2026-02-13T03:40:10.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:10 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:10.533+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:10.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:10 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:10.533+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:11.482 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:11 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:40:11.202+0000 7fa17a76f6c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.183001+0000 front 2026-02-13T03:39:40.183014+0000 (oldest deadline 2026-02-13T03:40:04.883133+0000) 2026-02-13T03:40:11.482 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:11 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:40:11.202+0000 7fa17a76f6c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.183545+0000 front 2026-02-13T03:39:50.183529+0000 (oldest deadline 2026-02-13T03:40:10.683586+0000) 2026-02-13T03:40:11.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:11 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:11.057+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:11.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:11 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:11.057+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:11.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:11 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:11.392+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:11.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:11 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:11.392+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:43.827921+0000 front 2026-02-13T03:39:43.827942+0000 (oldest deadline 2026-02-13T03:40:09.127882+0000) 2026-02-13T03:40:11.675 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:11 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6[49624]: 2026-02-13T03:40:11.290+0000 7ff3f71966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:35.335006+0000 front 2026-02-13T03:39:35.335021+0000 (oldest deadline 2026-02-13T03:39:59.435191+0000) 2026-02-13T03:40:11.675 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:11 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6[49624]: 2026-02-13T03:40:11.290+0000 7ff3f71966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.835848+0000 front 2026-02-13T03:39:42.835882+0000 (oldest deadline 2026-02-13T03:40:07.535922+0000) 2026-02-13T03:40:11.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:11 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:11.449+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.561907+0000 front 2026-02-13T03:39:36.561858+0000 (oldest deadline 2026-02-13T03:40:00.661898+0000) 2026-02-13T03:40:11.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:11 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:11.449+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.662213+0000 front 2026-02-13T03:39:40.662069+0000 (oldest deadline 2026-02-13T03:40:05.962103+0000) 2026-02-13T03:40:11.764 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:11 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:11.449+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:46.462409+0000 front 2026-02-13T03:39:46.462417+0000 (oldest deadline 2026-02-13T03:40:11.162524+0000) 2026-02-13T03:40:11.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:11 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:11.497+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:11.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:11 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:11.497+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:11.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:11 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:11.497+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:12.482 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:12 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:40:12.178+0000 7fa17a76f6c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.183001+0000 front 2026-02-13T03:39:40.183014+0000 (oldest deadline 2026-02-13T03:40:04.883133+0000) 2026-02-13T03:40:12.482 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:12 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:40:12.178+0000 7fa17a76f6c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.183545+0000 front 2026-02-13T03:39:50.183529+0000 (oldest deadline 2026-02-13T03:40:10.683586+0000) 2026-02-13T03:40:12.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:12 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:12.078+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:12.483 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:12 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:12.078+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:12.483 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:12 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:12.078+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:45.338724+0000 front 2026-02-13T03:39:45.338808+0000 (oldest deadline 2026-02-13T03:40:11.238717+0000) 2026-02-13T03:40:12.671 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:12 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6[49624]: 2026-02-13T03:40:12.332+0000 7ff3f71966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:35.335006+0000 front 2026-02-13T03:39:35.335021+0000 (oldest deadline 2026-02-13T03:39:59.435191+0000) 2026-02-13T03:40:12.671 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:12 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6[49624]: 2026-02-13T03:40:12.332+0000 7ff3f71966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.835848+0000 front 2026-02-13T03:39:42.835882+0000 (oldest deadline 2026-02-13T03:40:07.535922+0000) 2026-02-13T03:40:12.671 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:12 trial096 podman[81035]: 2026-02-13 03:40:12.533368877 +0000 UTC m=+5.071960857 container died c47e6233ec925162aed13de4e4fa9b78e5e15d4505583c14954739dcb40714b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.version=10, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, ceph=True) 2026-02-13T03:40:12.671 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:12 trial096 podman[81035]: 2026-02-13 03:40:12.541834288 +0000 UTC m=+5.080426257 container remove c47e6233ec925162aed13de4e4fa9b78e5e15d4505583c14954739dcb40714b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T03:40:12.671 INFO:journalctl@ceph.osd.6.trial096.stdout:Feb 13 03:40:12 trial096 bash[81035]: ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-6 2026-02-13T03:40:12.671 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:12 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:12.407+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:12.671 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:12 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:12.407+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:43.827921+0000 front 2026-02-13T03:39:43.827942+0000 (oldest deadline 2026-02-13T03:40:09.127882+0000) 2026-02-13T03:40:12.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:12 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:12.402+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.561907+0000 front 2026-02-13T03:39:36.561858+0000 (oldest deadline 2026-02-13T03:40:00.661898+0000) 2026-02-13T03:40:12.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:12 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:12.402+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.662213+0000 front 2026-02-13T03:39:40.662069+0000 (oldest deadline 2026-02-13T03:40:05.962103+0000) 2026-02-13T03:40:12.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:12 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:12.402+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:46.462409+0000 front 2026-02-13T03:39:46.462417+0000 (oldest deadline 2026-02-13T03:40:11.162524+0000) 2026-02-13T03:40:12.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:12 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:12.500+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:12.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:12 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:12.500+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:12.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:12 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:12.500+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:12.871 DEBUG:teuthology.orchestra.run.trial096:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.6.service' 2026-02-13T03:40:12.906 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:40:12.906 INFO:tasks.cephadm.osd.6:Stopped osd.6 2026-02-13T03:40:12.907 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2026-02-13T03:40:12.907 DEBUG:teuthology.orchestra.run.trial132:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.7 2026-02-13T03:40:13.232 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:13 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:13.050+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:13.232 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:13 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:13.050+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:13.232 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:13 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:13.050+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:45.338724+0000 front 2026-02-13T03:39:45.338808+0000 (oldest deadline 2026-02-13T03:40:11.238717+0000) 2026-02-13T03:40:13.233 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:12 trial132 systemd[1]: Stopping Ceph osd.7 for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:40:13.233 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:13 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:40:13.020+0000 7fa1820b26c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T03:40:13.233 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:13 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:40:13.020+0000 7fa1820b26c0 -1 osd.7 72 *** Got signal Terminated *** 2026-02-13T03:40:13.233 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:13 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:40:13.020+0000 7fa1820b26c0 -1 osd.7 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T03:40:13.233 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:13 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:40:13.147+0000 7fa17a76f6c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.183001+0000 front 2026-02-13T03:39:40.183014+0000 (oldest deadline 2026-02-13T03:40:04.883133+0000) 2026-02-13T03:40:13.233 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:13 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:40:13.147+0000 7fa17a76f6c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.183545+0000 front 2026-02-13T03:39:50.183529+0000 (oldest deadline 2026-02-13T03:40:10.683586+0000) 2026-02-13T03:40:13.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:13 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:13.398+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:13.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:13 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:13.398+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:43.827921+0000 front 2026-02-13T03:39:43.827942+0000 (oldest deadline 2026-02-13T03:40:09.127882+0000) 2026-02-13T03:40:13.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:13 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:13.405+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.561907+0000 front 2026-02-13T03:39:36.561858+0000 (oldest deadline 2026-02-13T03:40:00.661898+0000) 2026-02-13T03:40:13.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:13 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:13.405+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.662213+0000 front 2026-02-13T03:39:40.662069+0000 (oldest deadline 2026-02-13T03:40:05.962103+0000) 2026-02-13T03:40:13.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:13 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:13.405+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:46.462409+0000 front 2026-02-13T03:39:46.462417+0000 (oldest deadline 2026-02-13T03:40:11.162524+0000) 2026-02-13T03:40:13.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:13 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:13.519+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:13.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:13 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:13.519+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:13.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:13 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:13.519+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:14.482 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:14 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:40:14.144+0000 7fa17a76f6c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.183001+0000 front 2026-02-13T03:39:40.183014+0000 (oldest deadline 2026-02-13T03:40:04.883133+0000) 2026-02-13T03:40:14.482 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:14 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:40:14.144+0000 7fa17a76f6c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.183545+0000 front 2026-02-13T03:39:50.183529+0000 (oldest deadline 2026-02-13T03:40:10.683586+0000) 2026-02-13T03:40:14.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:14 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:14.081+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:14.483 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:14 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:14.081+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:14.483 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:14 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:14.081+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:45.338724+0000 front 2026-02-13T03:39:45.338808+0000 (oldest deadline 2026-02-13T03:40:11.238717+0000) 2026-02-13T03:40:14.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:14 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:14.350+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:14.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:14 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:14.350+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:43.827921+0000 front 2026-02-13T03:39:43.827942+0000 (oldest deadline 2026-02-13T03:40:09.127882+0000) 2026-02-13T03:40:14.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:14 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:14.390+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.561907+0000 front 2026-02-13T03:39:36.561858+0000 (oldest deadline 2026-02-13T03:40:00.661898+0000) 2026-02-13T03:40:14.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:14 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:14.390+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.662213+0000 front 2026-02-13T03:39:40.662069+0000 (oldest deadline 2026-02-13T03:40:05.962103+0000) 2026-02-13T03:40:14.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:14 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:14.390+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:46.462409+0000 front 2026-02-13T03:39:46.462417+0000 (oldest deadline 2026-02-13T03:40:11.162524+0000) 2026-02-13T03:40:14.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:14 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:14.522+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:14.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:14 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:14.522+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:14.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:14 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:14.522+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:15.481 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:15 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:40:15.098+0000 7fa17a76f6c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.183001+0000 front 2026-02-13T03:39:40.183014+0000 (oldest deadline 2026-02-13T03:40:04.883133+0000) 2026-02-13T03:40:15.482 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:15 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:40:15.098+0000 7fa17a76f6c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.183545+0000 front 2026-02-13T03:39:50.183529+0000 (oldest deadline 2026-02-13T03:40:10.683586+0000) 2026-02-13T03:40:15.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:15 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:15.119+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:15.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:15 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:15.119+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:15.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:15 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:15.119+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:45.338724+0000 front 2026-02-13T03:39:45.338808+0000 (oldest deadline 2026-02-13T03:40:11.238717+0000) 2026-02-13T03:40:15.664 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:15 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:15.569+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:15.664 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:15 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:15.569+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:15.664 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:15 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:15.569+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:15.664 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:15 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:15.362+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.561907+0000 front 2026-02-13T03:39:36.561858+0000 (oldest deadline 2026-02-13T03:40:00.661898+0000) 2026-02-13T03:40:15.664 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:15 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:15.362+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.662213+0000 front 2026-02-13T03:39:40.662069+0000 (oldest deadline 2026-02-13T03:40:05.962103+0000) 2026-02-13T03:40:15.664 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:15 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:15.362+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:46.462409+0000 front 2026-02-13T03:39:46.462417+0000 (oldest deadline 2026-02-13T03:40:11.162524+0000) 2026-02-13T03:40:15.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:15 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:15.320+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:15.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:15 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:15.320+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:43.827921+0000 front 2026-02-13T03:39:43.827942+0000 (oldest deadline 2026-02-13T03:40:09.127882+0000) 2026-02-13T03:40:15.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:15 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:15.320+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:49.128144+0000 front 2026-02-13T03:39:49.128235+0000 (oldest deadline 2026-02-13T03:40:14.428134+0000) 2026-02-13T03:40:16.482 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:16 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:40:16.113+0000 7fa17a76f6c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.183001+0000 front 2026-02-13T03:39:40.183014+0000 (oldest deadline 2026-02-13T03:40:04.883133+0000) 2026-02-13T03:40:16.482 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:16 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:40:16.113+0000 7fa17a76f6c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.183545+0000 front 2026-02-13T03:39:50.183529+0000 (oldest deadline 2026-02-13T03:40:10.683586+0000) 2026-02-13T03:40:16.483 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:16 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:16.157+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:16.483 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:16 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:16.157+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:16.483 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:16 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:16.157+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:45.338724+0000 front 2026-02-13T03:39:45.338808+0000 (oldest deadline 2026-02-13T03:40:11.238717+0000) 2026-02-13T03:40:16.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:16 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:16.313+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:16.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:16 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:16.313+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:43.827921+0000 front 2026-02-13T03:39:43.827942+0000 (oldest deadline 2026-02-13T03:40:09.127882+0000) 2026-02-13T03:40:16.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:16 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:16.313+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:49.128144+0000 front 2026-02-13T03:39:49.128235+0000 (oldest deadline 2026-02-13T03:40:14.428134+0000) 2026-02-13T03:40:16.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:16 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:16.409+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.561907+0000 front 2026-02-13T03:39:36.561858+0000 (oldest deadline 2026-02-13T03:40:00.661898+0000) 2026-02-13T03:40:16.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:16 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:16.409+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.662213+0000 front 2026-02-13T03:39:40.662069+0000 (oldest deadline 2026-02-13T03:40:05.962103+0000) 2026-02-13T03:40:16.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:16 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:16.409+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:46.462409+0000 front 2026-02-13T03:39:46.462417+0000 (oldest deadline 2026-02-13T03:40:11.162524+0000) 2026-02-13T03:40:16.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:16 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:16.567+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:16.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:16 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:16.567+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:16.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:16 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:16.567+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:17.482 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:17 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:40:17.065+0000 7fa17a76f6c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.183001+0000 front 2026-02-13T03:39:40.183014+0000 (oldest deadline 2026-02-13T03:40:04.883133+0000) 2026-02-13T03:40:17.482 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:17 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7[44511]: 2026-02-13T03:40:17.065+0000 7fa17a76f6c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.183545+0000 front 2026-02-13T03:39:50.183529+0000 (oldest deadline 2026-02-13T03:40:10.683586+0000) 2026-02-13T03:40:17.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:17 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:17.188+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:17.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:17 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:17.188+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:17.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:17 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:17.188+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:45.338724+0000 front 2026-02-13T03:39:45.338808+0000 (oldest deadline 2026-02-13T03:40:11.238717+0000) 2026-02-13T03:40:17.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:17 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:17.188+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:51.239005+0000 front 2026-02-13T03:39:51.239036+0000 (oldest deadline 2026-02-13T03:40:17.139008+0000) 2026-02-13T03:40:17.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:17 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:17.282+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:17.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:17 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:17.282+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:43.827921+0000 front 2026-02-13T03:39:43.827942+0000 (oldest deadline 2026-02-13T03:40:09.127882+0000) 2026-02-13T03:40:17.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:17 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:17.282+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:49.128144+0000 front 2026-02-13T03:39:49.128235+0000 (oldest deadline 2026-02-13T03:40:14.428134+0000) 2026-02-13T03:40:17.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:17 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:17.363+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.561907+0000 front 2026-02-13T03:39:36.561858+0000 (oldest deadline 2026-02-13T03:40:00.661898+0000) 2026-02-13T03:40:17.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:17 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:17.363+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.662213+0000 front 2026-02-13T03:39:40.662069+0000 (oldest deadline 2026-02-13T03:40:05.962103+0000) 2026-02-13T03:40:17.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:17 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:17.363+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:46.462409+0000 front 2026-02-13T03:39:46.462417+0000 (oldest deadline 2026-02-13T03:40:11.162524+0000) 2026-02-13T03:40:17.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:17 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:17.596+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:17.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:17 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:17.596+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:17.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:17 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:17.596+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:18.363 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:18 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:18.206+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:18.363 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:18 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:18.206+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:18.363 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:18 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:18.206+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:45.338724+0000 front 2026-02-13T03:39:45.338808+0000 (oldest deadline 2026-02-13T03:40:11.238717+0000) 2026-02-13T03:40:18.363 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:18 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:18.206+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:51.239005+0000 front 2026-02-13T03:39:51.239036+0000 (oldest deadline 2026-02-13T03:40:17.139008+0000) 2026-02-13T03:40:18.363 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:18 trial132 podman[58721]: 2026-02-13 03:40:18.080742977 +0000 UTC m=+5.072823051 container died 2534c437f280a94f0aea3991934a1d3c0bd4ac458639c9de25cffbe508a6b50c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.version=10, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image) 2026-02-13T03:40:18.363 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:18 trial132 podman[58721]: 2026-02-13 03:40:18.089200127 +0000 UTC m=+5.081280201 container remove 2534c437f280a94f0aea3991934a1d3c0bd4ac458639c9de25cffbe508a6b50c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, summary=Rocky Linux Base image, org.opencontainers.image.version=10, name=rockylinux, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T03:40:18.363 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:18 trial132 bash[58721]: ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7 2026-02-13T03:40:18.363 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:18 trial132 podman[58852]: 2026-02-13 03:40:18.212574096 +0000 UTC m=+0.015260595 container create beac1ea077f11f18a2696c19c6a132a83c0b2b25a8650378a9b8511a8d1331d4 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7-deactivate, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, org.opencontainers.image.version=10, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T03:40:18.363 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:18 trial132 podman[58852]: 2026-02-13 03:40:18.242593486 +0000 UTC m=+0.045279915 container init beac1ea077f11f18a2696c19c6a132a83c0b2b25a8650378a9b8511a8d1331d4 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7-deactivate, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, version=10, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, org.opencontainers.image.version=10) 2026-02-13T03:40:18.363 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:18 trial132 podman[58852]: 2026-02-13 03:40:18.245127319 +0000 UTC m=+0.047813748 container start beac1ea077f11f18a2696c19c6a132a83c0b2b25a8650378a9b8511a8d1331d4 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, version=10, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T03:40:18.363 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:18 trial132 podman[58852]: 2026-02-13 03:40:18.245633136 +0000 UTC m=+0.048319565 container attach beac1ea077f11f18a2696c19c6a132a83c0b2b25a8650378a9b8511a8d1331d4 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-7-deactivate, version=10, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image) 2026-02-13T03:40:18.364 INFO:journalctl@ceph.osd.7.trial132.stdout:Feb 13 03:40:18 trial132 podman[58852]: 2026-02-13 03:40:18.205937123 +0000 UTC m=+0.008623542 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T03:40:18.390 DEBUG:teuthology.orchestra.run.trial132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.7.service' 2026-02-13T03:40:18.426 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:40:18.426 INFO:tasks.cephadm.osd.7:Stopped osd.7 2026-02-13T03:40:18.426 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2026-02-13T03:40:18.426 DEBUG:teuthology.orchestra.run.trial133:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.8 2026-02-13T03:40:18.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:18 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:18.245+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:18.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:18 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:18.245+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:43.827921+0000 front 2026-02-13T03:39:43.827942+0000 (oldest deadline 2026-02-13T03:40:09.127882+0000) 2026-02-13T03:40:18.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:18 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:18.245+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:49.128144+0000 front 2026-02-13T03:39:49.128235+0000 (oldest deadline 2026-02-13T03:40:14.428134+0000) 2026-02-13T03:40:18.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:18 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:18.245+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:54.428270+0000 front 2026-02-13T03:39:54.428282+0000 (oldest deadline 2026-02-13T03:40:17.328388+0000) 2026-02-13T03:40:18.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:18 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:18.567+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:18.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:18 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:18.567+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:18.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:18 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:18.567+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:18.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:18 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:18.567+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:53.581393+0000 front 2026-02-13T03:39:53.581467+0000 (oldest deadline 2026-02-13T03:40:18.281438+0000) 2026-02-13T03:40:18.764 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:18 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:18.409+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.561907+0000 front 2026-02-13T03:39:36.561858+0000 (oldest deadline 2026-02-13T03:40:00.661898+0000) 2026-02-13T03:40:18.764 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:18 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:18.409+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.662213+0000 front 2026-02-13T03:39:40.662069+0000 (oldest deadline 2026-02-13T03:40:05.962103+0000) 2026-02-13T03:40:18.764 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:18 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:18.409+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:46.462409+0000 front 2026-02-13T03:39:46.462417+0000 (oldest deadline 2026-02-13T03:40:11.162524+0000) 2026-02-13T03:40:18.764 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:18 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:18.409+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:52.863081+0000 front 2026-02-13T03:39:52.862974+0000 (oldest deadline 2026-02-13T03:40:18.163022+0000) 2026-02-13T03:40:18.764 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:18 trial133 systemd[1]: Stopping Ceph osd.8 for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:40:18.764 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:18 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:18.527+0000 7fab067856c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T03:40:18.765 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:18 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:18.527+0000 7fab067856c0 -1 osd.8 72 *** Got signal Terminated *** 2026-02-13T03:40:18.765 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:18 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:18.527+0000 7fab067856c0 -1 osd.8 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T03:40:19.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:19 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:19.171+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:19.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:19 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:19.171+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:19.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:19 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:19.171+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:45.338724+0000 front 2026-02-13T03:39:45.338808+0000 (oldest deadline 2026-02-13T03:40:11.238717+0000) 2026-02-13T03:40:19.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:19 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:19.171+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:51.239005+0000 front 2026-02-13T03:39:51.239036+0000 (oldest deadline 2026-02-13T03:40:17.139008+0000) 2026-02-13T03:40:19.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:19 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:19.262+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:19.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:19 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:19.262+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:43.827921+0000 front 2026-02-13T03:39:43.827942+0000 (oldest deadline 2026-02-13T03:40:09.127882+0000) 2026-02-13T03:40:19.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:19 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:19.262+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:49.128144+0000 front 2026-02-13T03:39:49.128235+0000 (oldest deadline 2026-02-13T03:40:14.428134+0000) 2026-02-13T03:40:19.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:19 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:19.262+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:54.428270+0000 front 2026-02-13T03:39:54.428282+0000 (oldest deadline 2026-02-13T03:40:17.328388+0000) 2026-02-13T03:40:19.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:19 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:19.425+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.561907+0000 front 2026-02-13T03:39:36.561858+0000 (oldest deadline 2026-02-13T03:40:00.661898+0000) 2026-02-13T03:40:19.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:19 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:19.425+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.662213+0000 front 2026-02-13T03:39:40.662069+0000 (oldest deadline 2026-02-13T03:40:05.962103+0000) 2026-02-13T03:40:19.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:19 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:19.425+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:46.462409+0000 front 2026-02-13T03:39:46.462417+0000 (oldest deadline 2026-02-13T03:40:11.162524+0000) 2026-02-13T03:40:19.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:19 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:19.425+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:52.863081+0000 front 2026-02-13T03:39:52.862974+0000 (oldest deadline 2026-02-13T03:40:18.163022+0000) 2026-02-13T03:40:19.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:19 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:19.545+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:19.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:19 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:19.545+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:19.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:19 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:19.545+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:19.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:19 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:19.545+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:53.581393+0000 front 2026-02-13T03:39:53.581467+0000 (oldest deadline 2026-02-13T03:40:18.281438+0000) 2026-02-13T03:40:20.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:20 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:20.160+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:20.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:20 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:20.160+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:20.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:20 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:20.160+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:45.338724+0000 front 2026-02-13T03:39:45.338808+0000 (oldest deadline 2026-02-13T03:40:11.238717+0000) 2026-02-13T03:40:20.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:20 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:20.160+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:51.239005+0000 front 2026-02-13T03:39:51.239036+0000 (oldest deadline 2026-02-13T03:40:17.139008+0000) 2026-02-13T03:40:20.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:20 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:20.263+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:20.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:20 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:20.263+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:43.827921+0000 front 2026-02-13T03:39:43.827942+0000 (oldest deadline 2026-02-13T03:40:09.127882+0000) 2026-02-13T03:40:20.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:20 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:20.263+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:49.128144+0000 front 2026-02-13T03:39:49.128235+0000 (oldest deadline 2026-02-13T03:40:14.428134+0000) 2026-02-13T03:40:20.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:20 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:20.263+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:54.428270+0000 front 2026-02-13T03:39:54.428282+0000 (oldest deadline 2026-02-13T03:40:17.328388+0000) 2026-02-13T03:40:20.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:20 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:20.474+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.561907+0000 front 2026-02-13T03:39:36.561858+0000 (oldest deadline 2026-02-13T03:40:00.661898+0000) 2026-02-13T03:40:20.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:20 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:20.474+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.662213+0000 front 2026-02-13T03:39:40.662069+0000 (oldest deadline 2026-02-13T03:40:05.962103+0000) 2026-02-13T03:40:20.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:20 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:20.474+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:46.462409+0000 front 2026-02-13T03:39:46.462417+0000 (oldest deadline 2026-02-13T03:40:11.162524+0000) 2026-02-13T03:40:20.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:20 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:20.474+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:52.863081+0000 front 2026-02-13T03:39:52.862974+0000 (oldest deadline 2026-02-13T03:40:18.163022+0000) 2026-02-13T03:40:20.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:20 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:20.537+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:20.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:20 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:20.537+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:20.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:20 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:20.537+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:20.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:20 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:20.537+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:53.581393+0000 front 2026-02-13T03:39:53.581467+0000 (oldest deadline 2026-02-13T03:40:18.281438+0000) 2026-02-13T03:40:21.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:21 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:21.182+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:21.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:21 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:21.182+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:21.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:21 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:21.182+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:45.338724+0000 front 2026-02-13T03:39:45.338808+0000 (oldest deadline 2026-02-13T03:40:11.238717+0000) 2026-02-13T03:40:21.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:21 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:21.182+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:51.239005+0000 front 2026-02-13T03:39:51.239036+0000 (oldest deadline 2026-02-13T03:40:17.139008+0000) 2026-02-13T03:40:21.575 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:21 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:21.278+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:21.575 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:21 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:21.278+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:43.827921+0000 front 2026-02-13T03:39:43.827942+0000 (oldest deadline 2026-02-13T03:40:09.127882+0000) 2026-02-13T03:40:21.575 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:21 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:21.278+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:49.128144+0000 front 2026-02-13T03:39:49.128235+0000 (oldest deadline 2026-02-13T03:40:14.428134+0000) 2026-02-13T03:40:21.575 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:21 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:21.278+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:54.428270+0000 front 2026-02-13T03:39:54.428282+0000 (oldest deadline 2026-02-13T03:40:17.328388+0000) 2026-02-13T03:40:21.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:21 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:21.440+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.561907+0000 front 2026-02-13T03:39:36.561858+0000 (oldest deadline 2026-02-13T03:40:00.661898+0000) 2026-02-13T03:40:21.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:21 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:21.440+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.662213+0000 front 2026-02-13T03:39:40.662069+0000 (oldest deadline 2026-02-13T03:40:05.962103+0000) 2026-02-13T03:40:21.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:21 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:21.440+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:46.462409+0000 front 2026-02-13T03:39:46.462417+0000 (oldest deadline 2026-02-13T03:40:11.162524+0000) 2026-02-13T03:40:21.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:21 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:21.440+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:52.863081+0000 front 2026-02-13T03:39:52.862974+0000 (oldest deadline 2026-02-13T03:40:18.163022+0000) 2026-02-13T03:40:21.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:21 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:21.500+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:21.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:21 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:21.500+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:21.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:21 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:21.500+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:21.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:21 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:21.500+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:53.581393+0000 front 2026-02-13T03:39:53.581467+0000 (oldest deadline 2026-02-13T03:40:18.281438+0000) 2026-02-13T03:40:22.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:22 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:22.161+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:22.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:22 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:22.161+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:22.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:22 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:22.161+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:45.338724+0000 front 2026-02-13T03:39:45.338808+0000 (oldest deadline 2026-02-13T03:40:11.238717+0000) 2026-02-13T03:40:22.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:22 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:22.161+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:51.239005+0000 front 2026-02-13T03:39:51.239036+0000 (oldest deadline 2026-02-13T03:40:17.139008+0000) 2026-02-13T03:40:22.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:22 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:22.268+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:22.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:22 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:22.268+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:43.827921+0000 front 2026-02-13T03:39:43.827942+0000 (oldest deadline 2026-02-13T03:40:09.127882+0000) 2026-02-13T03:40:22.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:22 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:22.268+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:49.128144+0000 front 2026-02-13T03:39:49.128235+0000 (oldest deadline 2026-02-13T03:40:14.428134+0000) 2026-02-13T03:40:22.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:22 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:22.268+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:54.428270+0000 front 2026-02-13T03:39:54.428282+0000 (oldest deadline 2026-02-13T03:40:17.328388+0000) 2026-02-13T03:40:22.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:22.392+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.561907+0000 front 2026-02-13T03:39:36.561858+0000 (oldest deadline 2026-02-13T03:40:00.661898+0000) 2026-02-13T03:40:22.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:22.392+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.662213+0000 front 2026-02-13T03:39:40.662069+0000 (oldest deadline 2026-02-13T03:40:05.962103+0000) 2026-02-13T03:40:22.763 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:22.392+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:46.462409+0000 front 2026-02-13T03:39:46.462417+0000 (oldest deadline 2026-02-13T03:40:11.162524+0000) 2026-02-13T03:40:22.764 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:22.392+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:52.863081+0000 front 2026-02-13T03:39:52.862974+0000 (oldest deadline 2026-02-13T03:40:18.163022+0000) 2026-02-13T03:40:22.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:22.453+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:22.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:22.453+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:22.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:22.453+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:22.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:22 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:22.453+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:53.581393+0000 front 2026-02-13T03:39:53.581467+0000 (oldest deadline 2026-02-13T03:40:18.281438+0000) 2026-02-13T03:40:23.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:23.210+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:23.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:23.210+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:23.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:23.210+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:45.338724+0000 front 2026-02-13T03:39:45.338808+0000 (oldest deadline 2026-02-13T03:40:11.238717+0000) 2026-02-13T03:40:23.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:23.210+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:51.239005+0000 front 2026-02-13T03:39:51.239036+0000 (oldest deadline 2026-02-13T03:40:17.139008+0000) 2026-02-13T03:40:23.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:23 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:23.210+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:01.239349+0000 front 2026-02-13T03:40:01.239363+0000 (oldest deadline 2026-02-13T03:40:22.339434+0000) 2026-02-13T03:40:23.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:23 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:23.281+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:23.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:23 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:23.281+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:43.827921+0000 front 2026-02-13T03:39:43.827942+0000 (oldest deadline 2026-02-13T03:40:09.127882+0000) 2026-02-13T03:40:23.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:23 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:23.281+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:49.128144+0000 front 2026-02-13T03:39:49.128235+0000 (oldest deadline 2026-02-13T03:40:14.428134+0000) 2026-02-13T03:40:23.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:23 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:23.281+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:54.428270+0000 front 2026-02-13T03:39:54.428282+0000 (oldest deadline 2026-02-13T03:40:17.328388+0000) 2026-02-13T03:40:23.744 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:23 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:23.406+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:23.744 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:23 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:23.406+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:23.744 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:23 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:23.406+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:23.744 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:23 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:23.406+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:53.581393+0000 front 2026-02-13T03:39:53.581467+0000 (oldest deadline 2026-02-13T03:40:18.281438+0000) 2026-02-13T03:40:23.744 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:23 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:23.398+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.561907+0000 front 2026-02-13T03:39:36.561858+0000 (oldest deadline 2026-02-13T03:40:00.661898+0000) 2026-02-13T03:40:23.744 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:23 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:23.398+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:40.662213+0000 front 2026-02-13T03:39:40.662069+0000 (oldest deadline 2026-02-13T03:40:05.962103+0000) 2026-02-13T03:40:23.744 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:23 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:23.398+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:46.462409+0000 front 2026-02-13T03:39:46.462417+0000 (oldest deadline 2026-02-13T03:40:11.162524+0000) 2026-02-13T03:40:23.744 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:23 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8[44621]: 2026-02-13T03:40:23.398+0000 7faafee426c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:52.863081+0000 front 2026-02-13T03:39:52.862974+0000 (oldest deadline 2026-02-13T03:40:18.163022+0000) 2026-02-13T03:40:23.744 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:23 trial133 podman[60425]: 2026-02-13 03:40:23.587570413 +0000 UTC m=+5.072297897 container died 505b14967077b8f69e0b2f27702571d5f9cf8055402e95972ad1d2526334723d (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, ceph=True, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, version=10, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, license=BSD-3-Clause, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T03:40:23.744 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:23 trial133 podman[60425]: 2026-02-13 03:40:23.597312432 +0000 UTC m=+5.082039906 container remove 505b14967077b8f69e0b2f27702571d5f9cf8055402e95972ad1d2526334723d (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8, io.buildah.version=1.33.7, version=10, OSD_FLAVOR=default, ceph=True, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T03:40:23.744 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:23 trial133 bash[60425]: ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8 2026-02-13T03:40:23.744 INFO:journalctl@ceph.osd.8.trial133.stdout:Feb 13 03:40:23 trial133 podman[60557]: 2026-02-13 03:40:23.741807945 +0000 UTC m=+0.018076495 container create 9473e9a61eb37e0a70af4af3bf5b47730d3989adeaef00ceb2206d7119aaa221 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-8-deactivate, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, name=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , ceph=True, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T03:40:23.945 DEBUG:teuthology.orchestra.run.trial133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.8.service' 2026-02-13T03:40:23.980 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:40:23.980 INFO:tasks.cephadm.osd.8:Stopped osd.8 2026-02-13T03:40:23.980 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2026-02-13T03:40:23.980 DEBUG:teuthology.orchestra.run.trial096:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.9 2026-02-13T03:40:24.267 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:24 trial096 systemd[1]: Stopping Ceph osd.9 for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:40:24.267 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:24 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:24.079+0000 7f30676ea6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T03:40:24.267 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:24 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:24.079+0000 7f30676ea6c0 -1 osd.9 72 *** Got signal Terminated *** 2026-02-13T03:40:24.267 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:24 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:24.079+0000 7f30676ea6c0 -1 osd.9 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T03:40:24.267 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:24 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:24.264+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:24.267 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:24 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:24.264+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:43.827921+0000 front 2026-02-13T03:39:43.827942+0000 (oldest deadline 2026-02-13T03:40:09.127882+0000) 2026-02-13T03:40:24.267 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:24 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:24.264+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:49.128144+0000 front 2026-02-13T03:39:49.128235+0000 (oldest deadline 2026-02-13T03:40:14.428134+0000) 2026-02-13T03:40:24.267 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:24 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:24.264+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:54.428270+0000 front 2026-02-13T03:39:54.428282+0000 (oldest deadline 2026-02-13T03:40:17.328388+0000) 2026-02-13T03:40:24.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:24 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:24.222+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:24.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:24 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:24.222+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:24.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:24 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:24.222+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:45.338724+0000 front 2026-02-13T03:39:45.338808+0000 (oldest deadline 2026-02-13T03:40:11.238717+0000) 2026-02-13T03:40:24.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:24 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:24.222+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:51.239005+0000 front 2026-02-13T03:39:51.239036+0000 (oldest deadline 2026-02-13T03:40:17.139008+0000) 2026-02-13T03:40:24.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:24 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:24.222+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:01.239349+0000 front 2026-02-13T03:40:01.239363+0000 (oldest deadline 2026-02-13T03:40:22.339434+0000) 2026-02-13T03:40:24.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:24 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:24.446+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:24.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:24 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:24.446+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:24.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:24 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:24.446+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:24.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:24 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:24.446+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:53.581393+0000 front 2026-02-13T03:39:53.581467+0000 (oldest deadline 2026-02-13T03:40:18.281438+0000) 2026-02-13T03:40:24.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:24 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:24.446+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:00.581906+0000 front 2026-02-13T03:40:00.581957+0000 (oldest deadline 2026-02-13T03:40:23.481895+0000) 2026-02-13T03:40:25.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:25 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:25.220+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:25.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:25 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:25.220+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:25.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:25 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:25.220+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:45.338724+0000 front 2026-02-13T03:39:45.338808+0000 (oldest deadline 2026-02-13T03:40:11.238717+0000) 2026-02-13T03:40:25.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:25 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:25.220+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:51.239005+0000 front 2026-02-13T03:39:51.239036+0000 (oldest deadline 2026-02-13T03:40:17.139008+0000) 2026-02-13T03:40:25.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:25 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:25.220+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:01.239349+0000 front 2026-02-13T03:40:01.239363+0000 (oldest deadline 2026-02-13T03:40:22.339434+0000) 2026-02-13T03:40:25.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:25 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:25.221+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:25.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:25 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:25.221+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:43.827921+0000 front 2026-02-13T03:39:43.827942+0000 (oldest deadline 2026-02-13T03:40:09.127882+0000) 2026-02-13T03:40:25.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:25 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:25.221+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:49.128144+0000 front 2026-02-13T03:39:49.128235+0000 (oldest deadline 2026-02-13T03:40:14.428134+0000) 2026-02-13T03:40:25.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:25 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:25.221+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:54.428270+0000 front 2026-02-13T03:39:54.428282+0000 (oldest deadline 2026-02-13T03:40:17.328388+0000) 2026-02-13T03:40:25.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:25 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:25.494+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:25.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:25 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:25.494+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:25.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:25 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:25.494+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:25.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:25 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:25.494+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:53.581393+0000 front 2026-02-13T03:39:53.581467+0000 (oldest deadline 2026-02-13T03:40:18.281438+0000) 2026-02-13T03:40:25.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:25 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:25.494+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:00.581906+0000 front 2026-02-13T03:40:00.581957+0000 (oldest deadline 2026-02-13T03:40:23.481895+0000) 2026-02-13T03:40:26.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:26 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:26.210+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:26.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:26 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:26.210+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:26.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:26 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:26.210+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:45.338724+0000 front 2026-02-13T03:39:45.338808+0000 (oldest deadline 2026-02-13T03:40:11.238717+0000) 2026-02-13T03:40:26.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:26 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:26.210+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:51.239005+0000 front 2026-02-13T03:39:51.239036+0000 (oldest deadline 2026-02-13T03:40:17.139008+0000) 2026-02-13T03:40:26.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:26 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:26.210+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:01.239349+0000 front 2026-02-13T03:40:01.239363+0000 (oldest deadline 2026-02-13T03:40:22.339434+0000) 2026-02-13T03:40:26.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:26 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:26.251+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:26.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:26 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:26.251+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:43.827921+0000 front 2026-02-13T03:39:43.827942+0000 (oldest deadline 2026-02-13T03:40:09.127882+0000) 2026-02-13T03:40:26.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:26 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:26.251+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:49.128144+0000 front 2026-02-13T03:39:49.128235+0000 (oldest deadline 2026-02-13T03:40:14.428134+0000) 2026-02-13T03:40:26.675 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:26 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:26.251+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:54.428270+0000 front 2026-02-13T03:39:54.428282+0000 (oldest deadline 2026-02-13T03:40:17.328388+0000) 2026-02-13T03:40:27.013 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:26 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:26.539+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:27.014 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:26 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:26.539+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:27.014 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:26 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:26.539+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:27.014 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:26 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:26.539+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:53.581393+0000 front 2026-02-13T03:39:53.581467+0000 (oldest deadline 2026-02-13T03:40:18.281438+0000) 2026-02-13T03:40:27.014 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:26 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:26.539+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:00.581906+0000 front 2026-02-13T03:40:00.581957+0000 (oldest deadline 2026-02-13T03:40:23.481895+0000) 2026-02-13T03:40:27.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:27 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:27.200+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:27.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:27 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:27.200+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:27.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:27 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:27.200+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:45.338724+0000 front 2026-02-13T03:39:45.338808+0000 (oldest deadline 2026-02-13T03:40:11.238717+0000) 2026-02-13T03:40:27.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:27 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:27.200+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:51.239005+0000 front 2026-02-13T03:39:51.239036+0000 (oldest deadline 2026-02-13T03:40:17.139008+0000) 2026-02-13T03:40:27.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:27 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:27.200+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:01.239349+0000 front 2026-02-13T03:40:01.239363+0000 (oldest deadline 2026-02-13T03:40:22.339434+0000) 2026-02-13T03:40:27.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:27 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:27.276+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:27.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:27 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:27.276+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:43.827921+0000 front 2026-02-13T03:39:43.827942+0000 (oldest deadline 2026-02-13T03:40:09.127882+0000) 2026-02-13T03:40:27.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:27 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:27.276+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:49.128144+0000 front 2026-02-13T03:39:49.128235+0000 (oldest deadline 2026-02-13T03:40:14.428134+0000) 2026-02-13T03:40:27.675 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:27 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:27.276+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:54.428270+0000 front 2026-02-13T03:39:54.428282+0000 (oldest deadline 2026-02-13T03:40:17.328388+0000) 2026-02-13T03:40:27.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:27 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:27.497+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:27.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:27 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:27.497+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:27.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:27 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:27.497+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:27.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:27 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:27.497+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:53.581393+0000 front 2026-02-13T03:39:53.581467+0000 (oldest deadline 2026-02-13T03:40:18.281438+0000) 2026-02-13T03:40:27.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:27 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:27.497+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:00.581906+0000 front 2026-02-13T03:40:00.581957+0000 (oldest deadline 2026-02-13T03:40:23.481895+0000) 2026-02-13T03:40:28.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:28 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:28.173+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:28.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:28 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:28.173+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:28.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:28 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:28.173+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:45.338724+0000 front 2026-02-13T03:39:45.338808+0000 (oldest deadline 2026-02-13T03:40:11.238717+0000) 2026-02-13T03:40:28.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:28 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:28.173+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:51.239005+0000 front 2026-02-13T03:39:51.239036+0000 (oldest deadline 2026-02-13T03:40:17.139008+0000) 2026-02-13T03:40:28.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:28 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:28.173+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:01.239349+0000 front 2026-02-13T03:40:01.239363+0000 (oldest deadline 2026-02-13T03:40:22.339434+0000) 2026-02-13T03:40:28.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:28 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:28.297+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:39.227390+0000 front 2026-02-13T03:39:39.227400+0000 (oldest deadline 2026-02-13T03:40:01.527449+0000) 2026-02-13T03:40:28.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:28 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:28.297+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:43.827921+0000 front 2026-02-13T03:39:43.827942+0000 (oldest deadline 2026-02-13T03:40:09.127882+0000) 2026-02-13T03:40:28.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:28 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:28.297+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:49.128144+0000 front 2026-02-13T03:39:49.128235+0000 (oldest deadline 2026-02-13T03:40:14.428134+0000) 2026-02-13T03:40:28.674 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:28 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9[55839]: 2026-02-13T03:40:28.297+0000 7f305fda76c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:54.428270+0000 front 2026-02-13T03:39:54.428282+0000 (oldest deadline 2026-02-13T03:40:17.328388+0000) 2026-02-13T03:40:28.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:28 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:28.507+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:28.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:28 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:28.507+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:28.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:28 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:28.507+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:28.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:28 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:28.507+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:53.581393+0000 front 2026-02-13T03:39:53.581467+0000 (oldest deadline 2026-02-13T03:40:18.281438+0000) 2026-02-13T03:40:28.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:28 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:28.507+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:00.581906+0000 front 2026-02-13T03:40:00.581957+0000 (oldest deadline 2026-02-13T03:40:23.481895+0000) 2026-02-13T03:40:29.425 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:29 trial096 podman[81295]: 2026-02-13 03:40:29.138845637 +0000 UTC m=+5.072072352 container died 12073fb015992ca311844784f73204944c07210f3040a7d3e80938ae53489e53 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, version=10, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, summary=Rocky Linux Base image, OSD_FLAVOR=default, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux) 2026-02-13T03:40:29.425 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:29 trial096 podman[81295]: 2026-02-13 03:40:29.148254604 +0000 UTC m=+5.081481320 container remove 12073fb015992ca311844784f73204944c07210f3040a7d3e80938ae53489e53 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, ceph=True, license=BSD-3-Clause, OSD_FLAVOR=default, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T03:40:29.425 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:29 trial096 bash[81295]: ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9 2026-02-13T03:40:29.425 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:29 trial096 podman[81427]: 2026-02-13 03:40:29.273638856 +0000 UTC m=+0.015083721 container create bd82f9abc567483e97a054e62a3693fc83bd8d772ded7bfbc34a42d65edcd2d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9-deactivate, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, OSD_FLAVOR=default, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, version=10, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux) 2026-02-13T03:40:29.425 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:29 trial096 podman[81427]: 2026-02-13 03:40:29.308284936 +0000 UTC m=+0.049729791 container init bd82f9abc567483e97a054e62a3693fc83bd8d772ded7bfbc34a42d65edcd2d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, version=10, name=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10) 2026-02-13T03:40:29.425 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:29 trial096 podman[81427]: 2026-02-13 03:40:29.310775227 +0000 UTC m=+0.052220092 container start bd82f9abc567483e97a054e62a3693fc83bd8d772ded7bfbc34a42d65edcd2d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause) 2026-02-13T03:40:29.426 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:29 trial096 podman[81427]: 2026-02-13 03:40:29.311221557 +0000 UTC m=+0.052666432 container attach bd82f9abc567483e97a054e62a3693fc83bd8d772ded7bfbc34a42d65edcd2d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-9-deactivate, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, license=BSD-3-Clause) 2026-02-13T03:40:29.426 INFO:journalctl@ceph.osd.9.trial096.stdout:Feb 13 03:40:29 trial096 podman[81427]: 2026-02-13 03:40:29.26772561 +0000 UTC m=+0.009170475 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T03:40:29.464 DEBUG:teuthology.orchestra.run.trial096:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.9.service' 2026-02-13T03:40:29.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:29 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:29.130+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:29.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:29 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:29.130+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:29.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:29 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:29.130+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:45.338724+0000 front 2026-02-13T03:39:45.338808+0000 (oldest deadline 2026-02-13T03:40:11.238717+0000) 2026-02-13T03:40:29.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:29 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:29.130+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:51.239005+0000 front 2026-02-13T03:39:51.239036+0000 (oldest deadline 2026-02-13T03:40:17.139008+0000) 2026-02-13T03:40:29.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:29 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:29.130+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:01.239349+0000 front 2026-02-13T03:40:01.239363+0000 (oldest deadline 2026-02-13T03:40:22.339434+0000) 2026-02-13T03:40:29.501 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:40:29.501 INFO:tasks.cephadm.osd.9:Stopped osd.9 2026-02-13T03:40:29.501 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2026-02-13T03:40:29.501 DEBUG:teuthology.orchestra.run.trial132:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.10 2026-02-13T03:40:29.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:29 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:29.464+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:29.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:29 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:29.464+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:29.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:29 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:29.464+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:29.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:29 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:29.464+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:53.581393+0000 front 2026-02-13T03:39:53.581467+0000 (oldest deadline 2026-02-13T03:40:18.281438+0000) 2026-02-13T03:40:29.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:29 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:29.464+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:00.581906+0000 front 2026-02-13T03:40:00.581957+0000 (oldest deadline 2026-02-13T03:40:23.481895+0000) 2026-02-13T03:40:29.982 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:29 trial132 systemd[1]: Stopping Ceph osd.10 for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:40:29.982 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:29 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:29.608+0000 7f2f300636c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T03:40:29.982 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:29 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:29.608+0000 7f2f300636c0 -1 osd.10 72 *** Got signal Terminated *** 2026-02-13T03:40:29.982 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:29 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:29.608+0000 7f2f300636c0 -1 osd.10 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T03:40:30.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:30 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:30.113+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:30.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:30 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:30.113+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:30.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:30 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:30.113+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:45.338724+0000 front 2026-02-13T03:39:45.338808+0000 (oldest deadline 2026-02-13T03:40:11.238717+0000) 2026-02-13T03:40:30.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:30 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:30.113+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:51.239005+0000 front 2026-02-13T03:39:51.239036+0000 (oldest deadline 2026-02-13T03:40:17.139008+0000) 2026-02-13T03:40:30.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:30 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:30.113+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:01.239349+0000 front 2026-02-13T03:40:01.239363+0000 (oldest deadline 2026-02-13T03:40:22.339434+0000) 2026-02-13T03:40:30.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:30 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:30.438+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:30.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:30 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:30.438+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:30.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:30 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:30.438+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:30.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:30 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:30.438+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:53.581393+0000 front 2026-02-13T03:39:53.581467+0000 (oldest deadline 2026-02-13T03:40:18.281438+0000) 2026-02-13T03:40:30.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:30 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:30.438+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:00.581906+0000 front 2026-02-13T03:40:00.581957+0000 (oldest deadline 2026-02-13T03:40:23.481895+0000) 2026-02-13T03:40:31.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:31 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:31.118+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:31.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:31 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:31.118+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:31.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:31 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:31.118+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:45.338724+0000 front 2026-02-13T03:39:45.338808+0000 (oldest deadline 2026-02-13T03:40:11.238717+0000) 2026-02-13T03:40:31.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:31 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:31.118+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:51.239005+0000 front 2026-02-13T03:39:51.239036+0000 (oldest deadline 2026-02-13T03:40:17.139008+0000) 2026-02-13T03:40:31.483 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:31 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:31.118+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:01.239349+0000 front 2026-02-13T03:40:01.239363+0000 (oldest deadline 2026-02-13T03:40:22.339434+0000) 2026-02-13T03:40:31.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:31 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:31.463+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:31.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:31 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:31.463+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:31.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:31 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:31.463+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:31.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:31 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:31.463+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:53.581393+0000 front 2026-02-13T03:39:53.581467+0000 (oldest deadline 2026-02-13T03:40:18.281438+0000) 2026-02-13T03:40:31.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:31 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:31.463+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:00.581906+0000 front 2026-02-13T03:40:00.581957+0000 (oldest deadline 2026-02-13T03:40:23.481895+0000) 2026-02-13T03:40:31.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:31 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:31.463+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6812 osd.5 since back 2026-02-13T03:40:06.882420+0000 front 2026-02-13T03:40:06.882394+0000 (oldest deadline 2026-02-13T03:40:30.982435+0000) 2026-02-13T03:40:32.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:32 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:32.118+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:32.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:32 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:32.118+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:32.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:32 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:32.118+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:45.338724+0000 front 2026-02-13T03:39:45.338808+0000 (oldest deadline 2026-02-13T03:40:11.238717+0000) 2026-02-13T03:40:32.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:32 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:32.118+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:51.239005+0000 front 2026-02-13T03:39:51.239036+0000 (oldest deadline 2026-02-13T03:40:17.139008+0000) 2026-02-13T03:40:32.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:32 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:32.118+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:01.239349+0000 front 2026-02-13T03:40:01.239363+0000 (oldest deadline 2026-02-13T03:40:22.339434+0000) 2026-02-13T03:40:32.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:32 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:32.461+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:32.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:32 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:32.461+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:32.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:32 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:32.461+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:32.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:32 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:32.461+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:53.581393+0000 front 2026-02-13T03:39:53.581467+0000 (oldest deadline 2026-02-13T03:40:18.281438+0000) 2026-02-13T03:40:32.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:32 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:32.461+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:00.581906+0000 front 2026-02-13T03:40:00.581957+0000 (oldest deadline 2026-02-13T03:40:23.481895+0000) 2026-02-13T03:40:32.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:32 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:32.461+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6812 osd.5 since back 2026-02-13T03:40:06.882420+0000 front 2026-02-13T03:40:06.882394+0000 (oldest deadline 2026-02-13T03:40:30.982435+0000) 2026-02-13T03:40:33.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:33 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:33.068+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:33.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:33 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:33.068+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:33.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:33 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:33.068+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:45.338724+0000 front 2026-02-13T03:39:45.338808+0000 (oldest deadline 2026-02-13T03:40:11.238717+0000) 2026-02-13T03:40:33.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:33 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:33.068+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:51.239005+0000 front 2026-02-13T03:39:51.239036+0000 (oldest deadline 2026-02-13T03:40:17.139008+0000) 2026-02-13T03:40:33.483 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:33 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:33.068+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:01.239349+0000 front 2026-02-13T03:40:01.239363+0000 (oldest deadline 2026-02-13T03:40:22.339434+0000) 2026-02-13T03:40:33.483 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:33 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:33.068+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6812 osd.5 since back 2026-02-13T03:40:06.840159+0000 front 2026-02-13T03:40:06.840337+0000 (oldest deadline 2026-02-13T03:40:32.740182+0000) 2026-02-13T03:40:33.483 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:33 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:33.068+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6822 osd.6 since back 2026-02-13T03:40:06.840317+0000 front 2026-02-13T03:40:06.840196+0000 (oldest deadline 2026-02-13T03:40:32.740182+0000) 2026-02-13T03:40:33.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:33 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:33.486+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:33.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:33 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:33.486+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:33.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:33 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:33.486+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:33.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:33 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:33.486+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:53.581393+0000 front 2026-02-13T03:39:53.581467+0000 (oldest deadline 2026-02-13T03:40:18.281438+0000) 2026-02-13T03:40:33.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:33 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:33.486+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:00.581906+0000 front 2026-02-13T03:40:00.581957+0000 (oldest deadline 2026-02-13T03:40:23.481895+0000) 2026-02-13T03:40:33.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:33 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:33.486+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6812 osd.5 since back 2026-02-13T03:40:06.882420+0000 front 2026-02-13T03:40:06.882394+0000 (oldest deadline 2026-02-13T03:40:30.982435+0000) 2026-02-13T03:40:34.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:34 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:34.057+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:36.137803+0000 front 2026-02-13T03:39:36.137755+0000 (oldest deadline 2026-02-13T03:39:59.637772+0000) 2026-02-13T03:40:34.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:34 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:34.057+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:44.238412+0000 front 2026-02-13T03:39:44.238425+0000 (oldest deadline 2026-02-13T03:40:05.338509+0000) 2026-02-13T03:40:34.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:34 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:34.057+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:45.338724+0000 front 2026-02-13T03:39:45.338808+0000 (oldest deadline 2026-02-13T03:40:11.238717+0000) 2026-02-13T03:40:34.482 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:34 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:34.057+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:51.239005+0000 front 2026-02-13T03:39:51.239036+0000 (oldest deadline 2026-02-13T03:40:17.139008+0000) 2026-02-13T03:40:34.483 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:34 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:34.057+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:01.239349+0000 front 2026-02-13T03:40:01.239363+0000 (oldest deadline 2026-02-13T03:40:22.339434+0000) 2026-02-13T03:40:34.483 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:34 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:34.057+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.133:6812 osd.5 since back 2026-02-13T03:40:06.840159+0000 front 2026-02-13T03:40:06.840337+0000 (oldest deadline 2026-02-13T03:40:32.740182+0000) 2026-02-13T03:40:34.483 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:34 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10[50748]: 2026-02-13T03:40:34.057+0000 7f2f2c7286c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.96:6822 osd.6 since back 2026-02-13T03:40:06.840317+0000 front 2026-02-13T03:40:06.840196+0000 (oldest deadline 2026-02-13T03:40:32.740182+0000) 2026-02-13T03:40:34.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:34 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:34.445+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:34.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:34 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:34.445+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:34.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:34 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:34.445+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:34.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:34 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:34.445+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:53.581393+0000 front 2026-02-13T03:39:53.581467+0000 (oldest deadline 2026-02-13T03:40:18.281438+0000) 2026-02-13T03:40:34.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:34 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:34.445+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:00.581906+0000 front 2026-02-13T03:40:00.581957+0000 (oldest deadline 2026-02-13T03:40:23.481895+0000) 2026-02-13T03:40:34.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:34 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:34.445+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6812 osd.5 since back 2026-02-13T03:40:06.882420+0000 front 2026-02-13T03:40:06.882394+0000 (oldest deadline 2026-02-13T03:40:30.982435+0000) 2026-02-13T03:40:34.972 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:34 trial132 podman[58995]: 2026-02-13 03:40:34.678912284 +0000 UTC m=+5.081993864 container died c2989c2081b9cede281cb935618af4383197211513e4755d0f097bcd116b93d3 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, ceph=True, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T03:40:34.972 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:34 trial132 podman[58995]: 2026-02-13 03:40:34.687193654 +0000 UTC m=+5.090275224 container remove c2989c2081b9cede281cb935618af4383197211513e4755d0f097bcd116b93d3 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, ceph=True, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, version=10, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T03:40:34.972 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:34 trial132 bash[58995]: ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10 2026-02-13T03:40:34.972 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:34 trial132 podman[59130]: 2026-02-13 03:40:34.821064135 +0000 UTC m=+0.016516905 container create 440adb52620b6e3c25a039c7a9d6bab55a5f3ae94bb8518114a999a9bb119bec (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, OSD_FLAVOR=default, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T03:40:34.972 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:34 trial132 podman[59130]: 2026-02-13 03:40:34.847426416 +0000 UTC m=+0.042879196 container init 440adb52620b6e3c25a039c7a9d6bab55a5f3ae94bb8518114a999a9bb119bec (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10-deactivate, org.opencontainers.image.version=10, license=BSD-3-Clause, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T03:40:34.972 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:34 trial132 podman[59130]: 2026-02-13 03:40:34.850109909 +0000 UTC m=+0.045562689 container start 440adb52620b6e3c25a039c7a9d6bab55a5f3ae94bb8518114a999a9bb119bec (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10-deactivate, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, io.buildah.version=1.33.7, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T03:40:34.972 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:34 trial132 podman[59130]: 2026-02-13 03:40:34.850602421 +0000 UTC m=+0.046055211 container attach 440adb52620b6e3c25a039c7a9d6bab55a5f3ae94bb8518114a999a9bb119bec (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, ceph=True, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7) 2026-02-13T03:40:34.972 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:34 trial132 podman[59130]: 2026-02-13 03:40:34.814778811 +0000 UTC m=+0.010231591 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T03:40:34.972 INFO:journalctl@ceph.osd.10.trial132.stdout:Feb 13 03:40:34 trial132 podman[59130]: 2026-02-13 03:40:34.981712495 +0000 UTC m=+0.177165275 container died 440adb52620b6e3c25a039c7a9d6bab55a5f3ae94bb8518114a999a9bb119bec (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-10-deactivate, summary=Rocky Linux Base image, org.opencontainers.image.version=10, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, vendor=Rocky Enterprise Software Foundation, ceph=True) 2026-02-13T03:40:35.009 DEBUG:teuthology.orchestra.run.trial132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.10.service' 2026-02-13T03:40:35.045 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:40:35.045 INFO:tasks.cephadm.osd.10:Stopped osd.10 2026-02-13T03:40:35.045 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2026-02-13T03:40:35.045 DEBUG:teuthology.orchestra.run.trial133:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.11 2026-02-13T03:40:35.466 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:35 trial133 systemd[1]: Stopping Ceph osd.11 for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:40:35.466 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:35 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:35.143+0000 7fac1d0696c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T03:40:35.466 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:35 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:35.143+0000 7fac1d0696c0 -1 osd.11 72 *** Got signal Terminated *** 2026-02-13T03:40:35.466 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:35 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:35.143+0000 7fac1d0696c0 -1 osd.11 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T03:40:35.466 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:35 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:35.463+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:35.466 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:35 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:35.463+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:35.467 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:35 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:35.463+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:35.467 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:35 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:35.463+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:53.581393+0000 front 2026-02-13T03:39:53.581467+0000 (oldest deadline 2026-02-13T03:40:18.281438+0000) 2026-02-13T03:40:35.467 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:35 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:35.463+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:00.581906+0000 front 2026-02-13T03:40:00.581957+0000 (oldest deadline 2026-02-13T03:40:23.481895+0000) 2026-02-13T03:40:35.467 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:35 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:35.463+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6812 osd.5 since back 2026-02-13T03:40:06.882420+0000 front 2026-02-13T03:40:06.882394+0000 (oldest deadline 2026-02-13T03:40:30.982435+0000) 2026-02-13T03:40:36.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:36 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:36.451+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:36.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:36 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:36.451+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:36.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:36 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:36.451+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:36.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:36 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:36.451+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:53.581393+0000 front 2026-02-13T03:39:53.581467+0000 (oldest deadline 2026-02-13T03:40:18.281438+0000) 2026-02-13T03:40:36.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:36 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:36.451+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:00.581906+0000 front 2026-02-13T03:40:00.581957+0000 (oldest deadline 2026-02-13T03:40:23.481895+0000) 2026-02-13T03:40:36.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:36 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:36.451+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6812 osd.5 since back 2026-02-13T03:40:06.882420+0000 front 2026-02-13T03:40:06.882394+0000 (oldest deadline 2026-02-13T03:40:30.982435+0000) 2026-02-13T03:40:37.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:37 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:37.419+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:37.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:37 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:37.419+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:37.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:37 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:37.419+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:37.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:37 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:37.419+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:53.581393+0000 front 2026-02-13T03:39:53.581467+0000 (oldest deadline 2026-02-13T03:40:18.281438+0000) 2026-02-13T03:40:37.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:37 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:37.419+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:00.581906+0000 front 2026-02-13T03:40:00.581957+0000 (oldest deadline 2026-02-13T03:40:23.481895+0000) 2026-02-13T03:40:37.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:37 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:37.419+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6812 osd.5 since back 2026-02-13T03:40:06.882420+0000 front 2026-02-13T03:40:06.882394+0000 (oldest deadline 2026-02-13T03:40:30.982435+0000) 2026-02-13T03:40:38.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:38 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:38.406+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:38.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:38 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:38.406+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:38.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:38 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:38.406+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:38.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:38 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:38.406+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:53.581393+0000 front 2026-02-13T03:39:53.581467+0000 (oldest deadline 2026-02-13T03:40:18.281438+0000) 2026-02-13T03:40:38.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:38 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:38.406+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:00.581906+0000 front 2026-02-13T03:40:00.581957+0000 (oldest deadline 2026-02-13T03:40:23.481895+0000) 2026-02-13T03:40:38.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:38 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:38.406+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6812 osd.5 since back 2026-02-13T03:40:06.882420+0000 front 2026-02-13T03:40:06.882394+0000 (oldest deadline 2026-02-13T03:40:30.982435+0000) 2026-02-13T03:40:39.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:39 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:39.452+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6806 osd.0 since back 2026-02-13T03:39:37.380074+0000 front 2026-02-13T03:39:37.380141+0000 (oldest deadline 2026-02-13T03:40:02.080053+0000) 2026-02-13T03:40:39.763 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:39 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:39.452+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6804 osd.1 since back 2026-02-13T03:39:42.080275+0000 front 2026-02-13T03:39:42.080282+0000 (oldest deadline 2026-02-13T03:40:04.980261+0000) 2026-02-13T03:40:39.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:39 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:39.452+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6804 osd.2 since back 2026-02-13T03:39:50.280651+0000 front 2026-02-13T03:39:50.280664+0000 (oldest deadline 2026-02-13T03:40:11.380732+0000) 2026-02-13T03:40:39.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:39 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:39.452+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.96:6814 osd.3 since back 2026-02-13T03:39:53.581393+0000 front 2026-02-13T03:39:53.581467+0000 (oldest deadline 2026-02-13T03:40:18.281438+0000) 2026-02-13T03:40:39.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:39 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:39.452+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.132:6812 osd.4 since back 2026-02-13T03:40:00.581906+0000 front 2026-02-13T03:40:00.581957+0000 (oldest deadline 2026-02-13T03:40:23.481895+0000) 2026-02-13T03:40:39.764 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:39 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11[50863]: 2026-02-13T03:40:39.452+0000 7fac157266c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.133:6812 osd.5 since back 2026-02-13T03:40:06.882420+0000 front 2026-02-13T03:40:06.882394+0000 (oldest deadline 2026-02-13T03:40:30.982435+0000) 2026-02-13T03:40:40.505 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:40 trial133 podman[60692]: 2026-02-13 03:40:40.203710755 +0000 UTC m=+5.072128361 container died 265526340e62263777cb493b3162268a717e976b00c70009ac9d5f9a2e240ead (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11, ceph=True, name=rockylinux, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T03:40:40.505 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:40 trial133 podman[60692]: 2026-02-13 03:40:40.212650853 +0000 UTC m=+5.081068469 container remove 265526340e62263777cb493b3162268a717e976b00c70009ac9d5f9a2e240ead (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, name=rockylinux, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True) 2026-02-13T03:40:40.505 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:40 trial133 bash[60692]: ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11 2026-02-13T03:40:40.505 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:40 trial133 podman[60822]: 2026-02-13 03:40:40.349081746 +0000 UTC m=+0.016031318 container create 57ca13b645b957c8102c4e080c089e5921a7dde932bf0e9d03b1aa0a6dc6a04a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11-deactivate, io.buildah.version=1.33.7, version=10, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10) 2026-02-13T03:40:40.505 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:40 trial133 podman[60822]: 2026-02-13 03:40:40.375104999 +0000 UTC m=+0.042054571 container init 57ca13b645b957c8102c4e080c089e5921a7dde932bf0e9d03b1aa0a6dc6a04a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11-deactivate, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.version=10, io.buildah.version=1.33.7, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T03:40:40.506 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:40 trial133 podman[60822]: 2026-02-13 03:40:40.377516041 +0000 UTC m=+0.044465623 container start 57ca13b645b957c8102c4e080c089e5921a7dde932bf0e9d03b1aa0a6dc6a04a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11-deactivate, version=10, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10) 2026-02-13T03:40:40.506 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:40 trial133 podman[60822]: 2026-02-13 03:40:40.378070759 +0000 UTC m=+0.045020341 container attach 57ca13b645b957c8102c4e080c089e5921a7dde932bf0e9d03b1aa0a6dc6a04a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11-deactivate, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, io.buildah.version=1.33.7, version=10, name=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T03:40:40.506 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:40 trial133 podman[60822]: 2026-02-13 03:40:40.34233419 +0000 UTC m=+0.009283772 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T03:40:40.506 INFO:journalctl@ceph.osd.11.trial133.stdout:Feb 13 03:40:40 trial133 podman[60822]: 2026-02-13 03:40:40.502495607 +0000 UTC m=+0.169445189 container died 57ca13b645b957c8102c4e080c089e5921a7dde932bf0e9d03b1aa0a6dc6a04a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-osd-11-deactivate, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, version=10, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T03:40:40.534 DEBUG:teuthology.orchestra.run.trial133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@osd.11.service' 2026-02-13T03:40:40.570 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:40:40.570 INFO:tasks.cephadm.osd.11:Stopped osd.11 2026-02-13T03:40:40.570 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2026-02-13T03:40:40.571 DEBUG:teuthology.orchestra.run.trial096:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.a 2026-02-13T03:40:40.924 INFO:journalctl@ceph.mds.a.trial096.stdout:Feb 13 03:40:40 trial096 systemd[1]: Stopping Ceph mds.a for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:40:40.924 INFO:journalctl@ceph.mds.a.trial096.stdout:Feb 13 03:40:40 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-a[61637]: 2026-02-13T03:40:40.663+0000 7fd7c7b516c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:40:40.925 INFO:journalctl@ceph.mds.a.trial096.stdout:Feb 13 03:40:40 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-a[61637]: 2026-02-13T03:40:40.663+0000 7fd7c7b516c0 -1 mds.a *** got signal Terminated *** 2026-02-13T03:40:41.715 DEBUG:teuthology.orchestra.run.trial096:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.a.service' 2026-02-13T03:40:41.751 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:40:41.751 INFO:tasks.cephadm.mds.a:Stopped mds.a 2026-02-13T03:40:41.751 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2026-02-13T03:40:41.752 DEBUG:teuthology.orchestra.run.trial096:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.d 2026-02-13T03:40:41.884 INFO:journalctl@ceph.mds.d.trial096.stdout:Feb 13 03:40:41 trial096 systemd[1]: Stopping Ceph mds.d for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:40:42.174 INFO:journalctl@ceph.mds.d.trial096.stdout:Feb 13 03:40:41 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-d[60776]: 2026-02-13T03:40:41.881+0000 7f85b73d96c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:40:42.174 INFO:journalctl@ceph.mds.d.trial096.stdout:Feb 13 03:40:41 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-d[60776]: 2026-02-13T03:40:41.881+0000 7f85b73d96c0 -1 mds.d *** got signal Terminated *** 2026-02-13T03:40:42.919 DEBUG:teuthology.orchestra.run.trial096:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.d.service' 2026-02-13T03:40:42.950 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:40:42.950 INFO:tasks.cephadm.mds.d:Stopped mds.d 2026-02-13T03:40:42.950 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2026-02-13T03:40:42.950 DEBUG:teuthology.orchestra.run.trial096:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.g 2026-02-13T03:40:43.174 INFO:journalctl@ceph.mds.g.trial096.stdout:Feb 13 03:40:43 trial096 systemd[1]: Stopping Ceph mds.g for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:40:43.174 INFO:journalctl@ceph.mds.g.trial096.stdout:Feb 13 03:40:43 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-g[61313]: 2026-02-13T03:40:43.082+0000 7fdeb74106c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:40:43.174 INFO:journalctl@ceph.mds.g.trial096.stdout:Feb 13 03:40:43 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-g[61313]: 2026-02-13T03:40:43.082+0000 7fdeb74106c0 -1 mds.g *** got signal Terminated *** 2026-02-13T03:40:44.123 DEBUG:teuthology.orchestra.run.trial096:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.g.service' 2026-02-13T03:40:44.155 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:40:44.155 INFO:tasks.cephadm.mds.g:Stopped mds.g 2026-02-13T03:40:44.155 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2026-02-13T03:40:44.155 DEBUG:teuthology.orchestra.run.trial096:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.j 2026-02-13T03:40:44.424 INFO:journalctl@ceph.mds.j.trial096.stdout:Feb 13 03:40:44 trial096 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-j[60413]: 2026-02-13T03:40:44.282+0000 7f902d3306c0 -1 mds.j *** got signal Terminated *** 2026-02-13T03:40:45.307 DEBUG:teuthology.orchestra.run.trial096:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.j.service' 2026-02-13T03:40:45.339 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:40:45.339 INFO:tasks.cephadm.mds.j:Stopped mds.j 2026-02-13T03:40:45.340 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2026-02-13T03:40:45.340 DEBUG:teuthology.orchestra.run.trial132:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.b 2026-02-13T03:40:45.732 INFO:journalctl@ceph.mds.b.trial132.stdout:Feb 13 03:40:45 trial132 systemd[1]: Stopping Ceph mds.b for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:40:45.732 INFO:journalctl@ceph.mds.b.trial132.stdout:Feb 13 03:40:45 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-b[55456]: 2026-02-13T03:40:45.455+0000 7f26f91106c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:40:45.732 INFO:journalctl@ceph.mds.b.trial132.stdout:Feb 13 03:40:45 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-b[55456]: 2026-02-13T03:40:45.455+0000 7f26f91106c0 -1 mds.b *** got signal Terminated *** 2026-02-13T03:40:51.414 DEBUG:teuthology.orchestra.run.trial132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.b.service' 2026-02-13T03:40:51.449 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:40:51.449 INFO:tasks.cephadm.mds.b:Stopped mds.b 2026-02-13T03:40:51.449 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2026-02-13T03:40:51.449 DEBUG:teuthology.orchestra.run.trial132:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.e 2026-02-13T03:40:51.581 INFO:journalctl@ceph.mds.e.trial132.stdout:Feb 13 03:40:51 trial132 systemd[1]: Stopping Ceph mds.e for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:40:51.982 INFO:journalctl@ceph.mds.e.trial132.stdout:Feb 13 03:40:51 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-e[54801]: 2026-02-13T03:40:51.589+0000 7fd3d927b6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:40:51.982 INFO:journalctl@ceph.mds.e.trial132.stdout:Feb 13 03:40:51 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-e[54801]: 2026-02-13T03:40:51.589+0000 7fd3d927b6c0 -1 mds.e *** got signal Terminated *** 2026-02-13T03:40:52.815 DEBUG:teuthology.orchestra.run.trial132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.e.service' 2026-02-13T03:40:52.849 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:40:52.849 INFO:tasks.cephadm.mds.e:Stopped mds.e 2026-02-13T03:40:52.849 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2026-02-13T03:40:52.850 DEBUG:teuthology.orchestra.run.trial132:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.h 2026-02-13T03:40:53.232 INFO:journalctl@ceph.mds.h.trial132.stdout:Feb 13 03:40:52 trial132 systemd[1]: Stopping Ceph mds.h for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:40:53.232 INFO:journalctl@ceph.mds.h.trial132.stdout:Feb 13 03:40:52 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-h[55128]: 2026-02-13T03:40:52.990+0000 7f82e86516c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:40:53.232 INFO:journalctl@ceph.mds.h.trial132.stdout:Feb 13 03:40:52 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-h[55128]: 2026-02-13T03:40:52.990+0000 7f82e86516c0 -1 mds.h *** got signal Terminated *** 2026-02-13T03:40:55.253 DEBUG:teuthology.orchestra.run.trial132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.h.service' 2026-02-13T03:40:55.286 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:40:55.287 INFO:tasks.cephadm.mds.h:Stopped mds.h 2026-02-13T03:40:55.287 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2026-02-13T03:40:55.287 DEBUG:teuthology.orchestra.run.trial132:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.k 2026-02-13T03:40:55.482 INFO:journalctl@ceph.mds.k.trial132.stdout:Feb 13 03:40:55 trial132 systemd[1]: Stopping Ceph mds.k for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:40:55.482 INFO:journalctl@ceph.mds.k.trial132.stdout:Feb 13 03:40:55 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-k[54477]: 2026-02-13T03:40:55.431+0000 7f4adda0b6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:40:55.482 INFO:journalctl@ceph.mds.k.trial132.stdout:Feb 13 03:40:55 trial132 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-k[54477]: 2026-02-13T03:40:55.431+0000 7f4adda0b6c0 -1 mds.k *** got signal Terminated *** 2026-02-13T03:40:56.457 DEBUG:teuthology.orchestra.run.trial132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.k.service' 2026-02-13T03:40:56.489 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:40:56.490 INFO:tasks.cephadm.mds.k:Stopped mds.k 2026-02-13T03:40:56.490 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2026-02-13T03:40:56.490 DEBUG:teuthology.orchestra.run.trial133:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.c 2026-02-13T03:40:56.977 INFO:journalctl@ceph.mds.c.trial133.stdout:Feb 13 03:40:56 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-c[55673]: 2026-02-13T03:40:56.584+0000 7f8cfa23e6c0 -1 mds.c *** got signal Terminated *** 2026-02-13T03:40:57.699 DEBUG:teuthology.orchestra.run.trial133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.c.service' 2026-02-13T03:40:57.735 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:40:57.735 INFO:tasks.cephadm.mds.c:Stopped mds.c 2026-02-13T03:40:57.736 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2026-02-13T03:40:57.736 DEBUG:teuthology.orchestra.run.trial133:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.f 2026-02-13T03:40:57.869 INFO:journalctl@ceph.mds.f.trial133.stdout:Feb 13 03:40:57 trial133 systemd[1]: Stopping Ceph mds.f for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:40:58.263 INFO:journalctl@ceph.mds.f.trial133.stdout:Feb 13 03:40:57 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-f[55355]: 2026-02-13T03:40:57.865+0000 7f1d067be6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:40:58.263 INFO:journalctl@ceph.mds.f.trial133.stdout:Feb 13 03:40:57 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-f[55355]: 2026-02-13T03:40:57.865+0000 7f1d067be6c0 -1 mds.f *** got signal Terminated *** 2026-02-13T03:40:58.982 DEBUG:teuthology.orchestra.run.trial133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.f.service' 2026-02-13T03:40:59.018 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:40:59.018 INFO:tasks.cephadm.mds.f:Stopped mds.f 2026-02-13T03:40:59.019 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2026-02-13T03:40:59.019 DEBUG:teuthology.orchestra.run.trial133:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.i 2026-02-13T03:40:59.157 INFO:journalctl@ceph.mds.i.trial133.stdout:Feb 13 03:40:59 trial133 systemd[1]: Stopping Ceph mds.i for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:40:59.513 INFO:journalctl@ceph.mds.i.trial133.stdout:Feb 13 03:40:59 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-i[55996]: 2026-02-13T03:40:59.154+0000 7f48b9df86c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:40:59.513 INFO:journalctl@ceph.mds.i.trial133.stdout:Feb 13 03:40:59 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-i[55996]: 2026-02-13T03:40:59.154+0000 7f48b9df86c0 -1 mds.i *** got signal Terminated *** 2026-02-13T03:41:00.273 DEBUG:teuthology.orchestra.run.trial133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.i.service' 2026-02-13T03:41:00.305 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:41:00.306 INFO:tasks.cephadm.mds.i:Stopped mds.i 2026-02-13T03:41:00.306 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2026-02-13T03:41:00.306 DEBUG:teuthology.orchestra.run.trial133:> sudo systemctl stop ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.l 2026-02-13T03:41:00.513 INFO:journalctl@ceph.mds.l.trial133.stdout:Feb 13 03:41:00 trial133 systemd[1]: Stopping Ceph mds.l for 7c123de8-088c-11f1-84f7-d404e6e7d460... 2026-02-13T03:41:00.513 INFO:journalctl@ceph.mds.l.trial133.stdout:Feb 13 03:41:00 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-l[55035]: 2026-02-13T03:41:00.436+0000 7f365940f6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:41:00.514 INFO:journalctl@ceph.mds.l.trial133.stdout:Feb 13 03:41:00 trial133 ceph-7c123de8-088c-11f1-84f7-d404e6e7d460-mds-l[55035]: 2026-02-13T03:41:00.436+0000 7f365940f6c0 -1 mds.l *** got signal Terminated *** 2026-02-13T03:41:01.464 DEBUG:teuthology.orchestra.run.trial133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7c123de8-088c-11f1-84f7-d404e6e7d460@mds.l.service' 2026-02-13T03:41:01.498 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:41:01.498 INFO:tasks.cephadm.mds.l:Stopped mds.l 2026-02-13T03:41:01.498 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 --force --keep-logs 2026-02-13T03:41:01.619 INFO:teuthology.orchestra.run.trial096.stdout:Deleting cluster with fsid: 7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:41:03.404 DEBUG:teuthology.orchestra.run.trial132:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 --force --keep-logs 2026-02-13T03:41:03.525 INFO:teuthology.orchestra.run.trial132.stdout:Deleting cluster with fsid: 7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:41:05.330 DEBUG:teuthology.orchestra.run.trial133:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 --force --keep-logs 2026-02-13T03:41:05.451 INFO:teuthology.orchestra.run.trial133.stdout:Deleting cluster with fsid: 7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:41:07.234 DEBUG:teuthology.orchestra.run.trial096:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T03:41:07.262 DEBUG:teuthology.orchestra.run.trial132:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T03:41:07.289 DEBUG:teuthology.orchestra.run.trial133:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T03:41:07.318 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-13T03:41:07.322 DEBUG:teuthology.misc:Transferring archived files from trial096:/var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48095/remote/trial096/crash 2026-02-13T03:41:07.324 DEBUG:teuthology.orchestra.run.trial096:> sudo tar c -f - -C /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/crash -- . 2026-02-13T03:41:07.348 INFO:teuthology.orchestra.run.trial096.stderr:tar: /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T03:41:07.348 INFO:teuthology.orchestra.run.trial096.stderr:tar: Error is not recoverable: exiting now 2026-02-13T03:41:07.350 DEBUG:teuthology.misc:Transferring archived files from trial132:/var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48095/remote/trial132/crash 2026-02-13T03:41:07.352 DEBUG:teuthology.orchestra.run.trial132:> sudo tar c -f - -C /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/crash -- . 2026-02-13T03:41:07.376 INFO:teuthology.orchestra.run.trial132.stderr:tar: /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T03:41:07.376 INFO:teuthology.orchestra.run.trial132.stderr:tar: Error is not recoverable: exiting now 2026-02-13T03:41:07.379 DEBUG:teuthology.misc:Transferring archived files from trial133:/var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48095/remote/trial133/crash 2026-02-13T03:41:07.380 DEBUG:teuthology.orchestra.run.trial133:> sudo tar c -f - -C /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/crash -- . 2026-02-13T03:41:07.405 INFO:teuthology.orchestra.run.trial133.stderr:tar: /var/lib/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T03:41:07.405 INFO:teuthology.orchestra.run.trial133.stderr:tar: Error is not recoverable: exiting now 2026-02-13T03:41:07.406 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-13T03:41:07.407 DEBUG:teuthology.orchestra.run.trial096:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-13T03:41:07.433 INFO:teuthology.orchestra.run.trial096.stdout:2026-02-13T03:32:27.488029+0000 mon.a (mon.0) 302 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:41:07.434 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2026-02-13T03:41:07.435 DEBUG:teuthology.orchestra.run.trial096:> sudo grep -E '\[SEC\]' /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-13T03:41:07.499 DEBUG:teuthology.orchestra.run.trial096:> sudo grep -E '\[ERR\]' /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-13T03:41:07.565 DEBUG:teuthology.orchestra.run.trial096:> sudo grep -E '\[WRN\]' /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-13T03:41:07.630 INFO:teuthology.orchestra.run.trial096.stdout:2026-02-13T03:32:27.488029+0000 mon.a (mon.0) 302 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:41:07.631 INFO:tasks.cephadm:Compressing logs... 2026-02-13T03:41:07.631 DEBUG:teuthology.orchestra.run.trial096:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T03:41:07.673 DEBUG:teuthology.orchestra.run.trial132:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T03:41:07.676 DEBUG:teuthology.orchestra.run.trial133:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T03:41:07.696 INFO:teuthology.orchestra.run.trial096.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-13T03:41:07.696 INFO:teuthology.orchestra.run.trial096.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T03:41:07.696 INFO:teuthology.orchestra.run.trial096.stderr:gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mon.a.log 2026-02-13T03:41:07.696 INFO:teuthology.orchestra.run.trial096.stderr:gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.d.log 2026-02-13T03:41:07.696 INFO:teuthology.orchestra.run.trial096.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.j.log 2026-02-13T03:41:07.696 INFO:teuthology.orchestra.run.trial096.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.0.log 2026-02-13T03:41:07.696 INFO:teuthology.orchestra.run.trial096.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.3.log 2026-02-13T03:41:07.696 INFO:teuthology.orchestra.run.trial096.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.cephadm.log 2026-02-13T03:41:07.700 INFO:teuthology.orchestra.run.trial096.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.a.log 2026-02-13T03:41:07.700 INFO:teuthology.orchestra.run.trial096.stderr:gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.g.log 2026-02-13T03:41:07.700 INFO:teuthology.orchestra.run.trial096.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.cephadm.log: 43.3% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.cephadm.log.gz 2026-02-13T03:41:07.700 INFO:teuthology.orchestra.run.trial096.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.audit.log 2026-02-13T03:41:07.700 INFO:teuthology.orchestra.run.trial096.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-volume.log 2026-02-13T03:41:07.700 INFO:teuthology.orchestra.run.trial096.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.6.log 2026-02-13T03:41:07.700 INFO:teuthology.orchestra.run.trial096.stderr: 94.9% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.d.log.gz 2026-02-13T03:41:07.700 INFO:teuthology.orchestra.run.trial096.stderr: 94.7% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T03:41:07.700 INFO:teuthology.orchestra.run.trial096.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-volume.log: 94.9% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.j.log.gz 2026-02-13T03:41:07.700 INFO:teuthology.orchestra.run.trial096.stderr:gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mgr.x.log 2026-02-13T03:41:07.701 INFO:teuthology.orchestra.run.trial096.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.log 2026-02-13T03:41:07.701 INFO:teuthology.orchestra.run.trial096.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.9.log 2026-02-13T03:41:07.701 INFO:teuthology.orchestra.run.trial096.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.log: /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.9.log: 94.9% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.a.log.gz 2026-02-13T03:41:07.701 INFO:teuthology.orchestra.run.trial096.stderr: 94.8% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.g.log.gz 2026-02-13T03:41:07.701 INFO:teuthology.orchestra.run.trial096.stderr: 90.9% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.audit.log.gz 2026-02-13T03:41:07.701 INFO:teuthology.orchestra.run.trial096.stderr: 87.4% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.log.gz 2026-02-13T03:41:07.708 INFO:teuthology.orchestra.run.trial133.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-13T03:41:07.709 INFO:teuthology.orchestra.run.trial133.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T03:41:07.709 INFO:teuthology.orchestra.run.trial133.stderr:gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.2.log 2026-02-13T03:41:07.709 INFO:teuthology.orchestra.run.trial133.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.i.log 2026-02-13T03:41:07.709 INFO:teuthology.orchestra.run.trial133.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mon.c.log 2026-02-13T03:41:07.709 INFO:teuthology.orchestra.run.trial133.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.f.log 2026-02-13T03:41:07.709 INFO:teuthology.orchestra.run.trial133.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.5.log 2026-02-13T03:41:07.709 INFO:teuthology.orchestra.run.trial133.stderr: 93.7% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T03:41:07.709 INFO:teuthology.orchestra.run.trial133.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.11.log 2026-02-13T03:41:07.709 INFO:teuthology.orchestra.run.trial133.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.audit.log 2026-02-13T03:41:07.709 INFO:teuthology.orchestra.run.trial133.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-volume.log 2026-02-13T03:41:07.709 INFO:teuthology.orchestra.run.trial133.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mgr.z.log 2026-02-13T03:41:07.710 INFO:teuthology.orchestra.run.trial133.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.l.log 2026-02-13T03:41:07.710 INFO:teuthology.orchestra.run.trial133.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.c.log 2026-02-13T03:41:07.710 INFO:teuthology.orchestra.run.trial133.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.log 2026-02-13T03:41:07.710 INFO:teuthology.orchestra.run.trial133.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.8.log 2026-02-13T03:41:07.710 INFO:teuthology.orchestra.run.trial133.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.log: 91.0% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.audit.log.gz 2026-02-13T03:41:07.710 INFO:teuthology.orchestra.run.trial133.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.8.log: 87.5% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.log.gz 2026-02-13T03:41:07.710 INFO:teuthology.orchestra.run.trial133.stderr: 95.0% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.l.log.gz 2026-02-13T03:41:07.710 INFO:teuthology.orchestra.run.trial133.stderr: 92.3% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mgr.z.log.gz 2026-02-13T03:41:07.710 INFO:teuthology.orchestra.run.trial132.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T03:41:07.710 INFO:teuthology.orchestra.run.trial132.stderr:: No such file or directory 2026-02-13T03:41:07.711 INFO:teuthology.orchestra.run.trial132.stderr:gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mgr.y.log 2026-02-13T03:41:07.711 INFO:teuthology.orchestra.run.trial132.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.b.log 2026-02-13T03:41:07.711 INFO:teuthology.orchestra.run.trial132.stderr:gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.h.log 2026-02-13T03:41:07.711 INFO:teuthology.orchestra.run.trial132.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mgr.y.log: /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.7.log 2026-02-13T03:41:07.711 INFO:teuthology.orchestra.run.trial132.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.10.log 2026-02-13T03:41:07.711 INFO:teuthology.orchestra.run.trial132.stderr: 92.9% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T03:41:07.711 INFO:teuthology.orchestra.run.trial132.stderr:gzip -5/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.7.log: --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.4.log 2026-02-13T03:41:07.711 INFO:teuthology.orchestra.run.trial132.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.audit.log 2026-02-13T03:41:07.711 INFO:teuthology.orchestra.run.trial132.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mon.b.log 2026-02-13T03:41:07.711 INFO:teuthology.orchestra.run.trial132.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-volume.log 2026-02-13T03:41:07.711 INFO:teuthology.orchestra.run.trial132.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.1.log 2026-02-13T03:41:07.711 INFO:teuthology.orchestra.run.trial132.stderr:gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.log 2026-02-13T03:41:07.712 INFO:teuthology.orchestra.run.trial132.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-volume.log: 92.2% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mgr.y.log.gz 2026-02-13T03:41:07.712 INFO:teuthology.orchestra.run.trial132.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.k.log 2026-02-13T03:41:07.712 INFO:teuthology.orchestra.run.trial132.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.log: gzip -5 --verbose -- /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.e.log 2026-02-13T03:41:07.712 INFO:teuthology.orchestra.run.trial132.stderr: 91.0% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.audit.log.gz 2026-02-13T03:41:07.712 INFO:teuthology.orchestra.run.trial132.stderr:/var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.k.log: /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.e.log: 87.5% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph.log.gz 2026-02-13T03:41:07.712 INFO:teuthology.orchestra.run.trial132.stderr: 94.9% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.k.log.gz 2026-02-13T03:41:07.712 INFO:teuthology.orchestra.run.trial132.stderr: 93.4% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-volume.log.gz 2026-02-13T03:41:07.712 INFO:teuthology.orchestra.run.trial096.stderr: 93.4% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-volume.log.gz 2026-02-13T03:41:07.713 INFO:teuthology.orchestra.run.trial132.stderr: 94.1% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.h.log.gz 2026-02-13T03:41:07.713 INFO:teuthology.orchestra.run.trial133.stderr: 93.8% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-volume.log.gz 2026-02-13T03:41:07.713 INFO:teuthology.orchestra.run.trial133.stderr: 94.3% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.i.log.gz 2026-02-13T03:41:07.713 INFO:teuthology.orchestra.run.trial133.stderr: 95.0% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.f.log.gz 2026-02-13T03:41:07.716 INFO:teuthology.orchestra.run.trial132.stderr: 94.5% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.e.log.gz 2026-02-13T03:41:07.717 INFO:teuthology.orchestra.run.trial133.stderr: 95.0% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.c.log.gz 2026-02-13T03:41:07.730 INFO:teuthology.orchestra.run.trial132.stderr: 93.4% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mds.b.log.gz 2026-02-13T03:41:07.790 INFO:teuthology.orchestra.run.trial133.stderr: 92.1% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mon.c.log.gz 2026-02-13T03:41:07.790 INFO:teuthology.orchestra.run.trial096.stderr: 90.2% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mgr.x.log.gz 2026-02-13T03:41:07.792 INFO:teuthology.orchestra.run.trial132.stderr: 92.0% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mon.b.log.gz 2026-02-13T03:41:07.836 INFO:teuthology.orchestra.run.trial133.stderr: 92.7% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.11.log.gz 2026-02-13T03:41:07.836 INFO:teuthology.orchestra.run.trial096.stderr: 92.4% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.9.log.gz 2026-02-13T03:41:07.855 INFO:teuthology.orchestra.run.trial132.stderr: 92.4% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.4.log.gz 2026-02-13T03:41:07.859 INFO:teuthology.orchestra.run.trial096.stderr: 92.5% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.0.log.gz 2026-02-13T03:41:07.861 INFO:teuthology.orchestra.run.trial096.stderr: 92.3% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.3.log.gz 2026-02-13T03:41:07.864 INFO:teuthology.orchestra.run.trial096.stderr: 92.3% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.6.log.gz 2026-02-13T03:41:07.864 INFO:teuthology.orchestra.run.trial133.stderr: 92.4% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.8.log.gz 2026-02-13T03:41:07.870 INFO:teuthology.orchestra.run.trial132.stderr: 92.5% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.7.log.gz 2026-02-13T03:41:07.887 INFO:teuthology.orchestra.run.trial133.stderr: 92.2% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.2.log.gz 2026-02-13T03:41:07.903 INFO:teuthology.orchestra.run.trial132.stderr: 92.2% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.1.log.gz 2026-02-13T03:41:07.911 INFO:teuthology.orchestra.run.trial133.stderr: 92.2% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.5.log.gz 2026-02-13T03:41:07.913 INFO:teuthology.orchestra.run.trial133.stderr: 2026-02-13T03:41:07.913 INFO:teuthology.orchestra.run.trial133.stderr:real 0m0.220s 2026-02-13T03:41:07.913 INFO:teuthology.orchestra.run.trial133.stderr:user 0m0.772s 2026-02-13T03:41:07.913 INFO:teuthology.orchestra.run.trial133.stderr:sys 0m0.071s 2026-02-13T03:41:07.919 INFO:teuthology.orchestra.run.trial132.stderr: 92.2% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-osd.10.log.gz 2026-02-13T03:41:07.921 INFO:teuthology.orchestra.run.trial132.stderr: 2026-02-13T03:41:07.921 INFO:teuthology.orchestra.run.trial132.stderr:real 0m0.231s 2026-02-13T03:41:07.921 INFO:teuthology.orchestra.run.trial132.stderr:user 0m0.859s 2026-02-13T03:41:07.921 INFO:teuthology.orchestra.run.trial132.stderr:sys 0m0.067s 2026-02-13T03:41:07.993 INFO:teuthology.orchestra.run.trial096.stderr: 90.2% -- replaced with /var/log/ceph/7c123de8-088c-11f1-84f7-d404e6e7d460/ceph-mon.a.log.gz 2026-02-13T03:41:07.994 INFO:teuthology.orchestra.run.trial096.stderr: 2026-02-13T03:41:07.994 INFO:teuthology.orchestra.run.trial096.stderr:real 0m0.308s 2026-02-13T03:41:07.994 INFO:teuthology.orchestra.run.trial096.stderr:user 0m0.993s 2026-02-13T03:41:07.994 INFO:teuthology.orchestra.run.trial096.stderr:sys 0m0.072s 2026-02-13T03:41:07.996 INFO:tasks.cephadm:Archiving logs... 2026-02-13T03:41:07.996 DEBUG:teuthology.misc:Transferring archived files from trial096:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48095/remote/trial096/log 2026-02-13T03:41:07.997 DEBUG:teuthology.orchestra.run.trial096:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T03:41:08.223 DEBUG:teuthology.misc:Transferring archived files from trial132:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48095/remote/trial132/log 2026-02-13T03:41:08.224 DEBUG:teuthology.orchestra.run.trial132:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T03:41:08.340 DEBUG:teuthology.misc:Transferring archived files from trial133:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48095/remote/trial133/log 2026-02-13T03:41:08.341 DEBUG:teuthology.orchestra.run.trial133:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T03:41:08.447 INFO:tasks.cephadm:Removing cluster... 2026-02-13T03:41:08.447 DEBUG:teuthology.orchestra.run.trial096:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 --force 2026-02-13T03:41:08.565 INFO:teuthology.orchestra.run.trial096.stdout:Deleting cluster with fsid: 7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:41:08.728 DEBUG:teuthology.orchestra.run.trial132:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 --force 2026-02-13T03:41:08.849 INFO:teuthology.orchestra.run.trial132.stdout:Deleting cluster with fsid: 7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:41:09.008 DEBUG:teuthology.orchestra.run.trial133:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7c123de8-088c-11f1-84f7-d404e6e7d460 --force 2026-02-13T03:41:09.128 INFO:teuthology.orchestra.run.trial133.stdout:Deleting cluster with fsid: 7c123de8-088c-11f1-84f7-d404e6e7d460 2026-02-13T03:41:09.288 INFO:tasks.cephadm:Removing cephadm ... 2026-02-13T03:41:09.289 DEBUG:teuthology.orchestra.run.trial096:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T03:41:09.307 DEBUG:teuthology.orchestra.run.trial132:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T03:41:09.325 DEBUG:teuthology.orchestra.run.trial133:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T03:41:09.341 INFO:tasks.cephadm:Teardown complete 2026-02-13T03:41:09.342 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephadm.py", line 2025, in task healthy(ctx=ctx, config=config) File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/ceph.py", line 1557, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/ceph_manager.py", line 3393, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy 2026-02-13T03:41:09.344 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-13T03:41:09.359 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-13T03:41:09.373 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-13T03:41:09.373 DEBUG:teuthology.orchestra.run.trial096:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T03:41:09.376 DEBUG:teuthology.orchestra.run.trial132:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T03:41:09.379 DEBUG:teuthology.orchestra.run.trial133:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T03:41:09.620 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-13T03:41:09.632 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-13T03:41:09.632 DEBUG:teuthology.orchestra.run.trial096:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T03:41:09.633 DEBUG:teuthology.orchestra.run.trial132:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T03:41:09.635 DEBUG:teuthology.orchestra.run.trial133:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T03:41:09.648 INFO:teuthology.orchestra.run.trial096.stderr:bash: line 1: ntpq: command not found 2026-02-13T03:41:09.650 INFO:teuthology.orchestra.run.trial132.stderr:bash: line 1: ntpq: command not found 2026-02-13T03:41:09.651 INFO:teuthology.orchestra.run.trial133.stderr:bash: line 1: ntpq: command not found 2026-02-13T03:41:09.672 INFO:teuthology.orchestra.run.trial132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T03:41:09.673 INFO:teuthology.orchestra.run.trial132.stdout:=============================================================================== 2026-02-13T03:41:09.673 INFO:teuthology.orchestra.run.trial132.stdout:^- time-dfw.far.net 2 6 277 48 +12ms[ +12ms] +/- 43ms 2026-02-13T03:41:09.673 INFO:teuthology.orchestra.run.trial132.stdout:^* 172-104-209-204.ip.linod> 4 6 377 50 +13ms[ +13ms] +/- 33ms 2026-02-13T03:41:09.673 INFO:teuthology.orchestra.run.trial132.stdout:^+ 23.186.168.129 2 6 157 46 +10ms[ +10ms] +/- 56ms 2026-02-13T03:41:09.673 INFO:teuthology.orchestra.run.trial132.stdout:^+ t2.time.bf1.yahoo.com 2 6 377 49 -24ms[ -24ms] +/- 42ms 2026-02-13T03:41:09.673 INFO:teuthology.orchestra.run.trial096.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T03:41:09.673 INFO:teuthology.orchestra.run.trial096.stdout:=============================================================================== 2026-02-13T03:41:09.673 INFO:teuthology.orchestra.run.trial096.stdout:^- time-ord.far.net 2 6 377 51 -4326us[-4729us] +/- 31ms 2026-02-13T03:41:09.673 INFO:teuthology.orchestra.run.trial096.stdout:^- ntp.maxhost.io 2 6 357 53 -9280ns[ -412us] +/- 57ms 2026-02-13T03:41:09.673 INFO:teuthology.orchestra.run.trial096.stdout:^- 69-10-208-170.rainiercon> 2 6 377 114 -5038us[-5400us] +/- 91ms 2026-02-13T03:41:09.673 INFO:teuthology.orchestra.run.trial096.stdout:^* pool-96-231-54-40.washdc> 1 6 377 51 -614us[-1017us] +/- 5891us 2026-02-13T03:41:09.682 INFO:teuthology.orchestra.run.trial133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T03:41:09.682 INFO:teuthology.orchestra.run.trial133.stdout:=============================================================================== 2026-02-13T03:41:09.682 INFO:teuthology.orchestra.run.trial133.stdout:^- ntp.shastacoe.net 2 6 377 49 -3631us[-3631us] +/- 69ms 2026-02-13T03:41:09.682 INFO:teuthology.orchestra.run.trial133.stdout:^* pool-96-231-54-40.washdc> 1 6 377 50 -527us[ -734us] +/- 6588us 2026-02-13T03:41:09.682 INFO:teuthology.orchestra.run.trial133.stdout:^- 172-233-157-223.ip.linod> 2 6 377 50 -16ms[ -16ms] +/- 137ms 2026-02-13T03:41:09.682 INFO:teuthology.orchestra.run.trial133.stdout:^- t2.time.gq1.yahoo.com 2 6 377 49 -37ms[ -37ms] +/- 69ms 2026-02-13T03:41:09.683 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-13T03:41:09.694 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-13T03:41:09.694 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-13T03:41:09.708 DEBUG:teuthology.orchestra.run.trial096:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T03:41:09.763 DEBUG:teuthology.orchestra.run.trial132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T03:41:09.809 DEBUG:teuthology.orchestra.run.trial133:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T03:41:09.856 DEBUG:teuthology.orchestra.run.trial096:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T03:41:09.883 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:41:09.884 DEBUG:teuthology.orchestra.run.trial132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T03:41:09.911 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:41:09.912 DEBUG:teuthology.orchestra.run.trial133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T03:41:09.939 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:41:09.940 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-13T03:41:09.955 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-13T03:41:09.969 INFO:teuthology.task.internal:Duration was 710.158743 seconds 2026-02-13T03:41:09.970 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-13T03:41:09.984 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-13T03:41:09.984 DEBUG:teuthology.orchestra.run.trial096:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T03:41:09.987 DEBUG:teuthology.orchestra.run.trial132:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T03:41:09.990 DEBUG:teuthology.orchestra.run.trial133:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T03:41:10.022 INFO:teuthology.orchestra.run.trial096.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T03:41:10.026 INFO:teuthology.orchestra.run.trial132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T03:41:10.028 INFO:teuthology.orchestra.run.trial133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T03:41:10.461 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-13T03:41:10.461 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial096.front.sepia.ceph.com 2026-02-13T03:41:10.461 DEBUG:teuthology.orchestra.run.trial096:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T03:41:10.520 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial132.front.sepia.ceph.com 2026-02-13T03:41:10.521 DEBUG:teuthology.orchestra.run.trial132:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T03:41:10.541 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial133.front.sepia.ceph.com 2026-02-13T03:41:10.541 DEBUG:teuthology.orchestra.run.trial133:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T03:41:10.561 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-13T03:41:10.561 DEBUG:teuthology.orchestra.run.trial096:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T03:41:10.563 DEBUG:teuthology.orchestra.run.trial132:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T03:41:10.583 DEBUG:teuthology.orchestra.run.trial133:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T03:41:10.807 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-13T03:41:10.807 DEBUG:teuthology.orchestra.run.trial096:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T03:41:10.809 DEBUG:teuthology.orchestra.run.trial132:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T03:41:10.812 DEBUG:teuthology.orchestra.run.trial133:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T03:41:10.831 INFO:teuthology.orchestra.run.trial096.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T03:41:10.832 INFO:teuthology.orchestra.run.trial096.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T03:41:10.832 INFO:teuthology.orchestra.run.trial096.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T03:41:10.832 INFO:teuthology.orchestra.run.trial096.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T03:41:10.833 INFO:teuthology.orchestra.run.trial096.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T03:41:10.834 INFO:teuthology.orchestra.run.trial132.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T03:41:10.835 INFO:teuthology.orchestra.run.trial132.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T03:41:10.835 INFO:teuthology.orchestra.run.trial132.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T03:41:10.835 INFO:teuthology.orchestra.run.trial132.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T03:41:10.835 INFO:teuthology.orchestra.run.trial132.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T03:41:10.837 INFO:teuthology.orchestra.run.trial133.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T03:41:10.838 INFO:teuthology.orchestra.run.trial133.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T03:41:10.839 INFO:teuthology.orchestra.run.trial133.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T03:41:10.839 INFO:teuthology.orchestra.run.trial133.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T03:41:10.839 INFO:teuthology.orchestra.run.trial133.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T03:41:10.847 INFO:teuthology.orchestra.run.trial132.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T03:41:10.853 INFO:teuthology.orchestra.run.trial133.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T03:41:10.878 INFO:teuthology.orchestra.run.trial096.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 92.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T03:41:10.880 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-13T03:41:10.896 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-13T03:41:10.896 DEBUG:teuthology.orchestra.run.trial096:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T03:41:10.946 DEBUG:teuthology.orchestra.run.trial132:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T03:41:10.972 DEBUG:teuthology.orchestra.run.trial133:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T03:41:10.998 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-13T03:41:11.014 DEBUG:teuthology.orchestra.run.trial096:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T03:41:11.017 DEBUG:teuthology.orchestra.run.trial132:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T03:41:11.020 DEBUG:teuthology.orchestra.run.trial133:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T03:41:11.039 INFO:teuthology.orchestra.run.trial096.stdout:kernel.core_pattern = core 2026-02-13T03:41:11.049 INFO:teuthology.orchestra.run.trial132.stdout:kernel.core_pattern = core 2026-02-13T03:41:11.062 INFO:teuthology.orchestra.run.trial133.stdout:kernel.core_pattern = core 2026-02-13T03:41:11.092 DEBUG:teuthology.orchestra.run.trial096:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T03:41:11.108 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:41:11.109 DEBUG:teuthology.orchestra.run.trial132:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T03:41:11.128 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:41:11.128 DEBUG:teuthology.orchestra.run.trial133:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T03:41:11.147 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:41:11.148 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-13T03:41:11.163 INFO:teuthology.task.internal:Transferring archived files... 2026-02-13T03:41:11.164 DEBUG:teuthology.misc:Transferring archived files from trial096:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48095/remote/trial096 2026-02-13T03:41:11.165 DEBUG:teuthology.orchestra.run.trial096:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T03:41:11.209 DEBUG:teuthology.misc:Transferring archived files from trial132:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48095/remote/trial132 2026-02-13T03:41:11.209 DEBUG:teuthology.orchestra.run.trial132:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T03:41:11.244 DEBUG:teuthology.misc:Transferring archived files from trial133:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48095/remote/trial133 2026-02-13T03:41:11.245 DEBUG:teuthology.orchestra.run.trial133:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T03:41:11.280 INFO:teuthology.task.internal:Removing archive directory... 2026-02-13T03:41:11.280 DEBUG:teuthology.orchestra.run.trial096:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T03:41:11.283 DEBUG:teuthology.orchestra.run.trial132:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T03:41:11.286 DEBUG:teuthology.orchestra.run.trial133:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T03:41:11.329 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-13T03:41:11.348 INFO:teuthology.task.internal:Not uploading archives. 2026-02-13T03:41:11.349 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-13T03:41:11.364 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-13T03:41:11.364 DEBUG:teuthology.orchestra.run.trial096:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T03:41:11.367 DEBUG:teuthology.orchestra.run.trial132:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T03:41:11.370 DEBUG:teuthology.orchestra.run.trial133:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T03:41:11.381 INFO:teuthology.orchestra.run.trial096.stdout: 791883 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 03:41 /home/ubuntu/cephtest 2026-02-13T03:41:11.385 INFO:teuthology.orchestra.run.trial132.stdout: 786857 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 03:41 /home/ubuntu/cephtest 2026-02-13T03:41:11.386 INFO:teuthology.orchestra.run.trial133.stdout: 791884 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 03:41 /home/ubuntu/cephtest 2026-02-13T03:41:11.388 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-13T03:41:11.404 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-13T03:41:11.443 INFO:teuthology.run:Summary data: description: fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/fs/norstats}} duration: 710.1587431430817 failure_reason: '"2026-02-13T03:32:27.488029+0000 mon.a (mon.0) 302 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL)" in cluster log' flavor: default owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-13T03:41:11.443 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T03:41:11.554 INFO:teuthology.run:FAIL